-- Logs begin at Wed 2022-02-16 16:13:26 UTC, end at Wed 2022-02-16 17:36:17 UTC. -- Feb 16 16:49:09.984993 dv-cinder-829565-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 16 16:49:09.992333 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 16 16:49:09.994323 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Feb 16 16:49:09 2022] *** Feb 16 16:49:09.994323 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 16 16:49:09.994323 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 16 16:49:09.994323 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: nodename: dv-cinder-829565-2-iscsi Feb 16 16:49:09.994323 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: machine: x86_64 Feb 16 16:49:09.994323 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: clock source: unix Feb 16 16:49:09.994323 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: pcre jit disabled Feb 16 16:49:09.994323 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: detected number of CPU cores: 4 Feb 16 16:49:09.994894 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: current working directory: / Feb 16 16:49:09.994894 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: detected binary path: /usr/bin/uwsgi-core Feb 16 16:49:09.994894 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: your processes number limit is 47680 Feb 16 16:49:09.994894 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: your memory page size is 4096 bytes Feb 16 16:49:09.994894 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: detected max file descriptor number: 2048 Feb 16 16:49:09.994894 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: lock engine: pthread robust mutexes Feb 16 16:49:09.994894 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: thunder lock: enabled Feb 16 16:49:09.995766 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 16 16:49:09.995872 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 16 16:49:10.041833 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: Python main interpreter initialized at 0x55de401009c0 Feb 16 16:49:10.041833 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: python threads support enabled Feb 16 16:49:10.041833 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: your server socket listen backlog is limited to 100 connections Feb 16 16:49:10.041833 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: your mercy for graceful operations on workers is 90 seconds Feb 16 16:49:10.042958 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: mapped 403077 bytes (393 KB) for 2 cores Feb 16 16:49:10.043097 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: *** Operational MODE: preforking *** Feb 16 16:49:10.043373 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: *** uWSGI is running in multiple interpreter mode *** Feb 16 16:49:10.043373 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: spawned uWSGI master process (pid: 79455) Feb 16 16:49:10.043580 dv-cinder-829565-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 16 16:49:10.045399 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: spawned uWSGI worker 1 (pid: 79468, cores: 1) Feb 16 16:49:10.046556 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: spawned uWSGI worker 2 (pid: 79469, cores: 1) Feb 16 16:49:10.046556 dv-cinder-829565-2-iscsi devstack@keystone.service[79455]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 16 16:49:15.991507 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 16:49:15.991507 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: from cryptography.utils import int_from_bytes Feb 16 16:49:15.992329 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 16:49:15.992329 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: from cryptography.utils import int_from_bytes Feb 16 16:49:15.996020 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 16:49:15.996020 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: from cryptography.utils import int_from_bytes Feb 16 16:49:15.997233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 16:49:15.997233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: from cryptography.utils import int_from_bytes Feb 16 16:49:16.037869 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 16 16:49:16.038061 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 16 16:49:16.038229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] command line args: [] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 16 16:49:16.038496 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 16 16:49:16.038686 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ================================================================================ {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 16 16:49:16.038942 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] admin_token = **** {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.039191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] config_dir = [] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.039377 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.039558 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] config_source = [] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.039736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] debug = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.039929 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.041086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.041086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.041086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.041086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.041496 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] list_limit = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.041496 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] log_config_append = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.041496 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.042405 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] log_dir = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.042530 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] log_file = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.042866 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.043114 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.043366 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.043612 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.043790 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.043967 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.044211 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.044457 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.044694 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.044926 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.045159 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.045389 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.045470 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 16 16:49:16.045635 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.045717 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 16 16:49:16.045834 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] command line args: [] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 16 16:49:16.045933 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.046107 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 16 16:49:16.046192 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.046285 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ================================================================================ {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 16 16:49:16.046540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] admin_token = **** {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.046627 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.046822 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] config_dir = [] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.046912 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] publish_errors = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.046996 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.047073 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.047154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] config_source = [] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.047259 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.047345 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] debug = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.047437 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.047514 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.047683 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.047783 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.047919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.048001 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.048150 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] standard_threads = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.048246 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.048379 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.048464 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.048621 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.048709 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] list_limit = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.048786 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.048857 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] log_config_append = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.048963 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] use_journal = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.049037 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.049116 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] use_json = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.049187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] log_dir = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.049268 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] use_stderr = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.049351 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] log_file = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.049431 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] use_syslog = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.049508 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.049653 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.049759 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.049906 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.049994 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.050145 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.050240 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.050402 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.050480 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.050616 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.050777 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.050944 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.051034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.051110 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.051181 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.051356 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.051436 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.051589 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.051668 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.051824 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.051925 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.052114 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.052219 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.052309 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.052381 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.052531 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.052616 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.052774 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.052860 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.053031 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.053279 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.053366 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.053460 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] publish_errors = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.053540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.053703 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.053787 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.053940 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.054027 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.054142 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.054220 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.054399 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.054518 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.054711 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.054796 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.054967 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] standard_threads = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.055047 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.055207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.055288 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.055463 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.055553 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.055637 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.055730 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.055830 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] use_journal = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.055964 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.056061 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] use_json = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.056178 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] use_stderr = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.056272 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.056351 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] use_syslog = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.056439 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.056570 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 16:49:16.056657 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.056829 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.056921 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.057073 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.057157 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.057330 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.057425 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.057560 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.057700 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.057845 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.057972 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.058070 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.058152 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.058309 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.058389 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.058550 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.058632 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.058829 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.058925 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.059082 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.059165 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.059322 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.059406 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.059554 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.059644 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.059784 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.059874 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.060014 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.060112 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.060242 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.060385 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.060495 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.060610 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.060715 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.060850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.060958 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.061112 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.061292 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.061371 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.061489 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.061573 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.061708 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.061810 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.061902 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.062059 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.062189 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.062289 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.062377 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.062525 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.062631 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.062784 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.062873 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.063019 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.063106 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.063254 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.063341 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.063489 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.063576 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.063718 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.063796 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.063968 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.064097 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.064212 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.064316 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.064429 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.064501 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.064642 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.064734 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.064900 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.064987 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.065132 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.065224 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.065362 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.065447 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.065598 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.065680 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.065833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.065917 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.066097 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.066195 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.066330 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.066415 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.066562 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.066708 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.066824 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.071926 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.072054 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.072198 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.072303 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.072386 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.072461 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.072543 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.072618 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.072696 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.072770 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.072848 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.072928 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.073013 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.073088 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.073209 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.073288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.073405 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.073489 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.073616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.073694 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.073767 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.073839 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.073917 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.074003 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.074088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.074169 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.074243 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.074315 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.074386 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.074458 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.074529 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.074608 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.074702 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.074777 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.074849 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.074920 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.074992 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.074992 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.075138 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.075218 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.075291 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.075362 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.075433 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.075512 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.075592 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.075665 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.075742 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.075819 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.075891 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.075970 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.076044 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.076114 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.076191 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.076264 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.076335 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.076414 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.076541 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.076624 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.076698 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.076769 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.076840 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.076922 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.076997 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.077068 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.077139 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.077285 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] auth.external = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.077372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.077505 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.077589 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.077669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.077744 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.077823 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.077897 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.077976 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] auth.password = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.078050 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.078121 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] auth.token = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.078193 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.078269 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.078342 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.078421 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.078421 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.078552 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.078623 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.078758 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.078832 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.078921 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.079002 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.079076 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.079147 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.079218 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.079288 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] credential.caching = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.079367 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.079440 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.079516 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.079589 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.079661 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.079732 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.079812 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.079885 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.080042 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.080189 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.080279 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.080355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.080427 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.080499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.080579 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.080653 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.080726 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.080797 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.080869 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.080947 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.081098 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.081174 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.081248 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.081320 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.081427 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.081507 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.081595 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.081673 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.081746 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.081818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.081890 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.081962 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] federation.caching = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.082042 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.082117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.082190 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.082268 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.082342 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] auth.external = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.082422 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.082497 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.082569 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.082658 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.082745 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.082822 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.082906 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.082980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] auth.password = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.083058 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.083200 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] auth.token = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.083285 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.083443 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.083537 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.083682 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.083763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.083934 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.084021 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.084168 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] identity.caching = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.084256 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.084417 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.084497 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.084665 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.084801 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.084901 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.084993 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.085136 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.085218 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] credential.caching = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.085383 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.085470 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.085613 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.085703 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.085850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.085931 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.086102 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.086183 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.086352 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.086440 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.086582 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.086682 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.086837 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.086918 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.087067 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.087160 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.087310 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.087392 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.087558 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.087638 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.087804 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.087893 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.088059 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.088140 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.088309 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.088390 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.089109 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.089206 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.089383 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.089567 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.089647 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] federation.caching = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.089855 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.090071 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.090160 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.090244 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.090347 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.090433 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.090582 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.090683 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.090913 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.090995 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.091156 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.091238 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.091398 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.091488 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.091651 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.091742 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.091882 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.091964 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.092134 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.092223 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.092382 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.092507 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.092617 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.092698 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] identity.caching = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.092863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.092953 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.093111 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.093192 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.093343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.093424 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.093582 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.093672 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.093813 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.093900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.094051 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.094132 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.094287 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.094376 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.094528 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.094610 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.094787 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.094881 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.095024 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.095113 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.095273 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.095353 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.095520 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.095601 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.095752 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.095849 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.095982 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.096063 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.096229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.096310 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.096477 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.096566 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.096711 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.096792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.096943 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.097025 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.097175 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.097264 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.097403 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.user = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.097490 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.097640 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.097721 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.097897 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.097986 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.098127 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.098207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.098371 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.098452 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.098616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.098777 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.098887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.098970 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.099124 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.099205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.099351 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.099440 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.099583 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.099664 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.099815 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.099897 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.100048 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.100141 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.100276 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.100357 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.100521 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.100602 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.100755 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.100847 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.101000 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.101082 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.101234 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.101315 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.101477 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.101566 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.101703 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.101783 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.101946 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.102026 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.102182 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.102272 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.102420 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.102501 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.102688 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.102772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.102917 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.103011 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.103162 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.103243 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.103397 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.103477 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.103635 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.103789 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.103889 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.103969 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.104117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.104230 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.105081 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.105267 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.105349 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.105411 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.105538 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.105682 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.user = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.105778 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.105857 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.106265 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.106354 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.106507 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.106586 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.106766 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.106850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.107006 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.107086 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.107247 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] resource.caching = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.107326 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.107501 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.107582 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.107751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.107830 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.107988 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.108068 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.108240 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.108327 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.108481 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.108560 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.108713 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.108792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.108960 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.109040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.109200 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.109280 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.109439 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.109518 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.109672 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] role.caching = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.109856 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.109945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] role.driver = sql {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.110018 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.110135 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.110215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.110383 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.110463 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.110631 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.110729 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.110902 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.110991 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.111147 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.111228 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.111392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.111471 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.111637 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.111716 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.111882 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.111962 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.112128 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.112207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.112360 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.112471 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.112607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.112728 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.112852 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.112997 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.113098 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.113240 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.113347 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.113501 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.113745 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.113867 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.113984 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.114063 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.114239 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.114320 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.114489 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.114566 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.114755 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.114839 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.115001 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] resource.caching = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.115082 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.115233 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.115312 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.115488 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.115575 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.115732 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.115810 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.115970 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.116048 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.116201 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.116288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.116433 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.116511 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.116663 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.116743 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.116913 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.117000 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.117163 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.117241 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.117404 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] role.caching = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.117483 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.117636 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.117722 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] role.driver = sql {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.117870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.117950 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.118099 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.118178 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.118333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] token.caching = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.118419 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.118568 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.118664 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.118839 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.118918 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.119073 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.119164 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.119334 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.119414 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.119580 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.119659 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.119833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.119927 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.120082 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.120244 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.120365 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.120538 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.120685 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.120793 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.120868 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.121002 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.121082 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.121235 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.121315 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.121481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.121711 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.121791 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.121944 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.122022 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.122183 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.122275 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.122440 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.122519 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.122718 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.122807 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.connection = **** {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.122974 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.123064 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.123215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.123296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.123449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.123528 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.123688 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.123768 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.123924 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.124005 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.124159 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.124239 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.124394 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.124471 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.124625 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.124704 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.124868 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.124948 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.125103 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.125190 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.125344 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.125424 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.125577 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.125656 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.125820 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.125906 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.126071 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.126146 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.126281 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] token.caching = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.126361 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.126507 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.126585 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.126767 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.126850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.127002 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.127084 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.127156 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 16 16:49:16.127262 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.127516 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.127757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.128029 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.128276 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.128553 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.128797 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.129049 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.129296 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.129548 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.129824 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.130059 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.130305 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.130616 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.130907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.connection = **** {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.131159 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.131414 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.131659 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.131926 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.132169 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.132412 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.132653 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.132894 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.133143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.133384 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.133634 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.133872 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.134125 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.134363 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.134707 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.135027 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.135346 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.135641 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 16:49:16.135818 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 16 16:49:16.156810 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.157038 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.157261 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.162937 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.163173 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.163401 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.166021 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.172943 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.196578 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.196804 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.202560 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.202816 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.250790 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.251888 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.302462 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.302710 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.302917 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.303156 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.368864 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.369088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.369308 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.369522 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.369605 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.369736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.369844 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.370549 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.370639 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.370803 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.371047 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.371268 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.393979 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.394270 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.394387 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.394498 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.394624 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.394749 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.394882 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.394965 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.395110 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.395191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.395335 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.395418 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.395553 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.395792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.406608 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.407255 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.419699 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.419925 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.420145 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.420361 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.420443 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.420572 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.420656 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.420788 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.420871 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.420997 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79469) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.421089 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.421222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.421463 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.421681 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 16:49:16.438218 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.438422 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 16 16:49:16.438788 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.438990 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 16 16:49:16.439108 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.439258 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.439340 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 16 16:49:16.439517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.439641 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.439772 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.439854 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 16 16:49:16.440027 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.440108 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.440347 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.440606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.440860 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.451366 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.451638 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.451901 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.452177 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.452327 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.452606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.452877 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.453161 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.460234 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79469) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.461418 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.463434 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79469) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.464370 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.464657 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.464922 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.465195 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.465384 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.465467 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.465664 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.465755 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.465947 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.466030 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.466206 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.466288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.466472 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.466554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.466757 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.466843 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.467048 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.467320 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.467589 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.467859 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.468124 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.494441 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.496069 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79469) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.496335 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.496666 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.498278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.498559 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.501500 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79469) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.503810 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.504099 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.603763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.604097 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.607849 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.612633 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79469) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.612919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.615529 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.615817 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.617286 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79469) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.617570 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.617847 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.618122 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.618387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.618669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.619091 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.619363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.620342 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.620628 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.620911 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.621193 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.621470 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.621743 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.622011 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.622436 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.637569 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.637893 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.641213 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.641493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.642380 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79469) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.645915 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.646137 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.646221 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.649968 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.650261 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.651756 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79469) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.655688 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79469) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.656142 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.659271 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.659566 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.659846 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.659932 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.660133 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.660405 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.660798 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.663552 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.663864 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.664179 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.664493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.664811 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.665120 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.679558 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79469) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.679846 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.680107 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.680363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.685404 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.685687 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.685991 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.686271 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.688829 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.690494 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.690792 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.693758 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79469) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.694034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.694314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.694400 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.694584 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.694878 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.696191 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.696490 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.700236 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.700518 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.700799 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.701084 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.701366 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.708627 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79469) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.708903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.709174 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.709452 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.709725 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.710014 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.710282 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.715151 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.715436 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.715719 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.716020 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.716320 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.716619 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.716904 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.732941 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79469) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.735801 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.736282 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79469) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.739144 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.739527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.741092 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.742695 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79469) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.742781 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.742976 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.743253 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.744325 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.746720 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.747026 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.747313 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.750993 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.752706 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79469) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.754842 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.755823 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.756108 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.756391 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.756474 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.756662 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.759748 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.760038 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.760323 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.761284 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.766191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79469) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.766473 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.766781 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.770766 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.771058 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.771340 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.774662 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79469) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.774944 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.775216 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.775483 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.775751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.776056 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.776366 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.776631 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.776892 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.777160 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.777425 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.777689 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.777976 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.778227 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79469) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.779602 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 16:49:16.779884 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.780197 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.780509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.780803 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.781107 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.781382 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.781661 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.781939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.782219 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.782490 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.782815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.783111 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.783375 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 16:49:16.815735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55de401009c0 pid: 79469 (default app) Feb 16 16:49:16.819000 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e28d1-2340-4868-9b90-58ce2f478a88 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:16.819292 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e28d1-2340-4868-9b90-58ce2f478a88 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:16.819563 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e28d1-2340-4868-9b90-58ce2f478a88 None None] PATH_INFO: `/v3` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:16.822521 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55de401009c0 pid: 79468 (default app) Feb 16 16:49:16.824406 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Wed Feb 16 16:49:16 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:26.302973 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b4dee-3b49-4ca4-94d8-729ca7ac707e None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:26.303478 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b4dee-3b49-4ca4-94d8-729ca7ac707e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:26.303559 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b4dee-3b49-4ca4-94d8-729ca7ac707e None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:26.308620 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:49:26.314126 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb24d50-c2b6-43e3-8d92-158dc1bb3d8c None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:26.314517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb24d50-c2b6-43e3-8d92-158dc1bb3d8c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:26.314750 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb24d50-c2b6-43e3-8d92-158dc1bb3d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:26.346517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG oslo_db.sqlalchemy.engines [None req-1bb24d50-c2b6-43e3-8d92-158dc1bb3d8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79469) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 16:49:26.535125 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG passlib.handlers.bcrypt [None req-1bb24d50-c2b6-43e3-8d92-158dc1bb3d8c None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79469) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 16 16:49:26.535547 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG passlib.handlers.bcrypt [None req-1bb24d50-c2b6-43e3-8d92-158dc1bb3d8c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79469) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 16 16:49:26.590951 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-1bb24d50-c2b6-43e3-8d92-158dc1bb3d8c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:26.592472 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-1bb24d50-c2b6-43e3-8d92-158dc1bb3d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:26.712701 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:26.895878 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b4dee-3b49-4ca4-94d8-729ca7ac707e None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:26.929543 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG oslo_db.sqlalchemy.engines [None req-387b4dee-3b49-4ca4-94d8-729ca7ac707e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 16:49:27.057398 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b4dee-3b49-4ca4-94d8-729ca7ac707e None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:27.061811 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfe2ab-769e-40f8-aa69-705187f20ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:27.062463 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfe2ab-769e-40f8-aa69-705187f20ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:27.062791 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfe2ab-769e-40f8-aa69-705187f20ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:27.063073 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfe2ab-769e-40f8-aa69-705187f20ec8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:27.071036 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfe2ab-769e-40f8-aa69-705187f20ec8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:27.124843 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9ecfe2ab-769e-40f8-aa69-705187f20ec8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 16 16:49:27.125280 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfe2ab-769e-40f8-aa69-705187f20ec8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:27.137654 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:49:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:49:27.143730 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb24d50-c2b6-43e3-8d92-158dc1bb3d8c None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:27.160261 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb24d50-c2b6-43e3-8d92-158dc1bb3d8c None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:27.164669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725cad9-94c6-42ac-8e5d-1040492621ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:27.165792 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725cad9-94c6-42ac-8e5d-1040492621ab admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:27.166077 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725cad9-94c6-42ac-8e5d-1040492621ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:27.166413 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725cad9-94c6-42ac-8e5d-1040492621ab admin admin] PATH_INFO: `/v3/projects/604997d855554910a2aa75344774960d` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:27.168307 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725cad9-94c6-42ac-8e5d-1040492621ab admin admin] RBAC: Authorizing `identity:get_project(project_id=604997d855554910a2aa75344774960d)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:27.220453 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a725cad9-94c6-42ac-8e5d-1040492621ab admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 16 16:49:27.220794 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725cad9-94c6-42ac-8e5d-1040492621ab admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:27.225322 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:49:27 2022] GET /identity/v3/projects/604997d855554910a2aa75344774960d => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:29.534829 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee1ec1-254f-4426-a98a-d3812e512fe9 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:29.535242 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee1ec1-254f-4426-a98a-d3812e512fe9 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:29.535393 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee1ec1-254f-4426-a98a-d3812e512fe9 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:29.540074 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:29.546236 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e343d-66b7-4430-a1e1-254f27d9028b None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:29.546631 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e343d-66b7-4430-a1e1-254f27d9028b None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:29.546831 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e343d-66b7-4430-a1e1-254f27d9028b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:29.565659 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-ed3e343d-66b7-4430-a1e1-254f27d9028b None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:29.567190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-ed3e343d-66b7-4430-a1e1-254f27d9028b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:29.575416 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:29.599193 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee1ec1-254f-4426-a98a-d3812e512fe9 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:29.612118 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee1ec1-254f-4426-a98a-d3812e512fe9 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:29.616305 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55930279-324b-4fbf-8ede-8823bcca9e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:29.616955 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55930279-324b-4fbf-8ede-8823bcca9e56 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:29.617235 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55930279-324b-4fbf-8ede-8823bcca9e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:29.617509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55930279-324b-4fbf-8ede-8823bcca9e56 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:29.624953 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55930279-324b-4fbf-8ede-8823bcca9e56 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:29.626730 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55930279-324b-4fbf-8ede-8823bcca9e56 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:29.635212 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:49:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:49:29.640664 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e343d-66b7-4430-a1e1-254f27d9028b None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:29.649565 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e343d-66b7-4430-a1e1-254f27d9028b None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:29.654702 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b114163-762d-4743-9b25-4fb7bca55c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:29.655550 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b114163-762d-4743-9b25-4fb7bca55c49 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:29.655830 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b114163-762d-4743-9b25-4fb7bca55c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:29.656106 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b114163-762d-4743-9b25-4fb7bca55c49 admin admin] PATH_INFO: `/v3/users/b96481fed12c49429f583e04dace6093` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:29.657496 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b114163-762d-4743-9b25-4fb7bca55c49 admin admin] RBAC: Authorizing `identity:get_user(user_id=b96481fed12c49429f583e04dace6093)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:29.660500 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b114163-762d-4743-9b25-4fb7bca55c49 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:29.663391 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:29 2022] GET /identity/v3/users/b96481fed12c49429f583e04dace6093 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:32.031135 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159adc4-8285-40ad-8489-e041ab07e8ee None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:32.031656 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159adc4-8285-40ad-8489-e041ab07e8ee None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:32.031729 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159adc4-8285-40ad-8489-e041ab07e8ee None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:32.033430 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:32.038620 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ac268-cd12-4365-a98a-2792afd1f653 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:32.039040 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ac268-cd12-4365-a98a-2792afd1f653 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:32.039217 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ac268-cd12-4365-a98a-2792afd1f653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:32.057839 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-164ac268-cd12-4365-a98a-2792afd1f653 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:32.059127 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-164ac268-cd12-4365-a98a-2792afd1f653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:32.066623 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 6/11] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:49:32.090439 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159adc4-8285-40ad-8489-e041ab07e8ee None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:32.091206 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dbd33-7c0c-452f-85cf-ac48812edd12 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:32.091500 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dbd33-7c0c-452f-85cf-ac48812edd12 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:32.091782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dbd33-7c0c-452f-85cf-ac48812edd12 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:32.093787 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 7/12] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:49:32.098844 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf782c-0e8a-42ec-be1c-1c077c48913a None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:32.099132 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf782c-0e8a-42ec-be1c-1c077c48913a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:32.099409 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf782c-0e8a-42ec-be1c-1c077c48913a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:32.102522 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159adc4-8285-40ad-8489-e041ab07e8ee None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:32.107545 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d34ed-c8f6-48a5-aaf1-f51a26e91534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:32.108317 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d34ed-c8f6-48a5-aaf1-f51a26e91534 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:32.108594 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d34ed-c8f6-48a5-aaf1-f51a26e91534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:32.108865 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d34ed-c8f6-48a5-aaf1-f51a26e91534 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:32.118621 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-2aaf782c-0e8a-42ec-be1c-1c077c48913a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:32.120530 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2aaf782c-0e8a-42ec-be1c-1c077c48913a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:32.125722 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d34ed-c8f6-48a5-aaf1-f51a26e91534 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:32.128557 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 8/13] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:49:32.132769 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-805d34ed-c8f6-48a5-aaf1-f51a26e91534 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:49:32.134104 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 6/14] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:49:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:49:32.139798 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf782c-0e8a-42ec-be1c-1c077c48913a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:32.148833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf782c-0e8a-42ec-be1c-1c077c48913a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:32.150119 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d34ed-c8f6-48a5-aaf1-f51a26e91534 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:32.153317 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481895c-e72b-48c2-aba2-b6f1230ff3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:32.153955 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481895c-e72b-48c2-aba2-b6f1230ff3ab admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:32.154233 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481895c-e72b-48c2-aba2-b6f1230ff3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:32.154503 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481895c-e72b-48c2-aba2-b6f1230ff3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:32.155295 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481895c-e72b-48c2-aba2-b6f1230ff3ab admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:32.155595 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481895c-e72b-48c2-aba2-b6f1230ff3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:32.157325 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-8481895c-e72b-48c2-aba2-b6f1230ff3ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:49:32.157325 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 16:49:32.157325 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 16:49:32.158207 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481895c-e72b-48c2-aba2-b6f1230ff3ab admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:32.160660 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d34ed-c8f6-48a5-aaf1-f51a26e91534 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:32.165148 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c7d2d-c28e-4c1f-aad7-592a5295adb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:32.165813 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c7d2d-c28e-4c1f-aad7-592a5295adb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:32.166622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c7d2d-c28e-4c1f-aad7-592a5295adb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:32.166942 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c7d2d-c28e-4c1f-aad7-592a5295adb1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:32.172612 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 9/15] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:49:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:32.175095 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c7d2d-c28e-4c1f-aad7-592a5295adb1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:32.176865 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c7d2d-c28e-4c1f-aad7-592a5295adb1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:32.178016 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481895c-e72b-48c2-aba2-b6f1230ff3ab admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:32.186475 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 7/16] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:49:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 16:49:32.187688 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481895c-e72b-48c2-aba2-b6f1230ff3ab admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:32.191936 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c7d2d-c28e-4c1f-aad7-592a5295adb1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:32.192065 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7c6cc-7f3f-4e44-b467-aff80f6f2ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:32.192809 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7c6cc-7f3f-4e44-b467-aff80f6f2ebe admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:32.193083 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7c6cc-7f3f-4e44-b467-aff80f6f2ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:32.193349 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7c6cc-7f3f-4e44-b467-aff80f6f2ebe admin admin] PATH_INFO: `/v3/users/b96481fed12c49429f583e04dace6093` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:32.194526 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7c6cc-7f3f-4e44-b467-aff80f6f2ebe admin admin] RBAC: Authorizing `identity:get_user(user_id=b96481fed12c49429f583e04dace6093)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:32.196328 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7c6cc-7f3f-4e44-b467-aff80f6f2ebe admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:32.197891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 10/17] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:32 2022] GET /identity/v3/users/b96481fed12c49429f583e04dace6093 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:32.200565 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c7d2d-c28e-4c1f-aad7-592a5295adb1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:32.202861 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7c6cc-7f3f-4e44-b467-aff80f6f2ebe admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:32.205090 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebe09f-ee17-4fa8-a0d6-7c19128fca81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:32.205864 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebe09f-ee17-4fa8-a0d6-7c19128fca81 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:32.206147 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebe09f-ee17-4fa8-a0d6-7c19128fca81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:32.206425 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebe09f-ee17-4fa8-a0d6-7c19128fca81 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:32.207922 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebe09f-ee17-4fa8-a0d6-7c19128fca81 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:32.209612 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebe09f-ee17-4fa8-a0d6-7c19128fca81 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:32.211222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 8/18] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:49:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:32.212141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7c6cc-7f3f-4e44-b467-aff80f6f2ebe admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:32.216716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a99f6-9527-4330-9a50-299f1c4fd332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:32.217516 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a99f6-9527-4330-9a50-299f1c4fd332 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:32.217802 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a99f6-9527-4330-9a50-299f1c4fd332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:32.218076 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a99f6-9527-4330-9a50-299f1c4fd332 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:32.219334 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a99f6-9527-4330-9a50-299f1c4fd332 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:32.221097 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a99f6-9527-4330-9a50-299f1c4fd332 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:32.222815 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 11/19] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:49:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:32.229482 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebe09f-ee17-4fa8-a0d6-7c19128fca81 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:32.239778 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebe09f-ee17-4fa8-a0d6-7c19128fca81 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:32.244859 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c588c44-8fa8-4892-b2b2-6217d617e80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:32.245701 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c588c44-8fa8-4892-b2b2-6217d617e80b admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:32.245989 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c588c44-8fa8-4892-b2b2-6217d617e80b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:32.246264 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c588c44-8fa8-4892-b2b2-6217d617e80b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:32.247170 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c588c44-8fa8-4892-b2b2-6217d617e80b admin admin] RBAC: Adding query filter params (role.id=8263a29ceeed4576b3b6959c99964ed7, scope.domain.id=default, user.id=b96481fed12c49429f583e04dace6093) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:32.247480 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c588c44-8fa8-4892-b2b2-6217d617e80b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:32.249272 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING py.warnings [None req-4c588c44-8fa8-4892-b2b2-6217d617e80b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:49:32.249272 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: warnings.warn(msg) Feb 16 16:49:32.249272 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: Feb 16 16:49:32.250452 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c588c44-8fa8-4892-b2b2-6217d617e80b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:32.260590 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 9/20] 10.222.0.42 () {56 vars in 1343 bytes} [Wed Feb 16 16:49:32 2022] GET /identity/v3/role_assignments?user.id=b96481fed12c49429f583e04dace6093&scope.domain.id=default&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 233 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:34.996236 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ab125-1ca9-4de0-942a-b53b40d0eb76 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:34.997383 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ab125-1ca9-4de0-942a-b53b40d0eb76 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:34.997890 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ab125-1ca9-4de0-942a-b53b40d0eb76 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:35.000247 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 12/21] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:35.016519 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b815b-ba06-4c5f-a25a-0093562fea9d None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:35.017416 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b815b-ba06-4c5f-a25a-0093562fea9d None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:35.017889 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b815b-ba06-4c5f-a25a-0093562fea9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:35.029879 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7861bb-751f-4b12-a98e-6cd02756be20 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:35.030161 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7861bb-751f-4b12-a98e-6cd02756be20 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:35.030613 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7861bb-751f-4b12-a98e-6cd02756be20 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:35.032908 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 13/22] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:35.052295 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c21e7-c57e-4f09-a8d4-832247129b86 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:35.052904 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c21e7-c57e-4f09-a8d4-832247129b86 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:35.053407 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c21e7-c57e-4f09-a8d4-832247129b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:35.065208 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG passlib.handlers.bcrypt [None req-d18b815b-ba06-4c5f-a25a-0093562fea9d None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79468) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 16 16:49:35.065611 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG passlib.handlers.bcrypt [None req-d18b815b-ba06-4c5f-a25a-0093562fea9d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79468) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 16 16:49:35.080048 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-9f3c21e7-c57e-4f09-a8d4-832247129b86 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:35.081560 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-9f3c21e7-c57e-4f09-a8d4-832247129b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:35.097127 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 14/23] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:35.122411 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-d18b815b-ba06-4c5f-a25a-0093562fea9d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:35.124072 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d18b815b-ba06-4c5f-a25a-0093562fea9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:35.152447 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c21e7-c57e-4f09-a8d4-832247129b86 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:35.156653 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 10/24] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:35.171893 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c21e7-c57e-4f09-a8d4-832247129b86 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:35.184897 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893d485-939c-4fa3-8792-71546dd0b9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:35.185717 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893d485-939c-4fa3-8792-71546dd0b9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:35.185992 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893d485-939c-4fa3-8792-71546dd0b9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:35.186262 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893d485-939c-4fa3-8792-71546dd0b9d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:35.191542 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b815b-ba06-4c5f-a25a-0093562fea9d None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:35.202087 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b815b-ba06-4c5f-a25a-0093562fea9d None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:35.208626 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc799a-9d90-4bcc-a632-b3b21435c0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:35.209264 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893d485-939c-4fa3-8792-71546dd0b9d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:35.211437 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893d485-939c-4fa3-8792-71546dd0b9d1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:35.212952 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc799a-9d90-4bcc-a632-b3b21435c0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:35.213729 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc799a-9d90-4bcc-a632-b3b21435c0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:35.214398 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc799a-9d90-4bcc-a632-b3b21435c0c4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:35.236720 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-9893d485-939c-4fa3-8792-71546dd0b9d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:49:35.237354 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc799a-9d90-4bcc-a632-b3b21435c0c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:35.238357 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 15/25] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:49:35.239712 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d7c57-728d-4cd3-9d2c-8b4f3baa2817 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:35.239996 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d7c57-728d-4cd3-9d2c-8b4f3baa2817 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:35.240269 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d7c57-728d-4cd3-9d2c-8b4f3baa2817 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:35.242205 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 16/26] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:35.246351 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-77dc799a-9d90-4bcc-a632-b3b21435c0c4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:49:35.246883 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d7c57-728d-4cd3-9d2c-8b4f3baa2817 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:35.248240 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 11/27] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:49:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:49:35.249659 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4337655-4428-429d-ac00-17dc4227fa4b None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:35.250165 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4337655-4428-429d-ac00-17dc4227fa4b None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:35.250664 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4337655-4428-429d-ac00-17dc4227fa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:35.270672 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-e4337655-4428-429d-ac00-17dc4227fa4b None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:35.272188 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e4337655-4428-429d-ac00-17dc4227fa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:35.272311 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d7c57-728d-4cd3-9d2c-8b4f3baa2817 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:35.282576 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb40d8-ce01-4a59-a1d4-c0ac589f2922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:35.283621 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb40d8-ce01-4a59-a1d4-c0ac589f2922 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:35.284622 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb40d8-ce01-4a59-a1d4-c0ac589f2922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:35.286145 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 12/28] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:35.286754 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb40d8-ce01-4a59-a1d4-c0ac589f2922 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:35.287723 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb40d8-ce01-4a59-a1d4-c0ac589f2922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:35.288747 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4337655-4428-429d-ac00-17dc4227fa4b None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:35.289268 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb40d8-ce01-4a59-a1d4-c0ac589f2922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:35.290499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-52fb40d8-ce01-4a59-a1d4-c0ac589f2922 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:49:35.290499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 16:49:35.290499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 16:49:35.293256 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb40d8-ce01-4a59-a1d4-c0ac589f2922 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:35.306448 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4337655-4428-429d-ac00-17dc4227fa4b None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:35.325019 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 17/29] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:35.326930 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdb1b1-3bc3-4b71-b5e5-caaf4486478d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:35.327859 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdb1b1-3bc3-4b71-b5e5-caaf4486478d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:35.328353 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdb1b1-3bc3-4b71-b5e5-caaf4486478d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:35.328839 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdb1b1-3bc3-4b71-b5e5-caaf4486478d admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:35.329806 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdb1b1-3bc3-4b71-b5e5-caaf4486478d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:35.330340 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdb1b1-3bc3-4b71-b5e5-caaf4486478d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:35.331639 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING py.warnings [None req-6fbdb1b1-3bc3-4b71-b5e5-caaf4486478d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:49:35.331639 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: warnings.warn(msg) Feb 16 16:49:35.331639 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: Feb 16 16:49:35.332945 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdb1b1-3bc3-4b71-b5e5-caaf4486478d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:35.333956 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb40d8-ce01-4a59-a1d4-c0ac589f2922 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:35.355152 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb40d8-ce01-4a59-a1d4-c0ac589f2922 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:35.360180 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 13/30] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:49:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:35.361616 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdb1b1-3bc3-4b71-b5e5-caaf4486478d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:35.370779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7411f6-2a22-4580-a818-6d79145900b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:35.371826 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7411f6-2a22-4580-a818-6d79145900b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:35.372329 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7411f6-2a22-4580-a818-6d79145900b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:35.372829 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7411f6-2a22-4580-a818-6d79145900b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:35.373803 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7411f6-2a22-4580-a818-6d79145900b1 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:35.375092 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-8c7411f6-2a22-4580-a818-6d79145900b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:49:35.375092 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 16:49:35.375092 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 16:49:35.378409 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7411f6-2a22-4580-a818-6d79145900b1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:35.386058 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdb1b1-3bc3-4b71-b5e5-caaf4486478d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:35.398112 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439aa463-cb9b-457c-b0b0-a5d7fcf5d658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:35.398112 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439aa463-cb9b-457c-b0b0-a5d7fcf5d658 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:35.398112 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439aa463-cb9b-457c-b0b0-a5d7fcf5d658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:35.398112 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439aa463-cb9b-457c-b0b0-a5d7fcf5d658 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:35.398493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439aa463-cb9b-457c-b0b0-a5d7fcf5d658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:35.398493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING py.warnings [None req-439aa463-cb9b-457c-b0b0-a5d7fcf5d658 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:49:35.398493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: warnings.warn(msg) Feb 16 16:49:35.398493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: Feb 16 16:49:35.398493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439aa463-cb9b-457c-b0b0-a5d7fcf5d658 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:35.698303 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 18/31] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 16:49:35 2022] POST /identity/v3/roles => generated 219 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:49:35.699460 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7411f6-2a22-4580-a818-6d79145900b1 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:35.729553 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7411f6-2a22-4580-a818-6d79145900b1 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:35.745011 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db6bf9-10ba-4802-8f30-a5e61f61f6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:35.748309 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db6bf9-10ba-4802-8f30-a5e61f61f6df admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:35.748309 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db6bf9-10ba-4802-8f30-a5e61f61f6df admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:35.748309 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db6bf9-10ba-4802-8f30-a5e61f61f6df admin admin] PATH_INFO: `/v3/users/b96481fed12c49429f583e04dace6093` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:35.749599 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db6bf9-10ba-4802-8f30-a5e61f61f6df admin admin] RBAC: Authorizing `identity:get_user(user_id=b96481fed12c49429f583e04dace6093)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:35.751860 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db6bf9-10ba-4802-8f30-a5e61f61f6df admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:35.759217 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 19/32] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:35 2022] GET /identity/v3/users/b96481fed12c49429f583e04dace6093 => generated 247 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:35.761823 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 14/33] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Feb 16 16:49:35 2022] POST /identity/v3/projects => generated 301 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:49:35.763640 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e0db4-78da-4f8a-9e97-541157e6a9c1 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:35.764707 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e0db4-78da-4f8a-9e97-541157e6a9c1 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:35.766046 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439aa463-cb9b-457c-b0b0-a5d7fcf5d658 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:35.766586 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e0db4-78da-4f8a-9e97-541157e6a9c1 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:35.769312 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 20/34] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:35.775792 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634bb6f-17ba-4041-b1c8-d2de291fb46a None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:35.776100 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634bb6f-17ba-4041-b1c8-d2de291fb46a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:35.776472 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634bb6f-17ba-4041-b1c8-d2de291fb46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:35.817338 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-2634bb6f-17ba-4041-b1c8-d2de291fb46a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:35.819837 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2634bb6f-17ba-4041-b1c8-d2de291fb46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:35.969556 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439aa463-cb9b-457c-b0b0-a5d7fcf5d658 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:35.980869 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b30bd-c052-4a3f-887f-d665221cac4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:35.981688 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 21/35] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:49:35.984974 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b30bd-c052-4a3f-887f-d665221cac4d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:35.984974 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b30bd-c052-4a3f-887f-d665221cac4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:35.984974 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b30bd-c052-4a3f-887f-d665221cac4d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:35.984974 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b30bd-c052-4a3f-887f-d665221cac4d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:35.986015 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b30bd-c052-4a3f-887f-d665221cac4d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:35.993611 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 15/36] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:49:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:35.998411 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634bb6f-17ba-4041-b1c8-d2de291fb46a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:36.012821 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634bb6f-17ba-4041-b1c8-d2de291fb46a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:36.020297 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b30bd-c052-4a3f-887f-d665221cac4d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:36.023406 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcaf8f-6557-4d34-82f4-a5c7f4706163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:36.024304 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcaf8f-6557-4d34-82f4-a5c7f4706163 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:36.024584 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcaf8f-6557-4d34-82f4-a5c7f4706163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:36.024867 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcaf8f-6557-4d34-82f4-a5c7f4706163 admin admin] PATH_INFO: `/v3/domains/default/users/b96481fed12c49429f583e04dace6093/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:36.028229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcaf8f-6557-4d34-82f4-a5c7f4706163 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b96481fed12c49429f583e04dace6093, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:36.029363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-8ebcaf8f-6557-4d34-82f4-a5c7f4706163 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:49:36.029363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 16:49:36.029363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 16:49:36.031350 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcaf8f-6557-4d34-82f4-a5c7f4706163 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:36.032667 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b30bd-c052-4a3f-887f-d665221cac4d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:36.038483 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1773c-3196-4835-a4d6-d02e0790708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:36.039189 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1773c-3196-4835-a4d6-d02e0790708d admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:36.039512 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1773c-3196-4835-a4d6-d02e0790708d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:36.039833 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1773c-3196-4835-a4d6-d02e0790708d admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:36.040606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1773c-3196-4835-a4d6-d02e0790708d admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:36.041828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING py.warnings [None req-4be1773c-3196-4835-a4d6-d02e0790708d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:49:36.041828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: warnings.warn(msg) Feb 16 16:49:36.041828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: Feb 16 16:49:36.042939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1773c-3196-4835-a4d6-d02e0790708d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:36.165893 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 22/37] 10.222.0.42 () {58 vars in 1382 bytes} [Wed Feb 16 16:49:35 2022] PUT /identity/v3/domains/default/users/b96481fed12c49429f583e04dace6093/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:49:36.196553 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 16/38] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 16:49:36 2022] POST /identity/v3/roles => generated 225 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 16:49:36.585591 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30416d47-a967-4863-affc-cef12650cbce None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:36.585923 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30416d47-a967-4863-affc-cef12650cbce None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:36.586147 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30416d47-a967-4863-affc-cef12650cbce None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:36.588187 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 23/39] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:36.593891 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4be962-36e7-4113-af2a-22fe0b2e5cbd None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:36.594177 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4be962-36e7-4113-af2a-22fe0b2e5cbd None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:36.594385 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fceb430-5fbe-4c67-aec4-879cc6eff262 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:36.594488 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4be962-36e7-4113-af2a-22fe0b2e5cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:36.594713 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fceb430-5fbe-4c67-aec4-879cc6eff262 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:36.594998 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fceb430-5fbe-4c67-aec4-879cc6eff262 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:36.596859 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 24/40] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:49:36.601692 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4262f2c-62d4-46c1-8692-18dfc73c2de1 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:36.601987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4262f2c-62d4-46c1-8692-18dfc73c2de1 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:36.602272 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4262f2c-62d4-46c1-8692-18dfc73c2de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:36.614373 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-fa4be962-36e7-4113-af2a-22fe0b2e5cbd None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:36.615932 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-fa4be962-36e7-4113-af2a-22fe0b2e5cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:36.626427 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-e4262f2c-62d4-46c1-8692-18dfc73c2de1 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:36.627655 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e4262f2c-62d4-46c1-8692-18dfc73c2de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:36.679951 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 17/41] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:36.687306 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 25/42] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:49:36.710104 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4be962-36e7-4113-af2a-22fe0b2e5cbd None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:36.712316 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4262f2c-62d4-46c1-8692-18dfc73c2de1 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:36.720152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4be962-36e7-4113-af2a-22fe0b2e5cbd None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:36.721903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4262f2c-62d4-46c1-8692-18dfc73c2de1 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:36.724567 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fd90c-370f-48b3-bf7a-35547fe03a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:36.725193 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fd90c-370f-48b3-bf7a-35547fe03a23 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:36.725477 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fd90c-370f-48b3-bf7a-35547fe03a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:36.725780 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fd90c-370f-48b3-bf7a-35547fe03a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:36.726532 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15055cb5-8627-4439-b2a3-ce98ecfcd3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:36.726669 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fd90c-370f-48b3-bf7a-35547fe03a23 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:36.727392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15055cb5-8627-4439-b2a3-ce98ecfcd3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:36.727681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15055cb5-8627-4439-b2a3-ce98ecfcd3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:36.727992 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15055cb5-8627-4439-b2a3-ce98ecfcd3c2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:36.728176 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fd90c-370f-48b3-bf7a-35547fe03a23 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:36.730038 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15055cb5-8627-4439-b2a3-ce98ecfcd3c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:36.732288 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15055cb5-8627-4439-b2a3-ce98ecfcd3c2 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:36.733915 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 26/43] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:49:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:36.739093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15055cb5-8627-4439-b2a3-ce98ecfcd3c2 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:36.749169 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15055cb5-8627-4439-b2a3-ce98ecfcd3c2 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:36.753539 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc80751-e47c-4087-a809-0f50b8a9afa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:36.754152 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc80751-e47c-4087-a809-0f50b8a9afa9 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:36.754440 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc80751-e47c-4087-a809-0f50b8a9afa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:36.754750 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc80751-e47c-4087-a809-0f50b8a9afa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:36.755454 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc80751-e47c-4087-a809-0f50b8a9afa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:36.756431 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-adc80751-e47c-4087-a809-0f50b8a9afa9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:49:36.756431 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 16:49:36.756431 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 16:49:36.757639 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc80751-e47c-4087-a809-0f50b8a9afa9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:36.826756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 18/44] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 16:49:36 2022] POST /identity/v3/roles => generated 223 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 16:49:36.880487 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 27/45] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Feb 16 16:49:36 2022] POST /identity/v3/projects => generated 312 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 16:49:38.511539 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed652a-a114-4ca2-954f-e72858a14c44 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:38.512075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed652a-a114-4ca2-954f-e72858a14c44 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:38.512075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed652a-a114-4ca2-954f-e72858a14c44 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:38.513865 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 19/46] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:38.519231 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc31d48-e3e3-417e-822b-9a90f62aaab5 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:38.519638 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc31d48-e3e3-417e-822b-9a90f62aaab5 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:38.519836 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc31d48-e3e3-417e-822b-9a90f62aaab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:38.537621 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-1fc31d48-e3e3-417e-822b-9a90f62aaab5 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:38.538868 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-1fc31d48-e3e3-417e-822b-9a90f62aaab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:38.595680 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 28/47] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:38.620133 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed652a-a114-4ca2-954f-e72858a14c44 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:38.631991 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed652a-a114-4ca2-954f-e72858a14c44 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:38.636781 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9913101-29eb-49d2-a20f-91b140806aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:38.637558 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9913101-29eb-49d2-a20f-91b140806aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:38.637840 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9913101-29eb-49d2-a20f-91b140806aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:38.638117 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9913101-29eb-49d2-a20f-91b140806aa7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:38.648021 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9913101-29eb-49d2-a20f-91b140806aa7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:38.654900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-c9913101-29eb-49d2-a20f-91b140806aa7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:49:38.656071 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 20/48] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:49:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:49:38.661720 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc31d48-e3e3-417e-822b-9a90f62aaab5 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:38.671445 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc31d48-e3e3-417e-822b-9a90f62aaab5 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:38.675781 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0eba1a-10b4-436c-b02a-df23d565a8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:38.676437 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0eba1a-10b4-436c-b02a-df23d565a8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:38.676716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0eba1a-10b4-436c-b02a-df23d565a8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:38.676990 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0eba1a-10b4-436c-b02a-df23d565a8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:38.677740 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0eba1a-10b4-436c-b02a-df23d565a8f3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:38.678045 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0eba1a-10b4-436c-b02a-df23d565a8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:38.679682 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0eba1a-10b4-436c-b02a-df23d565a8f3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:38.688469 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 29/49] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:49:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:38.693916 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9913101-29eb-49d2-a20f-91b140806aa7 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:38.705172 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9913101-29eb-49d2-a20f-91b140806aa7 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:38.709502 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8c771-187d-4367-a3cb-d06883da88fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:38.710349 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8c771-187d-4367-a3cb-d06883da88fc admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:38.710631 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8c771-187d-4367-a3cb-d06883da88fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:38.710940 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8c771-187d-4367-a3cb-d06883da88fc admin admin] PATH_INFO: `/v3/users/b96481fed12c49429f583e04dace6093` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:38.712365 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8c771-187d-4367-a3cb-d06883da88fc admin admin] RBAC: Authorizing `identity:get_user(user_id=b96481fed12c49429f583e04dace6093)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:38.714356 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8c771-187d-4367-a3cb-d06883da88fc admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:38.715986 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 21/50] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:38 2022] GET /identity/v3/users/b96481fed12c49429f583e04dace6093 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:38.721220 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0eba1a-10b4-436c-b02a-df23d565a8f3 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:38.732282 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0eba1a-10b4-436c-b02a-df23d565a8f3 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:38.736918 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163fefc-187d-4121-a6f3-6218217e2876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:38.737739 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163fefc-187d-4121-a6f3-6218217e2876 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:38.738026 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163fefc-187d-4121-a6f3-6218217e2876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:38.738327 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163fefc-187d-4121-a6f3-6218217e2876 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:38.739560 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163fefc-187d-4121-a6f3-6218217e2876 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:38.741252 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163fefc-187d-4121-a6f3-6218217e2876 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:38.742982 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 30/51] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:49:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:38.749765 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8c771-187d-4367-a3cb-d06883da88fc admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:38.759333 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8c771-187d-4367-a3cb-d06883da88fc admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:38.775580 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411add0-a1cb-49ee-bfe1-7a40a6984874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:38.775580 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411add0-a1cb-49ee-bfe1-7a40a6984874 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:38.775580 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411add0-a1cb-49ee-bfe1-7a40a6984874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:38.775580 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411add0-a1cb-49ee-bfe1-7a40a6984874 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:38.776152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411add0-a1cb-49ee-bfe1-7a40a6984874 admin admin] RBAC: Adding query filter params (role.id=8263a29ceeed4576b3b6959c99964ed7, scope.domain.id=default, user.id=b96481fed12c49429f583e04dace6093) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:38.776152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411add0-a1cb-49ee-bfe1-7a40a6984874 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:38.776152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411add0-a1cb-49ee-bfe1-7a40a6984874 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:38.776152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 22/52] 10.222.0.42 () {56 vars in 1343 bytes} [Wed Feb 16 16:49:38 2022] GET /identity/v3/role_assignments?user.id=b96481fed12c49429f583e04dace6093&scope.domain.id=default&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 530 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:39.255123 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c897a4-a195-477d-ace4-7a073e51b6f3 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:39.255410 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c897a4-a195-477d-ace4-7a073e51b6f3 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:39.255694 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c897a4-a195-477d-ace4-7a073e51b6f3 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:39.257524 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 31/53] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:39.262854 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc01b47-f887-47e5-8310-d654bb49cc3c None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:39.263142 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc01b47-f887-47e5-8310-d654bb49cc3c None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:39.263419 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc01b47-f887-47e5-8310-d654bb49cc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:39.282691 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-cdc01b47-f887-47e5-8310-d654bb49cc3c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:39.283904 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-cdc01b47-f887-47e5-8310-d654bb49cc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:39.291899 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 23/54] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:39.314450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c897a4-a195-477d-ace4-7a073e51b6f3 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:39.327396 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c897a4-a195-477d-ace4-7a073e51b6f3 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:39.331576 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a84628-b079-4a64-81a8-410d24f88b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:39.332336 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a84628-b079-4a64-81a8-410d24f88b20 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:39.332615 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a84628-b079-4a64-81a8-410d24f88b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:39.332883 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a84628-b079-4a64-81a8-410d24f88b20 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:39.334028 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a84628-b079-4a64-81a8-410d24f88b20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:39.335722 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a84628-b079-4a64-81a8-410d24f88b20 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:39.337270 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 32/55] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:49:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:39.343179 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc01b47-f887-47e5-8310-d654bb49cc3c None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:39.352242 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc01b47-f887-47e5-8310-d654bb49cc3c None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:39.357593 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf54aa7-fcdb-45cc-bfa3-a04a8db20fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:39.358233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf54aa7-fcdb-45cc-bfa3-a04a8db20fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:39.358520 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf54aa7-fcdb-45cc-bfa3-a04a8db20fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:39.358840 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf54aa7-fcdb-45cc-bfa3-a04a8db20fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:39.359556 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf54aa7-fcdb-45cc-bfa3-a04a8db20fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:39.361442 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf54aa7-fcdb-45cc-bfa3-a04a8db20fd8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:39.474555 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 24/56] 10.222.0.42 () {60 vars in 1161 bytes} [Wed Feb 16 16:49:39 2022] POST /identity/v3/projects => generated 298 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 16:49:41.767798 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b3320-cb86-4669-b4a8-9ebfb37ecc4f None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:41.768303 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b3320-cb86-4669-b4a8-9ebfb37ecc4f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:41.768387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b3320-cb86-4669-b4a8-9ebfb37ecc4f None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:41.770134 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 33/57] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:41.775283 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b21350-2505-4670-ad66-fb1620571cd7 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:41.775655 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b21350-2505-4670-ad66-fb1620571cd7 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:41.775873 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b21350-2505-4670-ad66-fb1620571cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:41.793732 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-01b21350-2505-4670-ad66-fb1620571cd7 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:41.794864 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-01b21350-2505-4670-ad66-fb1620571cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:41.849255 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 25/58] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:41.875718 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b3320-cb86-4669-b4a8-9ebfb37ecc4f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:41.887693 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b3320-cb86-4669-b4a8-9ebfb37ecc4f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:41.891935 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911a9eb-9bca-46af-98e6-e925afe850ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:41.892697 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911a9eb-9bca-46af-98e6-e925afe850ea admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:41.892975 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911a9eb-9bca-46af-98e6-e925afe850ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:41.893245 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911a9eb-9bca-46af-98e6-e925afe850ea admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:41.894392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911a9eb-9bca-46af-98e6-e925afe850ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:41.896091 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911a9eb-9bca-46af-98e6-e925afe850ea admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:41.897619 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 34/59] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:49:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:41.902610 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b21350-2505-4670-ad66-fb1620571cd7 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:41.911380 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b21350-2505-4670-ad66-fb1620571cd7 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:41.916404 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9aeb71-dafc-4b86-97d4-fc0779420e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:41.917297 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9aeb71-dafc-4b86-97d4-fc0779420e51 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:41.917580 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9aeb71-dafc-4b86-97d4-fc0779420e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:41.917854 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9aeb71-dafc-4b86-97d4-fc0779420e51 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:41.918702 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9aeb71-dafc-4b86-97d4-fc0779420e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:41.919717 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING py.warnings [None req-4a9aeb71-dafc-4b86-97d4-fc0779420e51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:49:41.919717 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: warnings.warn(msg) Feb 16 16:49:41.919717 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: Feb 16 16:49:41.920938 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9aeb71-dafc-4b86-97d4-fc0779420e51 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:42.033922 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 26/60] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Feb 16 16:49:41 2022] POST /identity/v3/users => generated 275 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:49:45.560736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a063915-5496-4482-a43b-e31350f54c0a None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.561694 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a063915-5496-4482-a43b-e31350f54c0a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.562163 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a063915-5496-4482-a43b-e31350f54c0a None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.564446 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 35/61] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:45.569762 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217190cb-1622-49d4-9ef9-85c4d59722d6 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.570596 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217190cb-1622-49d4-9ef9-85c4d59722d6 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.571091 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217190cb-1622-49d4-9ef9-85c4d59722d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.602844 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-217190cb-1622-49d4-9ef9-85c4d59722d6 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:45.605088 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-217190cb-1622-49d4-9ef9-85c4d59722d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:45.617144 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 27/62] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:45.657451 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a063915-5496-4482-a43b-e31350f54c0a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:45.673035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a063915-5496-4482-a43b-e31350f54c0a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:45.682470 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7f9b8-309c-4e10-acda-555dc4520da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:45.683473 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7f9b8-309c-4e10-acda-555dc4520da0 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.683750 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7f9b8-309c-4e10-acda-555dc4520da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.684023 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7f9b8-309c-4e10-acda-555dc4520da0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.703790 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f909c5-33b3-4bfa-88a1-53debe58ad04 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.704382 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f909c5-33b3-4bfa-88a1-53debe58ad04 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.704708 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7f9b8-309c-4e10-acda-555dc4520da0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:45.705059 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f909c5-33b3-4bfa-88a1-53debe58ad04 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.707450 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 28/63] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:45.712115 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-92a7f9b8-309c-4e10-acda-555dc4520da0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 16:49:45.712684 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be38b6-4468-4e3b-9019-3c10c6c63b87 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.713259 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be38b6-4468-4e3b-9019-3c10c6c63b87 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.713725 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be38b6-4468-4e3b-9019-3c10c6c63b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.718294 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 36/64] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:49:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:49:45.719695 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80111f0a-da64-4b5c-b3ae-b7ad4e9593a7 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.719984 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80111f0a-da64-4b5c-b3ae-b7ad4e9593a7 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.720315 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80111f0a-da64-4b5c-b3ae-b7ad4e9593a7 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.722622 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 37/65] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:45.723486 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80111f0a-da64-4b5c-b3ae-b7ad4e9593a7 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:45.734745 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-a8be38b6-4468-4e3b-9019-3c10c6c63b87 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:45.737003 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-a8be38b6-4468-4e3b-9019-3c10c6c63b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:45.740132 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80111f0a-da64-4b5c-b3ae-b7ad4e9593a7 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:45.746004 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b60766-cacb-4ffa-9ee5-e30be1bd1a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:45.746689 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b60766-cacb-4ffa-9ee5-e30be1bd1a0c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.746972 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b60766-cacb-4ffa-9ee5-e30be1bd1a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.747252 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b60766-cacb-4ffa-9ee5-e30be1bd1a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.747831 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 29/66] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:49:45.748012 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b60766-cacb-4ffa-9ee5-e30be1bd1a0c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:45.748325 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b60766-cacb-4ffa-9ee5-e30be1bd1a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:45.754671 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00bee6-f7ec-4c05-ba71-e28cdbba8fd8 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.754789 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b60766-cacb-4ffa-9ee5-e30be1bd1a0c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:45.756438 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00bee6-f7ec-4c05-ba71-e28cdbba8fd8 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.756823 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00bee6-f7ec-4c05-ba71-e28cdbba8fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.770237 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 38/67] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:49:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:45.774626 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b60766-cacb-4ffa-9ee5-e30be1bd1a0c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:45.783820 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-1f00bee6-f7ec-4c05-ba71-e28cdbba8fd8 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:45.785063 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b60766-cacb-4ffa-9ee5-e30be1bd1a0c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:45.785384 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-1f00bee6-f7ec-4c05-ba71-e28cdbba8fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:45.789958 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58518899-1f88-4b28-b3bc-e5e51bb0fce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:45.791584 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58518899-1f88-4b28-b3bc-e5e51bb0fce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.791974 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58518899-1f88-4b28-b3bc-e5e51bb0fce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.792482 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58518899-1f88-4b28-b3bc-e5e51bb0fce6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.796234 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 30/68] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:45.802668 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00bee6-f7ec-4c05-ba71-e28cdbba8fd8 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:45.814059 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58518899-1f88-4b28-b3bc-e5e51bb0fce6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:45.822725 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-58518899-1f88-4b28-b3bc-e5e51bb0fce6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:49:45.826289 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00bee6-f7ec-4c05-ba71-e28cdbba8fd8 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:45.827703 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 39/69] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:49:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:49:45.828830 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58518899-1f88-4b28-b3bc-e5e51bb0fce6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:45.834424 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc529e7c-0082-43e2-8e97-ecde6e34c33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:45.835337 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc529e7c-0082-43e2-8e97-ecde6e34c33b admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.835623 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc529e7c-0082-43e2-8e97-ecde6e34c33b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.835902 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc529e7c-0082-43e2-8e97-ecde6e34c33b admin admin] PATH_INFO: `/v3/users/8a2a549f61b94b47956e72c5b6640148` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.844243 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58518899-1f88-4b28-b3bc-e5e51bb0fce6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:45.849918 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894d227-4767-4ba9-ab31-48d555bc834e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:45.851021 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894d227-4767-4ba9-ab31-48d555bc834e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.851839 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894d227-4767-4ba9-ab31-48d555bc834e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.852320 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894d227-4767-4ba9-ab31-48d555bc834e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.854892 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc529e7c-0082-43e2-8e97-ecde6e34c33b admin admin] RBAC: Authorizing `identity:get_user(user_id=8a2a549f61b94b47956e72c5b6640148)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:45.857990 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc529e7c-0082-43e2-8e97-ecde6e34c33b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:45.863997 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 31/70] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:45 2022] GET /identity/v3/users/8a2a549f61b94b47956e72c5b6640148 => generated 275 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:45.863997 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc529e7c-0082-43e2-8e97-ecde6e34c33b admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:45.872022 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894d227-4767-4ba9-ab31-48d555bc834e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:45.872400 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc529e7c-0082-43e2-8e97-ecde6e34c33b admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:45.876945 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da8efc-40e2-4ca1-842c-c504994c05e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:45.877621 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da8efc-40e2-4ca1-842c-c504994c05e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.877907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da8efc-40e2-4ca1-842c-c504994c05e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.878187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da8efc-40e2-4ca1-842c-c504994c05e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.878973 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da8efc-40e2-4ca1-842c-c504994c05e0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:45.879301 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da8efc-40e2-4ca1-842c-c504994c05e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:45.880963 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da8efc-40e2-4ca1-842c-c504994c05e0 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:45.881715 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-b894d227-4767-4ba9-ab31-48d555bc834e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 16:49:45.889363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 40/71] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:49:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:49:45.889363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894d227-4767-4ba9-ab31-48d555bc834e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:45.896628 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 32/72] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:49:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:45.897711 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da8efc-40e2-4ca1-842c-c504994c05e0 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:45.905656 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894d227-4767-4ba9-ab31-48d555bc834e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:45.909986 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da8efc-40e2-4ca1-842c-c504994c05e0 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:45.910923 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37b5f9-d17d-4a0d-bb26-bc77761db6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:45.911791 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37b5f9-d17d-4a0d-bb26-bc77761db6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.912276 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37b5f9-d17d-4a0d-bb26-bc77761db6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.912749 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37b5f9-d17d-4a0d-bb26-bc77761db6a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.914592 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a36eb4-a375-4df0-9d48-5230736fc865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:45.915277 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a36eb4-a375-4df0-9d48-5230736fc865 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.915627 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a36eb4-a375-4df0-9d48-5230736fc865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.916480 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a36eb4-a375-4df0-9d48-5230736fc865 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.917557 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a36eb4-a375-4df0-9d48-5230736fc865 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:45.917867 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a36eb4-a375-4df0-9d48-5230736fc865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:45.919523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a36eb4-a375-4df0-9d48-5230736fc865 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:45.923846 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37b5f9-d17d-4a0d-bb26-bc77761db6a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:45.925878 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37b5f9-d17d-4a0d-bb26-bc77761db6a8 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:45.934742 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 33/73] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:49:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:45.935693 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a36eb4-a375-4df0-9d48-5230736fc865 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:45.940793 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 41/74] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:49:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:49:45.941851 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37b5f9-d17d-4a0d-bb26-bc77761db6a8 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:45.946272 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a36eb4-a375-4df0-9d48-5230736fc865 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:45.952040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c480f-9579-4126-8f79-acf94802621e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:45.952718 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37b5f9-d17d-4a0d-bb26-bc77761db6a8 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:45.952933 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c480f-9579-4126-8f79-acf94802621e admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.953207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c480f-9579-4126-8f79-acf94802621e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.953485 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c480f-9579-4126-8f79-acf94802621e admin admin] PATH_INFO: `/v3/users/b96481fed12c49429f583e04dace6093` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.954795 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c480f-9579-4126-8f79-acf94802621e admin admin] RBAC: Authorizing `identity:get_user(user_id=b96481fed12c49429f583e04dace6093)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:45.956728 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c480f-9579-4126-8f79-acf94802621e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:45.957324 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b32030-af12-4ffa-aa28-fef059dcbb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:45.958220 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b32030-af12-4ffa-aa28-fef059dcbb16 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.958507 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b32030-af12-4ffa-aa28-fef059dcbb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.958839 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 34/75] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:45 2022] GET /identity/v3/users/b96481fed12c49429f583e04dace6093 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:45.959150 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b32030-af12-4ffa-aa28-fef059dcbb16 admin admin] PATH_INFO: `/v3/users/8a2a549f61b94b47956e72c5b6640148` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.960174 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba092a-4b13-452f-9a4b-325f7368cf6e None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.960463 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba092a-4b13-452f-9a4b-325f7368cf6e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.960741 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba092a-4b13-452f-9a4b-325f7368cf6e None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.961113 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b32030-af12-4ffa-aa28-fef059dcbb16 admin admin] RBAC: Authorizing `identity:get_user(user_id=8a2a549f61b94b47956e72c5b6640148)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:45.962688 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 35/76] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:45.963793 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b32030-af12-4ffa-aa28-fef059dcbb16 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:45.963918 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba092a-4b13-452f-9a4b-325f7368cf6e None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:45.966233 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 42/77] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:45 2022] GET /identity/v3/users/8a2a549f61b94b47956e72c5b6640148 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:45.968495 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b32030-af12-4ffa-aa28-fef059dcbb16 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:45.978923 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b32030-af12-4ffa-aa28-fef059dcbb16 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:45.981180 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba092a-4b13-452f-9a4b-325f7368cf6e None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:45.984018 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b40274-41d7-4a4f-872d-e78567956483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:45.984682 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b40274-41d7-4a4f-872d-e78567956483 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.984974 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b40274-41d7-4a4f-872d-e78567956483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.985257 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b40274-41d7-4a4f-872d-e78567956483 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.986009 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a72791-c7c3-47ef-9411-24d85aa9fa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:45.986892 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a72791-c7c3-47ef-9411-24d85aa9fa25 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.987176 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a72791-c7c3-47ef-9411-24d85aa9fa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.987456 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a72791-c7c3-47ef-9411-24d85aa9fa25 admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.988631 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a72791-c7c3-47ef-9411-24d85aa9fa25 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f8319abb808492e927f6f07504c63c5)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:45.990713 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a72791-c7c3-47ef-9411-24d85aa9fa25 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:45.992569 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 36/78] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:49:45 2022] GET /identity/v3/projects/0f8319abb808492e927f6f07504c63c5 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:45.997802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5808728-a126-452e-994f-63de08abf1b4 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:45.997802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5808728-a126-452e-994f-63de08abf1b4 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:45.997802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5808728-a126-452e-994f-63de08abf1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:45.999381 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b40274-41d7-4a4f-872d-e78567956483 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:46.001274 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b40274-41d7-4a4f-872d-e78567956483 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:46.011625 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 43/79] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:49:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 16:49:46.012293 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b40274-41d7-4a4f-872d-e78567956483 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:46.017383 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-a5808728-a126-452e-994f-63de08abf1b4 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:46.018560 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-a5808728-a126-452e-994f-63de08abf1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:46.025057 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b40274-41d7-4a4f-872d-e78567956483 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:46.026719 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 37/80] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:46.030750 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5808728-a126-452e-994f-63de08abf1b4 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:46.033886 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943ed05-e6b6-4ff3-92b2-c28eb147eb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:46.034857 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943ed05-e6b6-4ff3-92b2-c28eb147eb6b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:46.035210 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943ed05-e6b6-4ff3-92b2-c28eb147eb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:46.035556 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943ed05-e6b6-4ff3-92b2-c28eb147eb6b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:46.036434 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5808728-a126-452e-994f-63de08abf1b4 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:46.040938 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773ef91-8c41-4be4-906a-23bc4f4ff846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:46.041803 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773ef91-8c41-4be4-906a-23bc4f4ff846 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:46.042238 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773ef91-8c41-4be4-906a-23bc4f4ff846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:46.042687 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773ef91-8c41-4be4-906a-23bc4f4ff846 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:46.043669 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773ef91-8c41-4be4-906a-23bc4f4ff846 admin admin] RBAC: Adding query filter params (role.id=d361c0606e4646d3afa601176d0422ec, scope.project.id=0f8319abb808492e927f6f07504c63c5, user.id=8a2a549f61b94b47956e72c5b6640148) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:46.044149 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773ef91-8c41-4be4-906a-23bc4f4ff846 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:46.044453 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943ed05-e6b6-4ff3-92b2-c28eb147eb6b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:46.046295 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943ed05-e6b6-4ff3-92b2-c28eb147eb6b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:46.046407 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773ef91-8c41-4be4-906a-23bc4f4ff846 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:46.052487 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 38/81] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:49:46 2022] GET /identity/v3/role_assignments?user.id=8a2a549f61b94b47956e72c5b6640148&scope.project.id=0f8319abb808492e927f6f07504c63c5&role.id=d361c0606e4646d3afa601176d0422ec => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:46.053446 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773ef91-8c41-4be4-906a-23bc4f4ff846 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:46.057410 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 44/82] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:49:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:49:46.063474 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943ed05-e6b6-4ff3-92b2-c28eb147eb6b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:46.070425 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773ef91-8c41-4be4-906a-23bc4f4ff846 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:46.074086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943ed05-e6b6-4ff3-92b2-c28eb147eb6b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:46.076825 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9e1f6-5960-44ff-8c24-7cef6321b7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:46.078010 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9e1f6-5960-44ff-8c24-7cef6321b7aa admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:46.078509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9e1f6-5960-44ff-8c24-7cef6321b7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:46.078987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c54ff6-ad5e-4b5b-82b7-58d7999a3da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:46.079395 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9e1f6-5960-44ff-8c24-7cef6321b7aa admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:46.079865 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c54ff6-ad5e-4b5b-82b7-58d7999a3da0 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:46.080146 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c54ff6-ad5e-4b5b-82b7-58d7999a3da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:46.080419 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c54ff6-ad5e-4b5b-82b7-58d7999a3da0 admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:46.081624 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9e1f6-5960-44ff-8c24-7cef6321b7aa admin admin] RBAC: Authorizing `identity:get_project(project_id=0f8319abb808492e927f6f07504c63c5)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:46.081749 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c54ff6-ad5e-4b5b-82b7-58d7999a3da0 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f8319abb808492e927f6f07504c63c5)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:46.083765 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c54ff6-ad5e-4b5b-82b7-58d7999a3da0 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:46.084385 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9e1f6-5960-44ff-8c24-7cef6321b7aa admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:46.085541 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 45/83] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:49:46 2022] GET /identity/v3/projects/0f8319abb808492e927f6f07504c63c5 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:46.086563 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c54ff6-ad5e-4b5b-82b7-58d7999a3da0 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:46.092388 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 39/84] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:49:46 2022] GET /identity/v3/projects/0f8319abb808492e927f6f07504c63c5 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:46.093438 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9e1f6-5960-44ff-8c24-7cef6321b7aa admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:46.097920 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c54ff6-ad5e-4b5b-82b7-58d7999a3da0 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:46.103478 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9e1f6-5960-44ff-8c24-7cef6321b7aa admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:46.104124 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c6e5e-649d-4bd9-ac3e-c58d43add807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:46.105191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c6e5e-649d-4bd9-ac3e-c58d43add807 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:46.105774 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c6e5e-649d-4bd9-ac3e-c58d43add807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:46.106501 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c6e5e-649d-4bd9-ac3e-c58d43add807 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:46.107948 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c6e5e-649d-4bd9-ac3e-c58d43add807 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:46.108686 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14c13c-f902-41a0-8851-d2e327d4740b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:46.109363 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14c13c-f902-41a0-8851-d2e327d4740b admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:46.109650 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14c13c-f902-41a0-8851-d2e327d4740b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:46.109925 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14c13c-f902-41a0-8851-d2e327d4740b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:46.110810 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14c13c-f902-41a0-8851-d2e327d4740b admin admin] RBAC: Adding query filter params (role.id=cf30e55f556b4e0cbee0317b16316b0f, scope.project.id=0f8319abb808492e927f6f07504c63c5, user.id=8a2a549f61b94b47956e72c5b6640148) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:46.111046 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c6e5e-649d-4bd9-ac3e-c58d43add807 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:46.111158 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14c13c-f902-41a0-8851-d2e327d4740b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:46.113041 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14c13c-f902-41a0-8851-d2e327d4740b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:46.113394 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 46/85] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:49:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:46.114329 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c6e5e-649d-4bd9-ac3e-c58d43add807 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:46.120732 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 40/86] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:49:46 2022] GET /identity/v3/role_assignments?user.id=8a2a549f61b94b47956e72c5b6640148&scope.project.id=0f8319abb808492e927f6f07504c63c5&role.id=cf30e55f556b4e0cbee0317b16316b0f => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:46.121795 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14c13c-f902-41a0-8851-d2e327d4740b admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:46.138363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c6e5e-649d-4bd9-ac3e-c58d43add807 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:46.144446 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14c13c-f902-41a0-8851-d2e327d4740b admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:46.150007 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce172140-4ee9-475d-acba-fec40ec29703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:46.151430 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce172140-4ee9-475d-acba-fec40ec29703 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:46.151934 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce172140-4ee9-475d-acba-fec40ec29703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:46.153151 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce172140-4ee9-475d-acba-fec40ec29703 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:46.154279 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce172140-4ee9-475d-acba-fec40ec29703 admin admin] RBAC: Adding query filter params (role.id=8263a29ceeed4576b3b6959c99964ed7, scope.project.id=0f8319abb808492e927f6f07504c63c5, user.id=b96481fed12c49429f583e04dace6093) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:46.155450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce172140-4ee9-475d-acba-fec40ec29703 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:46.157723 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-ce172140-4ee9-475d-acba-fec40ec29703 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:49:46.157723 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 16:49:46.157723 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 16:49:46.158773 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a38dc-1205-45e7-8609-5bfd5b7ae7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:46.159661 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a38dc-1205-45e7-8609-5bfd5b7ae7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:46.161131 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce172140-4ee9-475d-acba-fec40ec29703 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:46.161695 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a38dc-1205-45e7-8609-5bfd5b7ae7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:46.162149 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a38dc-1205-45e7-8609-5bfd5b7ae7b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:46.165572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a38dc-1205-45e7-8609-5bfd5b7ae7b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:46.168512 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a38dc-1205-45e7-8609-5bfd5b7ae7b5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:46.181993 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 47/87] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:49:46 2022] GET /identity/v3/role_assignments?user.id=b96481fed12c49429f583e04dace6093&scope.project.id=0f8319abb808492e927f6f07504c63c5&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 259 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:46.264105 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 41/88] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Feb 16 16:49:46 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:49:46.336180 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e340b91-f8e1-4e23-998a-c0c619926d7a None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:46.336687 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e340b91-f8e1-4e23-998a-c0c619926d7a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:46.337119 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e340b91-f8e1-4e23-998a-c0c619926d7a None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:46.340306 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 48/89] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:46.346616 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fe064-9ff4-4dee-a174-c676193b1fbb None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:46.346976 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fe064-9ff4-4dee-a174-c676193b1fbb None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:46.347203 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fe064-9ff4-4dee-a174-c676193b1fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:46.374980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-337fe064-9ff4-4dee-a174-c676193b1fbb None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:46.376264 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-337fe064-9ff4-4dee-a174-c676193b1fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:46.389010 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 42/90] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:46.428972 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e340b91-f8e1-4e23-998a-c0c619926d7a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:46.449759 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e340b91-f8e1-4e23-998a-c0c619926d7a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:46.454773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebabf0-babc-47cb-acbf-159a98d5cebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:46.455903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebabf0-babc-47cb-acbf-159a98d5cebd admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:46.456415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebabf0-babc-47cb-acbf-159a98d5cebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:46.456888 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebabf0-babc-47cb-acbf-159a98d5cebd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:46.469577 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebabf0-babc-47cb-acbf-159a98d5cebd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:46.476999 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-9eebabf0-babc-47cb-acbf-159a98d5cebd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 16:49:46.478906 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 49/91] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:49:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:49:46.489634 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fe064-9ff4-4dee-a174-c676193b1fbb None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:46.501369 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fe064-9ff4-4dee-a174-c676193b1fbb None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:46.511337 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70703f-2604-4397-9103-f14cb9e712cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:46.512221 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70703f-2604-4397-9103-f14cb9e712cf admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:46.512505 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70703f-2604-4397-9103-f14cb9e712cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:46.512784 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70703f-2604-4397-9103-f14cb9e712cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:46.513547 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70703f-2604-4397-9103-f14cb9e712cf admin admin] RBAC: Adding query filter params (name=member) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:46.513857 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70703f-2604-4397-9103-f14cb9e712cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:46.515587 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70703f-2604-4397-9103-f14cb9e712cf admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:46.527782 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 43/92] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:49:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:46.533242 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebabf0-babc-47cb-acbf-159a98d5cebd admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:46.544571 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebabf0-babc-47cb-acbf-159a98d5cebd admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:46.556277 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9664e35-6f62-466b-9f6f-e36d225fce1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:46.558004 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9664e35-6f62-466b-9f6f-e36d225fce1d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:46.558291 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9664e35-6f62-466b-9f6f-e36d225fce1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:46.558590 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9664e35-6f62-466b-9f6f-e36d225fce1d admin admin] PATH_INFO: `/v3/users/8a2a549f61b94b47956e72c5b6640148` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:46.560367 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9664e35-6f62-466b-9f6f-e36d225fce1d admin admin] RBAC: Authorizing `identity:get_user(user_id=8a2a549f61b94b47956e72c5b6640148)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:46.562772 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9664e35-6f62-466b-9f6f-e36d225fce1d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:46.564717 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 50/93] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:46 2022] GET /identity/v3/users/8a2a549f61b94b47956e72c5b6640148 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:46.570314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70703f-2604-4397-9103-f14cb9e712cf admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:46.583103 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70703f-2604-4397-9103-f14cb9e712cf admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:46.591813 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615f1ec-a5ee-4959-b9d2-ca532b9654e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:46.592843 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615f1ec-a5ee-4959-b9d2-ca532b9654e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:46.593355 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615f1ec-a5ee-4959-b9d2-ca532b9654e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:46.593839 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615f1ec-a5ee-4959-b9d2-ca532b9654e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:46.604811 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615f1ec-a5ee-4959-b9d2-ca532b9654e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:46.607200 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615f1ec-a5ee-4959-b9d2-ca532b9654e5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:46.619091 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 44/94] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:49:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:49:46.625159 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9664e35-6f62-466b-9f6f-e36d225fce1d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:46.640128 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9664e35-6f62-466b-9f6f-e36d225fce1d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:46.646936 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546774a1-5daf-41f8-8b67-eb53744dee23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:46.648086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546774a1-5daf-41f8-8b67-eb53744dee23 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:46.648568 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546774a1-5daf-41f8-8b67-eb53744dee23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:46.649039 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546774a1-5daf-41f8-8b67-eb53744dee23 admin admin] PATH_INFO: `/v3/projects/699a7f87ffae454a82781090b073f25b` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:46.653725 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546774a1-5daf-41f8-8b67-eb53744dee23 admin admin] RBAC: Authorizing `identity:get_project(project_id=699a7f87ffae454a82781090b073f25b)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:46.656183 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546774a1-5daf-41f8-8b67-eb53744dee23 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:46.658083 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 51/95] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:49:46 2022] GET /identity/v3/projects/699a7f87ffae454a82781090b073f25b => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:46.663945 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615f1ec-a5ee-4959-b9d2-ca532b9654e5 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:46.676548 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615f1ec-a5ee-4959-b9d2-ca532b9654e5 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:46.682317 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc0760-7f72-49c9-b746-3e9d26bc68e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:46.683104 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc0760-7f72-49c9-b746-3e9d26bc68e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:46.683388 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc0760-7f72-49c9-b746-3e9d26bc68e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:46.683674 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc0760-7f72-49c9-b746-3e9d26bc68e5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:46.684498 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc0760-7f72-49c9-b746-3e9d26bc68e5 admin admin] RBAC: Adding query filter params (role.id=d361c0606e4646d3afa601176d0422ec, scope.project.id=699a7f87ffae454a82781090b073f25b, user.id=8a2a549f61b94b47956e72c5b6640148) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:46.684813 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc0760-7f72-49c9-b746-3e9d26bc68e5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:46.686661 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc0760-7f72-49c9-b746-3e9d26bc68e5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:46.693601 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 45/96] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:49:46 2022] GET /identity/v3/role_assignments?user.id=8a2a549f61b94b47956e72c5b6640148&scope.project.id=699a7f87ffae454a82781090b073f25b&role.id=d361c0606e4646d3afa601176d0422ec => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:48.981743 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9f34d-b4a3-4cc4-bcb5-424d96a12197 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:48.982799 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9f34d-b4a3-4cc4-bcb5-424d96a12197 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:48.983345 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9f34d-b4a3-4cc4-bcb5-424d96a12197 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:48.985597 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 52/97] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:48.991634 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd7ced-faaf-40a6-bc7b-d3da10e6bc39 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:48.992079 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd7ced-faaf-40a6-bc7b-d3da10e6bc39 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:48.992180 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd7ced-faaf-40a6-bc7b-d3da10e6bc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.000296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0851c-0588-43f6-90c1-27167c4bd5f0 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:49.000585 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0851c-0588-43f6-90c1-27167c4bd5f0 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:49.001017 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0851c-0588-43f6-90c1-27167c4bd5f0 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.003184 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 53/98] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:49.012307 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daf8f4-185b-4aa0-bf23-903a3580b609 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:49.012909 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daf8f4-185b-4aa0-bf23-903a3580b609 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:49.013390 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daf8f4-185b-4aa0-bf23-903a3580b609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.018681 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-04bd7ced-faaf-40a6-bc7b-d3da10e6bc39 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:49.018681 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-04bd7ced-faaf-40a6-bc7b-d3da10e6bc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:49.025743 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 46/99] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:49.040348 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-60daf8f4-185b-4aa0-bf23-903a3580b609 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:49.042247 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-60daf8f4-185b-4aa0-bf23-903a3580b609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:49.054264 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 54/100] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:49:49.064108 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd7ced-faaf-40a6-bc7b-d3da10e6bc39 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:49.076264 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd7ced-faaf-40a6-bc7b-d3da10e6bc39 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:49.086187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892a0ab-3f60-4bdc-b1a8-2742a653f5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:49.087054 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892a0ab-3f60-4bdc-b1a8-2742a653f5dd admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:49.089283 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892a0ab-3f60-4bdc-b1a8-2742a653f5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:49.089592 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892a0ab-3f60-4bdc-b1a8-2742a653f5dd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.101611 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892a0ab-3f60-4bdc-b1a8-2742a653f5dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:49.102923 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daf8f4-185b-4aa0-bf23-903a3580b609 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:49.111992 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-3892a0ab-3f60-4bdc-b1a8-2742a653f5dd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 16:49:49.111992 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 47/101] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:49:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:49:49.117424 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892a0ab-3f60-4bdc-b1a8-2742a653f5dd admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:49.126743 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daf8f4-185b-4aa0-bf23-903a3580b609 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:49.140567 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892a0ab-3f60-4bdc-b1a8-2742a653f5dd admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:49.143887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f6ee4-7054-42cd-a83f-2d960eae978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:49.144710 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f6ee4-7054-42cd-a83f-2d960eae978d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:49.144994 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f6ee4-7054-42cd-a83f-2d960eae978d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:49.145274 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f6ee4-7054-42cd-a83f-2d960eae978d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.155473 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc99ce-2ad8-44e6-a2f0-2d3fc2a188e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:49.156150 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc99ce-2ad8-44e6-a2f0-2d3fc2a188e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:49.156433 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc99ce-2ad8-44e6-a2f0-2d3fc2a188e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:49.156707 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc99ce-2ad8-44e6-a2f0-2d3fc2a188e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.157472 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc99ce-2ad8-44e6-a2f0-2d3fc2a188e6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:49.157784 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc99ce-2ad8-44e6-a2f0-2d3fc2a188e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:49.163949 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc99ce-2ad8-44e6-a2f0-2d3fc2a188e6 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:49.166342 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f6ee4-7054-42cd-a83f-2d960eae978d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:49.173875 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-446f6ee4-7054-42cd-a83f-2d960eae978d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 16:49:49.175115 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 55/102] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:49:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:49:49.187117 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 48/103] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:49:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:49.187574 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f6ee4-7054-42cd-a83f-2d960eae978d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:49.192582 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc99ce-2ad8-44e6-a2f0-2d3fc2a188e6 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:49.209200 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc99ce-2ad8-44e6-a2f0-2d3fc2a188e6 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:49.211924 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f6ee4-7054-42cd-a83f-2d960eae978d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:49.219068 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e68b8-134f-464e-bc57-31d603b99f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:49.219935 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e68b8-134f-464e-bc57-31d603b99f75 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:49.220223 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e68b8-134f-464e-bc57-31d603b99f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:49.220505 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e68b8-134f-464e-bc57-31d603b99f75 admin admin] PATH_INFO: `/v3/users/8a2a549f61b94b47956e72c5b6640148` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.222189 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e68b8-134f-464e-bc57-31d603b99f75 admin admin] RBAC: Authorizing `identity:get_user(user_id=8a2a549f61b94b47956e72c5b6640148)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:49.224396 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e68b8-134f-464e-bc57-31d603b99f75 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:49.226084 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 49/104] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:49 2022] GET /identity/v3/users/8a2a549f61b94b47956e72c5b6640148 => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:49.226723 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453a252-a142-45e9-89f0-00aa585bc005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:49.227397 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453a252-a142-45e9-89f0-00aa585bc005 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:49.227679 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453a252-a142-45e9-89f0-00aa585bc005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:49.228530 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453a252-a142-45e9-89f0-00aa585bc005 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.229399 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453a252-a142-45e9-89f0-00aa585bc005 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:49.229850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453a252-a142-45e9-89f0-00aa585bc005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:49.231840 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453a252-a142-45e9-89f0-00aa585bc005 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:49.234210 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e68b8-134f-464e-bc57-31d603b99f75 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:49.248612 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 56/105] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:49:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:49.253222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e68b8-134f-464e-bc57-31d603b99f75 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:49.253963 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453a252-a142-45e9-89f0-00aa585bc005 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:49.266476 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453a252-a142-45e9-89f0-00aa585bc005 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:49.267342 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0541ee0-7db3-4e2b-bff6-b7df89302cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:49.268211 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0541ee0-7db3-4e2b-bff6-b7df89302cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:49.268494 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0541ee0-7db3-4e2b-bff6-b7df89302cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:49.268771 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0541ee0-7db3-4e2b-bff6-b7df89302cf2 admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.269974 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0541ee0-7db3-4e2b-bff6-b7df89302cf2 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f8319abb808492e927f6f07504c63c5)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:49.272064 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0541ee0-7db3-4e2b-bff6-b7df89302cf2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:49.274066 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 50/106] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:49:49 2022] GET /identity/v3/projects/0f8319abb808492e927f6f07504c63c5 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:49.279676 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0541ee0-7db3-4e2b-bff6-b7df89302cf2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:49.284198 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58ef41-5670-4355-925e-050b7178a852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:49.285098 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58ef41-5670-4355-925e-050b7178a852 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:49.285386 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58ef41-5670-4355-925e-050b7178a852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:49.285660 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58ef41-5670-4355-925e-050b7178a852 admin admin] PATH_INFO: `/v3/users/8a2a549f61b94b47956e72c5b6640148` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.289410 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0541ee0-7db3-4e2b-bff6-b7df89302cf2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:49.291816 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58ef41-5670-4355-925e-050b7178a852 admin admin] RBAC: Authorizing `identity:get_user(user_id=8a2a549f61b94b47956e72c5b6640148)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:49.294309 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58ef41-5670-4355-925e-050b7178a852 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:49.296001 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 57/107] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:49 2022] GET /identity/v3/users/8a2a549f61b94b47956e72c5b6640148 => generated 275 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:49.297224 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818fad0-2f23-4e4e-9335-71ab7489eb0e None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:49.297513 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818fad0-2f23-4e4e-9335-71ab7489eb0e None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:49.297815 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818fad0-2f23-4e4e-9335-71ab7489eb0e None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.299795 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 58/108] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:49.301481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818fad0-2f23-4e4e-9335-71ab7489eb0e None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:49.303254 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558bfbd-cfc4-43bf-b15c-bc1aca49aa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:49.304151 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558bfbd-cfc4-43bf-b15c-bc1aca49aa30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:49.304432 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558bfbd-cfc4-43bf-b15c-bc1aca49aa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:49.305015 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558bfbd-cfc4-43bf-b15c-bc1aca49aa30 admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5/users/8a2a549f61b94b47956e72c5b6640148/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.311970 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558bfbd-cfc4-43bf-b15c-bc1aca49aa30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f8319abb808492e927f6f07504c63c5, user_id=8a2a549f61b94b47956e72c5b6640148, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:49.312999 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING py.warnings [None req-8558bfbd-cfc4-43bf-b15c-bc1aca49aa30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:49:49.312999 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: warnings.warn(msg) Feb 16 16:49:49.312999 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: Feb 16 16:49:49.314976 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558bfbd-cfc4-43bf-b15c-bc1aca49aa30 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:49.321545 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818fad0-2f23-4e4e-9335-71ab7489eb0e None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:49.327214 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39daeea-6e2f-462f-84ce-cd08c391d9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:49.328148 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39daeea-6e2f-462f-84ce-cd08c391d9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:49.328482 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39daeea-6e2f-462f-84ce-cd08c391d9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:49.333049 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39daeea-6e2f-462f-84ce-cd08c391d9a9 admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.333049 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39daeea-6e2f-462f-84ce-cd08c391d9a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f8319abb808492e927f6f07504c63c5)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:49.333049 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39daeea-6e2f-462f-84ce-cd08c391d9a9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:49.333851 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 59/109] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:49:49 2022] GET /identity/v3/projects/0f8319abb808492e927f6f07504c63c5 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:49.335162 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35c40d-a1a7-402b-9671-e880911f0e56 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:49.335450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35c40d-a1a7-402b-9671-e880911f0e56 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:49.335724 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35c40d-a1a7-402b-9671-e880911f0e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.354895 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-8d35c40d-a1a7-402b-9671-e880911f0e56 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:49.356125 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8d35c40d-a1a7-402b-9671-e880911f0e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:49.364905 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 60/110] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:49.365811 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35c40d-a1a7-402b-9671-e880911f0e56 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:49.375413 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35c40d-a1a7-402b-9671-e880911f0e56 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:49.379978 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b69c6-f5f4-4be4-b2dd-db81e7f87d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:49.380941 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b69c6-f5f4-4be4-b2dd-db81e7f87d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:49.381272 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b69c6-f5f4-4be4-b2dd-db81e7f87d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:49.383551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b69c6-f5f4-4be4-b2dd-db81e7f87d89 admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5/users/8a2a549f61b94b47956e72c5b6640148/roles/cf30e55f556b4e0cbee0317b16316b0f` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.383851 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b69c6-f5f4-4be4-b2dd-db81e7f87d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f8319abb808492e927f6f07504c63c5, user_id=8a2a549f61b94b47956e72c5b6640148, role_id=cf30e55f556b4e0cbee0317b16316b0f)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:49.387271 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b69c6-f5f4-4be4-b2dd-db81e7f87d89 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:49.417294 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 51/111] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:49:49 2022] PUT /identity/v3/projects/0f8319abb808492e927f6f07504c63c5/users/8a2a549f61b94b47956e72c5b6640148/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:49:49.418200 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558bfbd-cfc4-43bf-b15c-bc1aca49aa30 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:49.490203 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558bfbd-cfc4-43bf-b15c-bc1aca49aa30 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:49.501971 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 61/112] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:49:49 2022] PUT /identity/v3/projects/0f8319abb808492e927f6f07504c63c5/users/8a2a549f61b94b47956e72c5b6640148/roles/cf30e55f556b4e0cbee0317b16316b0f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:49:49.502516 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07b3d5-eb5e-42a9-b4a1-04d7acacdedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:49.503480 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07b3d5-eb5e-42a9-b4a1-04d7acacdedd admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:49.505024 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07b3d5-eb5e-42a9-b4a1-04d7acacdedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:49.505024 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07b3d5-eb5e-42a9-b4a1-04d7acacdedd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.518990 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07b3d5-eb5e-42a9-b4a1-04d7acacdedd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:49.532222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-8a07b3d5-eb5e-42a9-b4a1-04d7acacdedd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:49:49.533780 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 52/113] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:49:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:49:49.539758 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b69c6-f5f4-4be4-b2dd-db81e7f87d89 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:49.640544 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b69c6-f5f4-4be4-b2dd-db81e7f87d89 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:49.649391 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ffeed-5da4-47e4-b79d-59f96967e07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:49.650183 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ffeed-5da4-47e4-b79d-59f96967e07a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:49.650462 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ffeed-5da4-47e4-b79d-59f96967e07a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:49.650766 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ffeed-5da4-47e4-b79d-59f96967e07a admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.651632 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ffeed-5da4-47e4-b79d-59f96967e07a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:49.651941 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ffeed-5da4-47e4-b79d-59f96967e07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:49.653581 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ffeed-5da4-47e4-b79d-59f96967e07a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:49.662663 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 62/114] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:49:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:49.668725 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07b3d5-eb5e-42a9-b4a1-04d7acacdedd admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:49.683722 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07b3d5-eb5e-42a9-b4a1-04d7acacdedd admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:49.688524 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dadb53-6550-47c2-be6b-39fa2cc07d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:49.689402 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dadb53-6550-47c2-be6b-39fa2cc07d39 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:49.689678 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dadb53-6550-47c2-be6b-39fa2cc07d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:49.689951 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dadb53-6550-47c2-be6b-39fa2cc07d39 admin admin] PATH_INFO: `/v3/users/b96481fed12c49429f583e04dace6093` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.691233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dadb53-6550-47c2-be6b-39fa2cc07d39 admin admin] RBAC: Authorizing `identity:get_user(user_id=b96481fed12c49429f583e04dace6093)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:49.693058 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dadb53-6550-47c2-be6b-39fa2cc07d39 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:49.694677 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 53/115] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:49 2022] GET /identity/v3/users/b96481fed12c49429f583e04dace6093 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:49.701109 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ffeed-5da4-47e4-b79d-59f96967e07a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:49.711042 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ffeed-5da4-47e4-b79d-59f96967e07a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:49.715878 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6723282-8b99-4362-8d46-68d7da4b91dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:49.721486 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6723282-8b99-4362-8d46-68d7da4b91dc admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:49.721486 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6723282-8b99-4362-8d46-68d7da4b91dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:49.721486 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6723282-8b99-4362-8d46-68d7da4b91dc admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.721486 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6723282-8b99-4362-8d46-68d7da4b91dc admin admin] RBAC: Authorizing `identity:get_project(project_id=0f8319abb808492e927f6f07504c63c5)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:49.721486 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6723282-8b99-4362-8d46-68d7da4b91dc admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:49.722429 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 63/116] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:49:49 2022] GET /identity/v3/projects/0f8319abb808492e927f6f07504c63c5 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:49.728529 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dadb53-6550-47c2-be6b-39fa2cc07d39 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:49.739879 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dadb53-6550-47c2-be6b-39fa2cc07d39 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:49.745720 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950b8cd-23bb-4da0-a976-6dc2928e4d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:49.746600 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950b8cd-23bb-4da0-a976-6dc2928e4d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:49.746919 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950b8cd-23bb-4da0-a976-6dc2928e4d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:49.747191 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950b8cd-23bb-4da0-a976-6dc2928e4d37 admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5/users/b96481fed12c49429f583e04dace6093/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:49.749394 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950b8cd-23bb-4da0-a976-6dc2928e4d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f8319abb808492e927f6f07504c63c5, user_id=b96481fed12c49429f583e04dace6093, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:49.752259 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950b8cd-23bb-4da0-a976-6dc2928e4d37 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:49.862947 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 54/117] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:49:49 2022] PUT /identity/v3/projects/0f8319abb808492e927f6f07504c63c5/users/b96481fed12c49429f583e04dace6093/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:49:50.120072 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b39091-85f5-4215-b226-94f615f22fae None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:50.120561 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b39091-85f5-4215-b226-94f615f22fae None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:50.120561 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b39091-85f5-4215-b226-94f615f22fae None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:50.122668 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 64/118] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:50.127786 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6d33b-daff-45c4-823a-a78a3faf51c6 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:50.128631 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6d33b-daff-45c4-823a-a78a3faf51c6 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:50.129102 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6d33b-daff-45c4-823a-a78a3faf51c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:50.148567 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-36f6d33b-daff-45c4-823a-a78a3faf51c6 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:50.150393 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-36f6d33b-daff-45c4-823a-a78a3faf51c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:50.222833 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 55/119] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:50.260532 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b39091-85f5-4215-b226-94f615f22fae None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:50.273331 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b39091-85f5-4215-b226-94f615f22fae None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:50.278786 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726b88a-711f-48aa-8185-f46b3b3f3b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:50.279834 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726b88a-711f-48aa-8185-f46b3b3f3b9a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:50.280314 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726b88a-711f-48aa-8185-f46b3b3f3b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:50.280785 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726b88a-711f-48aa-8185-f46b3b3f3b9a admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:50.292296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726b88a-711f-48aa-8185-f46b3b3f3b9a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:50.299471 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-2726b88a-711f-48aa-8185-f46b3b3f3b9a admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 16:49:50.301896 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 65/120] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:49:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:49:50.306788 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6d33b-daff-45c4-823a-a78a3faf51c6 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:50.316155 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6d33b-daff-45c4-823a-a78a3faf51c6 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:50.326343 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a4aa4-8b4f-4908-9e7f-55d31a9a3287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:50.327456 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a4aa4-8b4f-4908-9e7f-55d31a9a3287 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:50.327933 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a4aa4-8b4f-4908-9e7f-55d31a9a3287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:50.328398 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a4aa4-8b4f-4908-9e7f-55d31a9a3287 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:50.329367 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a4aa4-8b4f-4908-9e7f-55d31a9a3287 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:50.329876 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a4aa4-8b4f-4908-9e7f-55d31a9a3287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:50.331852 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a4aa4-8b4f-4908-9e7f-55d31a9a3287 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:50.347029 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 56/121] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:49:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:50.352581 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726b88a-711f-48aa-8185-f46b3b3f3b9a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:50.367520 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726b88a-711f-48aa-8185-f46b3b3f3b9a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:50.374216 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e789e-f528-4eb7-9a36-a55c50e9456c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:50.375377 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e789e-f528-4eb7-9a36-a55c50e9456c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:50.375855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e789e-f528-4eb7-9a36-a55c50e9456c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:50.376321 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e789e-f528-4eb7-9a36-a55c50e9456c admin admin] PATH_INFO: `/v3/users/7fc0b6539dab4975875126fedcc5b497` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:50.390863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e789e-f528-4eb7-9a36-a55c50e9456c admin admin] RBAC: Authorizing `identity:get_user(user_id=7fc0b6539dab4975875126fedcc5b497)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:50.393288 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e789e-f528-4eb7-9a36-a55c50e9456c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:50.395557 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 66/122] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:50 2022] GET /identity/v3/users/7fc0b6539dab4975875126fedcc5b497 => generated 289 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:50.401164 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a4aa4-8b4f-4908-9e7f-55d31a9a3287 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:50.416312 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a4aa4-8b4f-4908-9e7f-55d31a9a3287 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:50.422880 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38aa605-179e-4cf8-8d56-a1138107ef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:50.423772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aa605-179e-4cf8-8d56-a1138107ef34 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:50.424246 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aa605-179e-4cf8-8d56-a1138107ef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:50.424709 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aa605-179e-4cf8-8d56-a1138107ef34 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:50.437326 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38aa605-179e-4cf8-8d56-a1138107ef34 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:50.439352 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38aa605-179e-4cf8-8d56-a1138107ef34 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:50.452160 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 57/123] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:49:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 16:49:50.457772 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e789e-f528-4eb7-9a36-a55c50e9456c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:50.471525 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e789e-f528-4eb7-9a36-a55c50e9456c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:50.476350 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccf02f-fc51-42be-bbf1-4feda94eaec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:50.477408 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccf02f-fc51-42be-bbf1-4feda94eaec2 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:50.477960 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccf02f-fc51-42be-bbf1-4feda94eaec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:50.478951 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccf02f-fc51-42be-bbf1-4feda94eaec2 admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:50.483353 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ccf02f-fc51-42be-bbf1-4feda94eaec2 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f8319abb808492e927f6f07504c63c5)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:50.485597 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ccf02f-fc51-42be-bbf1-4feda94eaec2 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:50.487476 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 67/124] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:49:50 2022] GET /identity/v3/projects/0f8319abb808492e927f6f07504c63c5 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:50.493226 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38aa605-179e-4cf8-8d56-a1138107ef34 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:50.502515 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38aa605-179e-4cf8-8d56-a1138107ef34 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:50.510782 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54893f51-aa3b-4577-9db7-987dbb40b2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:50.511660 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54893f51-aa3b-4577-9db7-987dbb40b2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:50.512135 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54893f51-aa3b-4577-9db7-987dbb40b2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:50.512621 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54893f51-aa3b-4577-9db7-987dbb40b2b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:50.513637 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54893f51-aa3b-4577-9db7-987dbb40b2b8 admin admin] RBAC: Adding query filter params (role.id=573b191bb7f843fa9bc910a1f859c370, scope.project.id=0f8319abb808492e927f6f07504c63c5, user.id=7fc0b6539dab4975875126fedcc5b497) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:50.514140 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54893f51-aa3b-4577-9db7-987dbb40b2b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:50.516206 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54893f51-aa3b-4577-9db7-987dbb40b2b8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:50.526460 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 58/125] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:49:50 2022] GET /identity/v3/role_assignments?user.id=7fc0b6539dab4975875126fedcc5b497&scope.project.id=0f8319abb808492e927f6f07504c63c5&role.id=573b191bb7f843fa9bc910a1f859c370 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:50.648901 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aed85-8e5a-45bc-b62e-af402dd226e7 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:50.649406 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aed85-8e5a-45bc-b62e-af402dd226e7 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:50.650420 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aed85-8e5a-45bc-b62e-af402dd226e7 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:50.652564 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 68/126] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:50.658496 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f77a0-7824-47c2-a647-8209a90550d1 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:50.659027 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f77a0-7824-47c2-a647-8209a90550d1 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:50.659494 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f77a0-7824-47c2-a647-8209a90550d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:50.683724 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-8c6f77a0-7824-47c2-a647-8209a90550d1 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:50.685246 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-8c6f77a0-7824-47c2-a647-8209a90550d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:50.699509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 59/127] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:49:50.748162 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1aed85-8e5a-45bc-b62e-af402dd226e7 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:50.765573 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1aed85-8e5a-45bc-b62e-af402dd226e7 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:50.773449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45926aea-93b5-4a31-b3f7-204909dffc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:50.774603 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45926aea-93b5-4a31-b3f7-204909dffc9a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:50.775714 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45926aea-93b5-4a31-b3f7-204909dffc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:50.776180 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45926aea-93b5-4a31-b3f7-204909dffc9a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:50.788934 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45926aea-93b5-4a31-b3f7-204909dffc9a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:50.796544 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-45926aea-93b5-4a31-b3f7-204909dffc9a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 16:49:50.797900 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 69/128] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:49:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:49:50.803907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f77a0-7824-47c2-a647-8209a90550d1 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:50.813553 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f77a0-7824-47c2-a647-8209a90550d1 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:50.827077 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e747d4-9b55-4012-8cbc-6d201c3399fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:50.828079 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e747d4-9b55-4012-8cbc-6d201c3399fc admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:50.828552 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e747d4-9b55-4012-8cbc-6d201c3399fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:50.829041 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e747d4-9b55-4012-8cbc-6d201c3399fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:50.829982 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e747d4-9b55-4012-8cbc-6d201c3399fc admin admin] RBAC: Adding query filter params (name=member) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:50.830495 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e747d4-9b55-4012-8cbc-6d201c3399fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:50.832903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5b419-a103-4360-935b-ab040ebe23ed None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:50.833439 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5b419-a103-4360-935b-ab040ebe23ed None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:50.833943 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5b419-a103-4360-935b-ab040ebe23ed None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:50.835850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e747d4-9b55-4012-8cbc-6d201c3399fc admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:50.836537 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 70/129] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:49:50.843428 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e03d3-53d0-4902-9051-b21c93bef46d None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:50.844013 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e03d3-53d0-4902-9051-b21c93bef46d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:50.844513 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e03d3-53d0-4902-9051-b21c93bef46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:50.846154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 60/130] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:49:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:50.851524 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e747d4-9b55-4012-8cbc-6d201c3399fc admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:50.861607 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e747d4-9b55-4012-8cbc-6d201c3399fc admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:50.865759 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-9d8e03d3-53d0-4902-9051-b21c93bef46d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:50.867330 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-9d8e03d3-53d0-4902-9051-b21c93bef46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:50.873729 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db5a33-a984-4e06-a175-952420432406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:50.874609 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db5a33-a984-4e06-a175-952420432406 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:50.874913 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db5a33-a984-4e06-a175-952420432406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:50.875187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db5a33-a984-4e06-a175-952420432406 admin admin] PATH_INFO: `/v3/users/8a2a549f61b94b47956e72c5b6640148` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:50.877246 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 71/131] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:50.881095 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db5a33-a984-4e06-a175-952420432406 admin admin] RBAC: Authorizing `identity:get_user(user_id=8a2a549f61b94b47956e72c5b6640148)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:50.881095 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db5a33-a984-4e06-a175-952420432406 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:50.882267 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 61/132] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:50 2022] GET /identity/v3/users/8a2a549f61b94b47956e72c5b6640148 => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:50.888197 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e03d3-53d0-4902-9051-b21c93bef46d None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:50.905147 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e03d3-53d0-4902-9051-b21c93bef46d None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:50.914310 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465ba3f-c39d-43f4-842a-4ebc20bf9e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:50.915535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465ba3f-c39d-43f4-842a-4ebc20bf9e66 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:50.916141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465ba3f-c39d-43f4-842a-4ebc20bf9e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:50.916846 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465ba3f-c39d-43f4-842a-4ebc20bf9e66 admin admin] PATH_INFO: `/v3/projects/699a7f87ffae454a82781090b073f25b` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:50.918834 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465ba3f-c39d-43f4-842a-4ebc20bf9e66 admin admin] RBAC: Authorizing `identity:get_project(project_id=699a7f87ffae454a82781090b073f25b)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:50.921261 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465ba3f-c39d-43f4-842a-4ebc20bf9e66 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:50.923351 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 72/133] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:49:50 2022] GET /identity/v3/projects/699a7f87ffae454a82781090b073f25b => generated 312 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:50.929529 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db5a33-a984-4e06-a175-952420432406 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:50.930356 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465ba3f-c39d-43f4-842a-4ebc20bf9e66 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:50.940980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db5a33-a984-4e06-a175-952420432406 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:50.941623 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465ba3f-c39d-43f4-842a-4ebc20bf9e66 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:50.946557 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465621a-1035-4daa-9570-ef3d901f8c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:50.948413 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465621a-1035-4daa-9570-ef3d901f8c5d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:50.949008 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465621a-1035-4daa-9570-ef3d901f8c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:50.949532 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465621a-1035-4daa-9570-ef3d901f8c5d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:50.951088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465621a-1035-4daa-9570-ef3d901f8c5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:50.953161 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465621a-1035-4daa-9570-ef3d901f8c5d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:50.955125 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 73/134] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:49:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:50.960313 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04a040-25cc-4779-a44b-2fdf691a3619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:50.960994 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465621a-1035-4daa-9570-ef3d901f8c5d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:50.961222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04a040-25cc-4779-a44b-2fdf691a3619 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:50.961486 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04a040-25cc-4779-a44b-2fdf691a3619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:50.961764 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04a040-25cc-4779-a44b-2fdf691a3619 admin admin] PATH_INFO: `/v3/projects/699a7f87ffae454a82781090b073f25b/users/8a2a549f61b94b47956e72c5b6640148/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:50.966023 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04a040-25cc-4779-a44b-2fdf691a3619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=699a7f87ffae454a82781090b073f25b, user_id=8a2a549f61b94b47956e72c5b6640148, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:50.969247 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04a040-25cc-4779-a44b-2fdf691a3619 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:50.980821 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465621a-1035-4daa-9570-ef3d901f8c5d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:50.989322 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84694c-4e37-4ad0-845f-205926224b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:50.995207 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84694c-4e37-4ad0-845f-205926224b92 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:50.995207 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84694c-4e37-4ad0-845f-205926224b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:50.995207 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84694c-4e37-4ad0-845f-205926224b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:50.995207 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84694c-4e37-4ad0-845f-205926224b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:50.995207 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84694c-4e37-4ad0-845f-205926224b92 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:51.097735 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 62/135] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:49:50 2022] PUT /identity/v3/projects/699a7f87ffae454a82781090b073f25b/users/8a2a549f61b94b47956e72c5b6640148/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 16:49:51.122697 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 74/136] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Feb 16 16:49:50 2022] POST /identity/v3/projects => generated 302 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 16:49:53.037624 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce06271-7385-4d0e-b431-36818f0cec99 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.038128 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce06271-7385-4d0e-b431-36818f0cec99 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.038228 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce06271-7385-4d0e-b431-36818f0cec99 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.040891 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 63/137] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:53.046979 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faad8fb-ce8f-4d3d-b7f0-57b94a9731a9 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.047419 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faad8fb-ce8f-4d3d-b7f0-57b94a9731a9 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.047595 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faad8fb-ce8f-4d3d-b7f0-57b94a9731a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.075007 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-2faad8fb-ce8f-4d3d-b7f0-57b94a9731a9 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:53.076258 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2faad8fb-ce8f-4d3d-b7f0-57b94a9731a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:53.162044 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 75/138] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:53.195139 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce06271-7385-4d0e-b431-36818f0cec99 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:53.214125 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce06271-7385-4d0e-b431-36818f0cec99 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:53.219029 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ce0c8-ae1b-4967-a087-bb66e8add25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:53.219849 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ce0c8-ae1b-4967-a087-bb66e8add25d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.220129 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ce0c8-ae1b-4967-a087-bb66e8add25d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.220404 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ce0c8-ae1b-4967-a087-bb66e8add25d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.241841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ce0c8-ae1b-4967-a087-bb66e8add25d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:53.249537 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258464e-df74-498d-a2b1-1477067f16f3 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.249729 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-911ce0c8-ae1b-4967-a087-bb66e8add25d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:49:53.249851 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258464e-df74-498d-a2b1-1477067f16f3 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.250096 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258464e-df74-498d-a2b1-1477067f16f3 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.251426 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 64/139] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:49:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:49:53.252586 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 76/140] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:49:53.258111 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ce0c8-ae1b-4967-a087-bb66e8add25d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:53.264102 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381928f-6674-4976-bf03-96033e960ac3 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.264384 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381928f-6674-4976-bf03-96033e960ac3 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.264663 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381928f-6674-4976-bf03-96033e960ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.275832 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ce0c8-ae1b-4967-a087-bb66e8add25d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:53.291567 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ae2f2-122f-49e3-aba9-e6250d47c20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:53.292159 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ae2f2-122f-49e3-aba9-e6250d47c20c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.292440 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ae2f2-122f-49e3-aba9-e6250d47c20c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.293093 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ae2f2-122f-49e3-aba9-e6250d47c20c admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.293871 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ae2f2-122f-49e3-aba9-e6250d47c20c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:53.294185 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ae2f2-122f-49e3-aba9-e6250d47c20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:53.295851 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ae2f2-122f-49e3-aba9-e6250d47c20c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:53.304679 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-0381928f-6674-4976-bf03-96033e960ac3 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:53.305895 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0381928f-6674-4976-bf03-96033e960ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:53.314220 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 65/141] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:49:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:53.323786 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 77/142] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:49:53.326856 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ae2f2-122f-49e3-aba9-e6250d47c20c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:53.344369 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ae2f2-122f-49e3-aba9-e6250d47c20c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:53.359501 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76ba73-f368-441e-9c84-cc011ff40aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:53.360395 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76ba73-f368-441e-9c84-cc011ff40aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.360676 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76ba73-f368-441e-9c84-cc011ff40aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.360953 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76ba73-f368-441e-9c84-cc011ff40aa9 admin admin] PATH_INFO: `/v3/users/b96481fed12c49429f583e04dace6093` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.362236 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76ba73-f368-441e-9c84-cc011ff40aa9 admin admin] RBAC: Authorizing `identity:get_user(user_id=b96481fed12c49429f583e04dace6093)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:53.364184 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76ba73-f368-441e-9c84-cc011ff40aa9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:53.365857 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 66/143] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:53 2022] GET /identity/v3/users/b96481fed12c49429f583e04dace6093 => generated 247 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:53.365969 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381928f-6674-4976-bf03-96033e960ac3 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:53.374427 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76ba73-f368-441e-9c84-cc011ff40aa9 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:53.380024 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381928f-6674-4976-bf03-96033e960ac3 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:53.385229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c96ef7-eddf-4f1d-bfd9-8f0476757935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:53.386345 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c96ef7-eddf-4f1d-bfd9-8f0476757935 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.386758 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c96ef7-eddf-4f1d-bfd9-8f0476757935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.387155 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c96ef7-eddf-4f1d-bfd9-8f0476757935 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.389923 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76ba73-f368-441e-9c84-cc011ff40aa9 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:53.405032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cf099-003c-4faa-a474-5fd3fc8007a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:53.405686 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cf099-003c-4faa-a474-5fd3fc8007a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.405975 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cf099-003c-4faa-a474-5fd3fc8007a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.406246 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cf099-003c-4faa-a474-5fd3fc8007a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.410220 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c96ef7-eddf-4f1d-bfd9-8f0476757935 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:53.418195 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-15c96ef7-eddf-4f1d-bfd9-8f0476757935 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 16:49:53.424055 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 78/144] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:49:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:49:53.425315 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cf099-003c-4faa-a474-5fd3fc8007a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:53.427219 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cf099-003c-4faa-a474-5fd3fc8007a7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:53.434542 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c96ef7-eddf-4f1d-bfd9-8f0476757935 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:53.453943 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c96ef7-eddf-4f1d-bfd9-8f0476757935 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:53.457844 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 67/145] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:49:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 16:49:53.463816 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cf099-003c-4faa-a474-5fd3fc8007a7 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:53.466434 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b27623-341d-4c6f-9e98-314bc74b1c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:53.467440 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b27623-341d-4c6f-9e98-314bc74b1c41 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.467937 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b27623-341d-4c6f-9e98-314bc74b1c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.468409 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b27623-341d-4c6f-9e98-314bc74b1c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.469356 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b27623-341d-4c6f-9e98-314bc74b1c41 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:53.469912 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b27623-341d-4c6f-9e98-314bc74b1c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:53.472898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b27623-341d-4c6f-9e98-314bc74b1c41 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:53.483120 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cf099-003c-4faa-a474-5fd3fc8007a7 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:53.491358 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 79/146] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:49:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:53.497954 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1a39c-87e2-4ff0-8496-a9c3f72cc3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:53.498849 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1a39c-87e2-4ff0-8496-a9c3f72cc3ad admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.499067 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b27623-341d-4c6f-9e98-314bc74b1c41 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:53.499164 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1a39c-87e2-4ff0-8496-a9c3f72cc3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.499391 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1a39c-87e2-4ff0-8496-a9c3f72cc3ad admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.500657 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1a39c-87e2-4ff0-8496-a9c3f72cc3ad admin admin] RBAC: Authorizing `identity:get_project(project_id=0f8319abb808492e927f6f07504c63c5)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:53.508313 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1a39c-87e2-4ff0-8496-a9c3f72cc3ad admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:53.514870 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 68/147] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:49:53 2022] GET /identity/v3/projects/0f8319abb808492e927f6f07504c63c5 => generated 298 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:53.517406 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1a39c-87e2-4ff0-8496-a9c3f72cc3ad admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:53.521379 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b27623-341d-4c6f-9e98-314bc74b1c41 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:53.539541 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ea213-0d92-44b3-b51a-961ab265eb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:53.541074 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ea213-0d92-44b3-b51a-961ab265eb82 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.541634 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ea213-0d92-44b3-b51a-961ab265eb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.542108 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ea213-0d92-44b3-b51a-961ab265eb82 admin admin] PATH_INFO: `/v3/users/8a2a549f61b94b47956e72c5b6640148` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.544049 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1a39c-87e2-4ff0-8496-a9c3f72cc3ad admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:53.544923 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ea213-0d92-44b3-b51a-961ab265eb82 admin admin] RBAC: Authorizing `identity:get_user(user_id=8a2a549f61b94b47956e72c5b6640148)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:53.547324 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ea213-0d92-44b3-b51a-961ab265eb82 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:53.549877 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 80/148] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:53 2022] GET /identity/v3/users/8a2a549f61b94b47956e72c5b6640148 => generated 275 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:53.554042 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85d647-a9c1-4212-9c16-f3eb290ce54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:53.554949 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85d647-a9c1-4212-9c16-f3eb290ce54f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.555430 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85d647-a9c1-4212-9c16-f3eb290ce54f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.557225 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85d647-a9c1-4212-9c16-f3eb290ce54f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.558523 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ea213-0d92-44b3-b51a-961ab265eb82 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:53.559976 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85d647-a9c1-4212-9c16-f3eb290ce54f admin admin] RBAC: Adding query filter params (role.id=8263a29ceeed4576b3b6959c99964ed7, scope.project.id=0f8319abb808492e927f6f07504c63c5, user.id=b96481fed12c49429f583e04dace6093) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:53.565077 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85d647-a9c1-4212-9c16-f3eb290ce54f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:53.567413 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85d647-a9c1-4212-9c16-f3eb290ce54f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:53.577170 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ea213-0d92-44b3-b51a-961ab265eb82 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:53.581847 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 69/149] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:49:53 2022] GET /identity/v3/role_assignments?user.id=b96481fed12c49429f583e04dace6093&scope.project.id=0f8319abb808492e927f6f07504c63c5&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 608 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:53.594392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4618699-d8f0-4fba-b614-fe555b218479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:53.595456 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4618699-d8f0-4fba-b614-fe555b218479 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.596043 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4618699-d8f0-4fba-b614-fe555b218479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.596512 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4618699-d8f0-4fba-b614-fe555b218479 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.611874 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4618699-d8f0-4fba-b614-fe555b218479 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:53.614049 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4618699-d8f0-4fba-b614-fe555b218479 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:53.625553 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 81/150] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:49:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:49:53.632677 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85d647-a9c1-4212-9c16-f3eb290ce54f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:53.644345 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85d647-a9c1-4212-9c16-f3eb290ce54f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:53.649399 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b2147-45f1-4032-9f32-d8a2757b08e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:53.651454 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b2147-45f1-4032-9f32-d8a2757b08e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.651983 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b2147-45f1-4032-9f32-d8a2757b08e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.652496 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b2147-45f1-4032-9f32-d8a2757b08e0 admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.654122 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b2147-45f1-4032-9f32-d8a2757b08e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f8319abb808492e927f6f07504c63c5)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:53.656489 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b2147-45f1-4032-9f32-d8a2757b08e0 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:53.658430 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 70/151] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:49:53 2022] GET /identity/v3/projects/0f8319abb808492e927f6f07504c63c5 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:53.665325 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4618699-d8f0-4fba-b614-fe555b218479 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:53.679795 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4618699-d8f0-4fba-b614-fe555b218479 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:53.685973 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0faaab-c463-4023-a88b-7bb814b57eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:53.686962 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0faaab-c463-4023-a88b-7bb814b57eab admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.687445 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0faaab-c463-4023-a88b-7bb814b57eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.687913 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0faaab-c463-4023-a88b-7bb814b57eab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.688962 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0faaab-c463-4023-a88b-7bb814b57eab admin admin] RBAC: Adding query filter params (role.id=cf30e55f556b4e0cbee0317b16316b0f, scope.project.id=0f8319abb808492e927f6f07504c63c5, user.id=8a2a549f61b94b47956e72c5b6640148) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:53.689470 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0faaab-c463-4023-a88b-7bb814b57eab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:53.691570 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0faaab-c463-4023-a88b-7bb814b57eab admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:53.700430 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 82/152] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:49:53 2022] GET /identity/v3/role_assignments?user.id=8a2a549f61b94b47956e72c5b6640148&scope.project.id=0f8319abb808492e927f6f07504c63c5&role.id=cf30e55f556b4e0cbee0317b16316b0f => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:53.732611 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6a4c0-ad4f-4044-beb9-cf019053afc9 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.732967 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7b5b1-aedd-4224-9cdf-4dfe43a07e5c None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.733203 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7b5b1-aedd-4224-9cdf-4dfe43a07e5c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.733481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7b5b1-aedd-4224-9cdf-4dfe43a07e5c None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.733832 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6a4c0-ad4f-4044-beb9-cf019053afc9 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.734355 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6a4c0-ad4f-4044-beb9-cf019053afc9 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.735929 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 83/153] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:53.736808 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 71/154] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:53.743108 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ac2fb-296f-4970-b0d1-5af7676fc060 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.744139 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ac2fb-296f-4970-b0d1-5af7676fc060 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.744436 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ac2fb-296f-4970-b0d1-5af7676fc060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.762276 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0408fca-9d10-4681-a9b2-05e20f037637 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.763160 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0408fca-9d10-4681-a9b2-05e20f037637 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.763642 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0408fca-9d10-4681-a9b2-05e20f037637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.783898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-ae9ac2fb-296f-4970-b0d1-5af7676fc060 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:53.787010 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-ae9ac2fb-296f-4970-b0d1-5af7676fc060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:53.795828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-a0408fca-9d10-4681-a9b2-05e20f037637 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:53.796966 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-a0408fca-9d10-4681-a9b2-05e20f037637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:53.797438 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 84/155] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:53.821214 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 72/156] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:49:53.838044 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ac2fb-296f-4970-b0d1-5af7676fc060 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:53.850084 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ac2fb-296f-4970-b0d1-5af7676fc060 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:53.862997 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f894b-5947-4f83-a0f1-9013c6eb8c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:53.864058 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0408fca-9d10-4681-a9b2-05e20f037637 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:53.864576 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f894b-5947-4f83-a0f1-9013c6eb8c0f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.865058 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f894b-5947-4f83-a0f1-9013c6eb8c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.865589 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f894b-5947-4f83-a0f1-9013c6eb8c0f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.883250 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0408fca-9d10-4681-a9b2-05e20f037637 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:53.885682 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f894b-5947-4f83-a0f1-9013c6eb8c0f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:53.894157 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-f22f894b-5947-4f83-a0f1-9013c6eb8c0f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 16:49:53.895806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 85/157] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:49:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:49:53.903005 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210d0dd-90f0-49b5-b084-39910871e27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:53.903832 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210d0dd-90f0-49b5-b084-39910871e27c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.904114 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210d0dd-90f0-49b5-b084-39910871e27c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.904407 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210d0dd-90f0-49b5-b084-39910871e27c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.906568 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f894b-5947-4f83-a0f1-9013c6eb8c0f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:53.925944 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f894b-5947-4f83-a0f1-9013c6eb8c0f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:53.930702 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210d0dd-90f0-49b5-b084-39910871e27c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:53.936950 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddc3b4-dcd2-4755-89fc-a0fb2ccc61c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:53.938009 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddc3b4-dcd2-4755-89fc-a0fb2ccc61c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.938510 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddc3b4-dcd2-4755-89fc-a0fb2ccc61c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.939061 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddc3b4-dcd2-4755-89fc-a0fb2ccc61c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.940086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddc3b4-dcd2-4755-89fc-a0fb2ccc61c4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:53.940677 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddc3b4-dcd2-4755-89fc-a0fb2ccc61c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:53.942731 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddc3b4-dcd2-4755-89fc-a0fb2ccc61c4 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:53.950716 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-6210d0dd-90f0-49b5-b084-39910871e27c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 16:49:53.950716 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 73/158] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:49:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:49:53.955722 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210d0dd-90f0-49b5-b084-39910871e27c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:53.961034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 86/159] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:49:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:53.974729 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210d0dd-90f0-49b5-b084-39910871e27c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:53.976738 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddc3b4-dcd2-4755-89fc-a0fb2ccc61c4 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:53.991158 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de52ea-2ba8-4f7e-beb7-b066c6b8362a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:53.991833 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de52ea-2ba8-4f7e-beb7-b066c6b8362a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:53.992105 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de52ea-2ba8-4f7e-beb7-b066c6b8362a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:53.992372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de52ea-2ba8-4f7e-beb7-b066c6b8362a admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:53.993128 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de52ea-2ba8-4f7e-beb7-b066c6b8362a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:53.993988 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de52ea-2ba8-4f7e-beb7-b066c6b8362a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:53.995610 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de52ea-2ba8-4f7e-beb7-b066c6b8362a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:53.999029 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddc3b4-dcd2-4755-89fc-a0fb2ccc61c4 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:54.007586 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 74/160] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:49:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:54.008173 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f038a7-b346-4784-b912-ce630af70f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:54.009311 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f038a7-b346-4784-b912-ce630af70f2d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:54.009973 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f038a7-b346-4784-b912-ce630af70f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:54.010379 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f038a7-b346-4784-b912-ce630af70f2d admin admin] PATH_INFO: `/v3/users/8a2a549f61b94b47956e72c5b6640148` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:54.011819 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f038a7-b346-4784-b912-ce630af70f2d admin admin] RBAC: Authorizing `identity:get_user(user_id=8a2a549f61b94b47956e72c5b6640148)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:54.013143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de52ea-2ba8-4f7e-beb7-b066c6b8362a admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:54.016172 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f038a7-b346-4784-b912-ce630af70f2d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:54.019528 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 87/161] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:53 2022] GET /identity/v3/users/8a2a549f61b94b47956e72c5b6640148 => generated 275 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:54.024335 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de52ea-2ba8-4f7e-beb7-b066c6b8362a admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:54.028993 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f038a7-b346-4784-b912-ce630af70f2d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:54.032586 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8d5ed-b071-4739-96f8-c621dcf0b8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:54.033556 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8d5ed-b071-4739-96f8-c621dcf0b8cb admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:54.033952 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8d5ed-b071-4739-96f8-c621dcf0b8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:54.034322 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8d5ed-b071-4739-96f8-c621dcf0b8cb admin admin] PATH_INFO: `/v3/users/7fc0b6539dab4975875126fedcc5b497` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:54.035656 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8d5ed-b071-4739-96f8-c621dcf0b8cb admin admin] RBAC: Authorizing `identity:get_user(user_id=7fc0b6539dab4975875126fedcc5b497)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:54.037875 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8d5ed-b071-4739-96f8-c621dcf0b8cb admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:54.041182 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 75/162] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:54 2022] GET /identity/v3/users/7fc0b6539dab4975875126fedcc5b497 => generated 289 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:54.045344 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f038a7-b346-4784-b912-ce630af70f2d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:54.045689 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8d5ed-b071-4739-96f8-c621dcf0b8cb admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:54.051784 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b9b15-4a79-4c58-8a3d-88a3983dec1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:54.052940 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b9b15-4a79-4c58-8a3d-88a3983dec1a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:54.053353 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b9b15-4a79-4c58-8a3d-88a3983dec1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:54.053748 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b9b15-4a79-4c58-8a3d-88a3983dec1a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:54.057739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8d5ed-b071-4739-96f8-c621dcf0b8cb admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:54.063966 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd31a00-4e7b-40d5-ad5a-2da54ba320b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:54.064598 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b9b15-4a79-4c58-8a3d-88a3983dec1a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:54.065186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd31a00-4e7b-40d5-ad5a-2da54ba320b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:54.065548 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd31a00-4e7b-40d5-ad5a-2da54ba320b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:54.065910 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd31a00-4e7b-40d5-ad5a-2da54ba320b6 admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:54.067142 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b9b15-4a79-4c58-8a3d-88a3983dec1a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:54.068137 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd31a00-4e7b-40d5-ad5a-2da54ba320b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f8319abb808492e927f6f07504c63c5)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:54.070368 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd31a00-4e7b-40d5-ad5a-2da54ba320b6 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:54.072341 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 76/163] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:49:54 2022] GET /identity/v3/projects/0f8319abb808492e927f6f07504c63c5 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:54.078040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd31a00-4e7b-40d5-ad5a-2da54ba320b6 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:54.078618 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 88/164] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:49:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 16:49:54.084185 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b9b15-4a79-4c58-8a3d-88a3983dec1a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:54.089566 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd31a00-4e7b-40d5-ad5a-2da54ba320b6 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:54.094639 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a334a7-dd34-43b5-a207-514ab1035271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:54.095592 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b9b15-4a79-4c58-8a3d-88a3983dec1a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:54.095838 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a334a7-dd34-43b5-a207-514ab1035271 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:54.096205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a334a7-dd34-43b5-a207-514ab1035271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:54.096564 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a334a7-dd34-43b5-a207-514ab1035271 admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5/users/7fc0b6539dab4975875126fedcc5b497/roles/573b191bb7f843fa9bc910a1f859c370` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:54.100815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a334a7-dd34-43b5-a207-514ab1035271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f8319abb808492e927f6f07504c63c5, user_id=7fc0b6539dab4975875126fedcc5b497, role_id=573b191bb7f843fa9bc910a1f859c370)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:54.101818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840559e6-c68b-4396-94e5-7920ddaa4d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:54.103564 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840559e6-c68b-4396-94e5-7920ddaa4d13 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:54.104226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840559e6-c68b-4396-94e5-7920ddaa4d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:54.104647 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840559e6-c68b-4396-94e5-7920ddaa4d13 admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:54.104824 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a334a7-dd34-43b5-a207-514ab1035271 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:54.106137 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840559e6-c68b-4396-94e5-7920ddaa4d13 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f8319abb808492e927f6f07504c63c5)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:54.108605 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840559e6-c68b-4396-94e5-7920ddaa4d13 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:54.110557 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 89/165] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:49:54 2022] GET /identity/v3/projects/0f8319abb808492e927f6f07504c63c5 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:54.116399 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840559e6-c68b-4396-94e5-7920ddaa4d13 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:54.128671 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840559e6-c68b-4396-94e5-7920ddaa4d13 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:54.136738 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090c67e-5014-42c2-88bc-25d742c71c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:54.137891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090c67e-5014-42c2-88bc-25d742c71c43 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:54.138408 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090c67e-5014-42c2-88bc-25d742c71c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:54.138971 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090c67e-5014-42c2-88bc-25d742c71c43 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:54.140620 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090c67e-5014-42c2-88bc-25d742c71c43 admin admin] RBAC: Adding query filter params (role.id=d361c0606e4646d3afa601176d0422ec, scope.project.id=0f8319abb808492e927f6f07504c63c5, user.id=8a2a549f61b94b47956e72c5b6640148) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:54.141415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090c67e-5014-42c2-88bc-25d742c71c43 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:54.146476 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090c67e-5014-42c2-88bc-25d742c71c43 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:54.158306 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 90/166] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:49:54 2022] GET /identity/v3/role_assignments?user.id=8a2a549f61b94b47956e72c5b6640148&scope.project.id=0f8319abb808492e927f6f07504c63c5&role.id=d361c0606e4646d3afa601176d0422ec => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:54.183873 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 77/167] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:49:54 2022] PUT /identity/v3/projects/0f8319abb808492e927f6f07504c63c5/users/7fc0b6539dab4975875126fedcc5b497/roles/573b191bb7f843fa9bc910a1f859c370 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 16:49:54.605613 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c7146-81e2-4f35-99ea-cf2b8ab1d9d8 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:54.605953 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c7146-81e2-4f35-99ea-cf2b8ab1d9d8 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:54.606168 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c7146-81e2-4f35-99ea-cf2b8ab1d9d8 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:54.608349 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 91/168] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:54.613642 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae75f44-bda4-47c7-8ade-8fb889ee7380 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:54.613924 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae75f44-bda4-47c7-8ade-8fb889ee7380 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:54.614193 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae75f44-bda4-47c7-8ade-8fb889ee7380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:54.631581 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-2ae75f44-bda4-47c7-8ade-8fb889ee7380 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:54.632748 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-2ae75f44-bda4-47c7-8ade-8fb889ee7380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:54.688511 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 78/169] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:54.711355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c7146-81e2-4f35-99ea-cf2b8ab1d9d8 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:54.724197 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c7146-81e2-4f35-99ea-cf2b8ab1d9d8 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:54.729287 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f82709-a20d-4360-bb05-3edd22b0cc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:54.730105 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f82709-a20d-4360-bb05-3edd22b0cc68 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:54.730379 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f82709-a20d-4360-bb05-3edd22b0cc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:54.730656 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f82709-a20d-4360-bb05-3edd22b0cc68 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:54.743034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f82709-a20d-4360-bb05-3edd22b0cc68 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:54.750133 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-68f82709-a20d-4360-bb05-3edd22b0cc68 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 16:49:54.751594 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 92/170] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:49:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:49:54.757085 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae75f44-bda4-47c7-8ade-8fb889ee7380 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:54.766595 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae75f44-bda4-47c7-8ade-8fb889ee7380 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:54.770886 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3827dd5-2728-4744-954b-26fa66530d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:54.771538 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3827dd5-2728-4744-954b-26fa66530d2d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:54.771810 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3827dd5-2728-4744-954b-26fa66530d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:54.772077 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3827dd5-2728-4744-954b-26fa66530d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:54.772821 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3827dd5-2728-4744-954b-26fa66530d2d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:54.773118 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3827dd5-2728-4744-954b-26fa66530d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:54.775382 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3827dd5-2728-4744-954b-26fa66530d2d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:54.783947 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 79/171] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:49:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:54.789017 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f82709-a20d-4360-bb05-3edd22b0cc68 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:54.799225 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f82709-a20d-4360-bb05-3edd22b0cc68 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:54.803464 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c75f8-42af-4b5b-bbec-b5930b487f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:54.804291 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c75f8-42af-4b5b-bbec-b5930b487f1f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:54.804563 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c75f8-42af-4b5b-bbec-b5930b487f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:54.804827 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c75f8-42af-4b5b-bbec-b5930b487f1f admin admin] PATH_INFO: `/v3/users/8a2a549f61b94b47956e72c5b6640148` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:54.806141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c75f8-42af-4b5b-bbec-b5930b487f1f admin admin] RBAC: Authorizing `identity:get_user(user_id=8a2a549f61b94b47956e72c5b6640148)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:54.808285 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c75f8-42af-4b5b-bbec-b5930b487f1f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:54.809959 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 93/172] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:54 2022] GET /identity/v3/users/8a2a549f61b94b47956e72c5b6640148 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:54.814811 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3827dd5-2728-4744-954b-26fa66530d2d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:54.824699 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3827dd5-2728-4744-954b-26fa66530d2d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:54.828869 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cce086-412e-4299-b130-91e1a9d56306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:54.829489 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cce086-412e-4299-b130-91e1a9d56306 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:54.829764 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cce086-412e-4299-b130-91e1a9d56306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:54.830032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cce086-412e-4299-b130-91e1a9d56306 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:54.838367 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cce086-412e-4299-b130-91e1a9d56306 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:54.840132 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cce086-412e-4299-b130-91e1a9d56306 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:54.849674 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 80/173] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:49:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:49:54.855346 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c75f8-42af-4b5b-bbec-b5930b487f1f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:54.864945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c75f8-42af-4b5b-bbec-b5930b487f1f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:54.869777 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83737c3-da03-49eb-86e2-56c8a0d76de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:54.870611 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83737c3-da03-49eb-86e2-56c8a0d76de8 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:54.870918 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83737c3-da03-49eb-86e2-56c8a0d76de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:54.871187 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83737c3-da03-49eb-86e2-56c8a0d76de8 admin admin] PATH_INFO: `/v3/projects/699a7f87ffae454a82781090b073f25b` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:54.872338 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83737c3-da03-49eb-86e2-56c8a0d76de8 admin admin] RBAC: Authorizing `identity:get_project(project_id=699a7f87ffae454a82781090b073f25b)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:54.874358 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83737c3-da03-49eb-86e2-56c8a0d76de8 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:54.876151 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 94/174] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:49:54 2022] GET /identity/v3/projects/699a7f87ffae454a82781090b073f25b => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:54.881460 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cce086-412e-4299-b130-91e1a9d56306 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:54.890718 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cce086-412e-4299-b130-91e1a9d56306 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:54.894935 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de56d13-7142-4719-a4b1-6b27f4c11f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:54.895569 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de56d13-7142-4719-a4b1-6b27f4c11f39 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:54.895835 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de56d13-7142-4719-a4b1-6b27f4c11f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:54.896105 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de56d13-7142-4719-a4b1-6b27f4c11f39 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:54.896914 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de56d13-7142-4719-a4b1-6b27f4c11f39 admin admin] RBAC: Adding query filter params (role.id=d361c0606e4646d3afa601176d0422ec, scope.project.id=699a7f87ffae454a82781090b073f25b, user.id=8a2a549f61b94b47956e72c5b6640148) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:54.897218 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de56d13-7142-4719-a4b1-6b27f4c11f39 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:54.899055 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de56d13-7142-4719-a4b1-6b27f4c11f39 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:54.907631 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 81/175] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:49:54 2022] GET /identity/v3/role_assignments?user.id=8a2a549f61b94b47956e72c5b6640148&scope.project.id=699a7f87ffae454a82781090b073f25b&role.id=d361c0606e4646d3afa601176d0422ec => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:55.098306 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cf081-d867-488c-8e68-d049cf24ccf9 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:55.098830 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cf081-d867-488c-8e68-d049cf24ccf9 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:55.098830 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cf081-d867-488c-8e68-d049cf24ccf9 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:55.100737 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 95/176] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:55.106973 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057ad9f-4071-4d94-a9a9-f1a73dd7f50f None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:55.107407 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057ad9f-4071-4d94-a9a9-f1a73dd7f50f None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:55.107531 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057ad9f-4071-4d94-a9a9-f1a73dd7f50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:55.132494 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-6057ad9f-4071-4d94-a9a9-f1a73dd7f50f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:55.133695 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6057ad9f-4071-4d94-a9a9-f1a73dd7f50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:55.141866 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 82/177] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:55.168192 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cf081-d867-488c-8e68-d049cf24ccf9 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:55.179962 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cf081-d867-488c-8e68-d049cf24ccf9 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:55.184554 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bd0a4-ce18-474e-a115-437a86c40386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:55.185332 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bd0a4-ce18-474e-a115-437a86c40386 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:55.185611 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bd0a4-ce18-474e-a115-437a86c40386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:55.185881 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bd0a4-ce18-474e-a115-437a86c40386 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:55.187047 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bd0a4-ce18-474e-a115-437a86c40386 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:55.188729 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bd0a4-ce18-474e-a115-437a86c40386 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:55.190460 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 96/178] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:49:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:55.195687 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057ad9f-4071-4d94-a9a9-f1a73dd7f50f None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:55.205151 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057ad9f-4071-4d94-a9a9-f1a73dd7f50f None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:55.209393 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a296051-0875-49c8-8c32-e8d33fc3c5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:55.210034 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a296051-0875-49c8-8c32-e8d33fc3c5eb admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:55.210311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a296051-0875-49c8-8c32-e8d33fc3c5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:55.210582 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a296051-0875-49c8-8c32-e8d33fc3c5eb admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:55.211323 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a296051-0875-49c8-8c32-e8d33fc3c5eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:55.213822 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a296051-0875-49c8-8c32-e8d33fc3c5eb admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:55.428897 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 83/179] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Feb 16 16:49:55 2022] POST /identity/v3/users => generated 283 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:49:56.632747 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bd07d-e78a-4c80-8ba7-95562e9594e5 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:56.633283 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bd07d-e78a-4c80-8ba7-95562e9594e5 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:56.633283 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bd07d-e78a-4c80-8ba7-95562e9594e5 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:56.635115 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 97/180] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:56.640648 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a9285-b891-4ff6-bb97-0f922d357566 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:56.641088 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a9285-b891-4ff6-bb97-0f922d357566 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:56.641283 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a9285-b891-4ff6-bb97-0f922d357566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:56.661233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-ca4a9285-b891-4ff6-bb97-0f922d357566 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:56.662458 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-ca4a9285-b891-4ff6-bb97-0f922d357566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:56.671037 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 84/181] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:49:56.695461 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bd07d-e78a-4c80-8ba7-95562e9594e5 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:56.710002 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bd07d-e78a-4c80-8ba7-95562e9594e5 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:56.715306 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a14d6-d819-426e-8513-c9962fcac64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:56.716233 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a14d6-d819-426e-8513-c9962fcac64c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:56.720669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a14d6-d819-426e-8513-c9962fcac64c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:56.720669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a14d6-d819-426e-8513-c9962fcac64c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:56.728454 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a14d6-d819-426e-8513-c9962fcac64c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:56.736137 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-f97a14d6-d819-426e-8513-c9962fcac64c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 16:49:56.737400 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 98/182] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:49:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:49:56.744148 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a9285-b891-4ff6-bb97-0f922d357566 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:56.753519 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a9285-b891-4ff6-bb97-0f922d357566 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:56.758184 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec44b7-8bd5-4521-bb8a-6b0234ce1c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:56.759588 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec44b7-8bd5-4521-bb8a-6b0234ce1c05 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:56.759938 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec44b7-8bd5-4521-bb8a-6b0234ce1c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:56.760293 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec44b7-8bd5-4521-bb8a-6b0234ce1c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:56.761053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec44b7-8bd5-4521-bb8a-6b0234ce1c05 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:56.761459 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec44b7-8bd5-4521-bb8a-6b0234ce1c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:56.763314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec44b7-8bd5-4521-bb8a-6b0234ce1c05 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:56.772207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 85/183] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:49:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:56.778997 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a14d6-d819-426e-8513-c9962fcac64c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:56.789799 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a14d6-d819-426e-8513-c9962fcac64c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:56.795146 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3991c0-9ff3-49e8-a57c-340e0e790139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:56.796302 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3991c0-9ff3-49e8-a57c-340e0e790139 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:56.796619 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3991c0-9ff3-49e8-a57c-340e0e790139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:56.796979 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3991c0-9ff3-49e8-a57c-340e0e790139 admin admin] PATH_INFO: `/v3/users/7fc0b6539dab4975875126fedcc5b497` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:56.798445 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3991c0-9ff3-49e8-a57c-340e0e790139 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fc0b6539dab4975875126fedcc5b497)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:56.800627 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3991c0-9ff3-49e8-a57c-340e0e790139 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:56.802298 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 99/184] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:56 2022] GET /identity/v3/users/7fc0b6539dab4975875126fedcc5b497 => generated 289 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:56.808629 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec44b7-8bd5-4521-bb8a-6b0234ce1c05 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:56.818742 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec44b7-8bd5-4521-bb8a-6b0234ce1c05 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:56.824317 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49596b4-5a38-4a77-a174-905a40170051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:56.825028 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49596b4-5a38-4a77-a174-905a40170051 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:56.825309 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49596b4-5a38-4a77-a174-905a40170051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:56.825585 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49596b4-5a38-4a77-a174-905a40170051 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:56.834481 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49596b4-5a38-4a77-a174-905a40170051 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:56.836307 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49596b4-5a38-4a77-a174-905a40170051 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:56.846318 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 86/185] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:49:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:49:56.852337 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3991c0-9ff3-49e8-a57c-340e0e790139 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:56.862488 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3991c0-9ff3-49e8-a57c-340e0e790139 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:56.866951 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf886e-2807-4327-ae91-6f7463754e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:56.867808 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf886e-2807-4327-ae91-6f7463754e18 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:56.868090 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf886e-2807-4327-ae91-6f7463754e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:56.868481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf886e-2807-4327-ae91-6f7463754e18 admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:56.869747 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf886e-2807-4327-ae91-6f7463754e18 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f8319abb808492e927f6f07504c63c5)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:56.871850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf886e-2807-4327-ae91-6f7463754e18 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:56.873675 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 100/186] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:49:56 2022] GET /identity/v3/projects/0f8319abb808492e927f6f07504c63c5 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:56.879178 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49596b4-5a38-4a77-a174-905a40170051 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:56.888852 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49596b4-5a38-4a77-a174-905a40170051 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:56.893258 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4ccdc-bf28-451d-a547-8212213725af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:56.893947 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4ccdc-bf28-451d-a547-8212213725af admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:56.894232 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4ccdc-bf28-451d-a547-8212213725af admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:56.894509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4ccdc-bf28-451d-a547-8212213725af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:56.895375 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4ccdc-bf28-451d-a547-8212213725af admin admin] RBAC: Adding query filter params (role.id=573b191bb7f843fa9bc910a1f859c370, scope.project.id=0f8319abb808492e927f6f07504c63c5, user.id=7fc0b6539dab4975875126fedcc5b497) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:56.895682 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4ccdc-bf28-451d-a547-8212213725af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:56.897522 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4ccdc-bf28-451d-a547-8212213725af admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:56.904202 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 87/187] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:49:56 2022] GET /identity/v3/role_assignments?user.id=7fc0b6539dab4975875126fedcc5b497&scope.project.id=0f8319abb808492e927f6f07504c63c5&role.id=573b191bb7f843fa9bc910a1f859c370 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:57.876297 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9a5c2-f7ac-4135-8c88-8e0b996eb54a None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:57.876795 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9a5c2-f7ac-4135-8c88-8e0b996eb54a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:57.876795 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9a5c2-f7ac-4135-8c88-8e0b996eb54a None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:57.878711 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 101/188] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:57.884669 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c5de7-2e7f-48bb-b1d3-1cb8136fb11f None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:57.885107 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c5de7-2e7f-48bb-b1d3-1cb8136fb11f None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:57.885514 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c5de7-2e7f-48bb-b1d3-1cb8136fb11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:57.910261 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-192c5de7-2e7f-48bb-b1d3-1cb8136fb11f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:57.911465 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-192c5de7-2e7f-48bb-b1d3-1cb8136fb11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:57.919440 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 88/189] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:49:57.943765 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9a5c2-f7ac-4135-8c88-8e0b996eb54a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:57.956984 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9a5c2-f7ac-4135-8c88-8e0b996eb54a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:57.961140 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5ad08-2dec-4c84-917c-b65d53cee01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:57.961940 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5ad08-2dec-4c84-917c-b65d53cee01d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:57.962385 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5ad08-2dec-4c84-917c-b65d53cee01d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:57.962940 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5ad08-2dec-4c84-917c-b65d53cee01d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:57.973423 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5ad08-2dec-4c84-917c-b65d53cee01d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:57.975980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa3ff2-0c66-4f6f-8df6-080a4e3cd41a None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:57.976267 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa3ff2-0c66-4f6f-8df6-080a4e3cd41a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:57.976539 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa3ff2-0c66-4f6f-8df6-080a4e3cd41a None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:57.978575 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 89/190] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:49:57.980734 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-a0b5ad08-2dec-4c84-917c-b65d53cee01d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:49:57.982682 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 102/191] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:49:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:49:57.983938 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8c50-8865-490a-bed5-b1a717eac151 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:57.984224 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8c50-8865-490a-bed5-b1a717eac151 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:57.984493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8c50-8865-490a-bed5-b1a717eac151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:57.989187 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5ad08-2dec-4c84-917c-b65d53cee01d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:57.999897 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5ad08-2dec-4c84-917c-b65d53cee01d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:58.002787 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-f0ea8c50-8865-490a-bed5-b1a717eac151 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:58.003951 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f0ea8c50-8865-490a-bed5-b1a717eac151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:58.004330 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51c746-da7b-46df-b2be-bd0cf163a137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:58.004980 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51c746-da7b-46df-b2be-bd0cf163a137 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:58.005258 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51c746-da7b-46df-b2be-bd0cf163a137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:58.005530 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51c746-da7b-46df-b2be-bd0cf163a137 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:58.006305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51c746-da7b-46df-b2be-bd0cf163a137 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:58.006611 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51c746-da7b-46df-b2be-bd0cf163a137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:58.008221 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51c746-da7b-46df-b2be-bd0cf163a137 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:58.012019 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 90/192] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:49:58.014475 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38babd35-d474-4574-bd8a-b0d271861dac None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:58.014846 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38babd35-d474-4574-bd8a-b0d271861dac None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:58.015126 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38babd35-d474-4574-bd8a-b0d271861dac None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:58.016918 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 91/193] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:49:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:49:58.022362 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 103/194] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:49:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:58.023022 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51c746-da7b-46df-b2be-bd0cf163a137 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:58.023191 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997d62b-22a2-4c08-9d23-87aa24191a38 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:58.023586 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997d62b-22a2-4c08-9d23-87aa24191a38 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:58.023859 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997d62b-22a2-4c08-9d23-87aa24191a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:58.032345 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51c746-da7b-46df-b2be-bd0cf163a137 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:58.036859 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532769c-e4cd-4f59-adf0-f486e0c396f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:58.037702 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532769c-e4cd-4f59-adf0-f486e0c396f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:58.037985 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532769c-e4cd-4f59-adf0-f486e0c396f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:58.038258 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532769c-e4cd-4f59-adf0-f486e0c396f6 admin admin] PATH_INFO: `/v3/users/87af6af2b8004988ab13ddf21cb9801e` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:58.041090 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-9997d62b-22a2-4c08-9d23-87aa24191a38 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:49:58.042280 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-9997d62b-22a2-4c08-9d23-87aa24191a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:49:58.049566 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 92/195] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:49:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:49:58.051186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997d62b-22a2-4c08-9d23-87aa24191a38 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:58.051613 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532769c-e4cd-4f59-adf0-f486e0c396f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=87af6af2b8004988ab13ddf21cb9801e)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:58.053715 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532769c-e4cd-4f59-adf0-f486e0c396f6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:58.055577 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 104/196] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:58 2022] GET /identity/v3/users/87af6af2b8004988ab13ddf21cb9801e => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:58.061227 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532769c-e4cd-4f59-adf0-f486e0c396f6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:58.061669 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997d62b-22a2-4c08-9d23-87aa24191a38 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:58.065973 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ded5a-df3d-4b31-94ff-2eee97e9a38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:58.066759 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ded5a-df3d-4b31-94ff-2eee97e9a38c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:58.067043 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ded5a-df3d-4b31-94ff-2eee97e9a38c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:58.067311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ded5a-df3d-4b31-94ff-2eee97e9a38c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:58.070610 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532769c-e4cd-4f59-adf0-f486e0c396f6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:58.075862 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac09452-be83-4479-8916-dbc9e7a8eb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:58.076489 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac09452-be83-4479-8916-dbc9e7a8eb56 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:58.076773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac09452-be83-4479-8916-dbc9e7a8eb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:58.077050 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac09452-be83-4479-8916-dbc9e7a8eb56 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:58.078427 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ded5a-df3d-4b31-94ff-2eee97e9a38c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:49:58.084995 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac09452-be83-4479-8916-dbc9e7a8eb56 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:58.085612 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-ad7ded5a-df3d-4b31-94ff-2eee97e9a38c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 16:49:58.086749 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac09452-be83-4479-8916-dbc9e7a8eb56 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:58.086839 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 93/197] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:49:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:49:58.088386 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ded5a-df3d-4b31-94ff-2eee97e9a38c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:58.096666 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 105/198] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:49:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 16:49:58.097277 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ded5a-df3d-4b31-94ff-2eee97e9a38c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:58.097379 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac09452-be83-4479-8916-dbc9e7a8eb56 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:58.101408 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89a6d8-5842-4802-a007-237c0c227d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:58.102136 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89a6d8-5842-4802-a007-237c0c227d22 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:58.102416 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89a6d8-5842-4802-a007-237c0c227d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:58.102768 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89a6d8-5842-4802-a007-237c0c227d22 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:58.104431 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89a6d8-5842-4802-a007-237c0c227d22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:58.106090 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89a6d8-5842-4802-a007-237c0c227d22 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:58.106933 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac09452-be83-4479-8916-dbc9e7a8eb56 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:58.107917 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 94/199] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:49:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:58.108634 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89a6d8-5842-4802-a007-237c0c227d22 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:58.112370 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d5563-0750-475a-8a5e-797db9f3a0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:58.113011 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d5563-0750-475a-8a5e-797db9f3a0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:58.113292 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d5563-0750-475a-8a5e-797db9f3a0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:58.113565 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d5563-0750-475a-8a5e-797db9f3a0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:58.114301 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d5563-0750-475a-8a5e-797db9f3a0c6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:58.114604 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d5563-0750-475a-8a5e-797db9f3a0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:58.116201 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d5563-0750-475a-8a5e-797db9f3a0c6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:58.117982 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89a6d8-5842-4802-a007-237c0c227d22 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:58.122546 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252333e-c71a-4cef-90a4-d1e72b575cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:58.123379 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252333e-c71a-4cef-90a4-d1e72b575cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:58.123661 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252333e-c71a-4cef-90a4-d1e72b575cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:58.123937 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252333e-c71a-4cef-90a4-d1e72b575cb5 admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:58.124808 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 106/200] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:49:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:58.125105 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252333e-c71a-4cef-90a4-d1e72b575cb5 admin admin] RBAC: Authorizing `identity:get_project(project_id=83908d6e37ad41e2882ed8f20923b274)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:58.125561 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d5563-0750-475a-8a5e-797db9f3a0c6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:58.127281 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252333e-c71a-4cef-90a4-d1e72b575cb5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:58.129186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 95/201] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:49:58 2022] GET /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:58.129954 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252333e-c71a-4cef-90a4-d1e72b575cb5 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:58.134888 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d5563-0750-475a-8a5e-797db9f3a0c6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:58.139116 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339685bc-374f-4d45-9f68-e5aa7f6131ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:58.139291 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252333e-c71a-4cef-90a4-d1e72b575cb5 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:58.139748 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339685bc-374f-4d45-9f68-e5aa7f6131ba admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:58.140032 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339685bc-374f-4d45-9f68-e5aa7f6131ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:58.140310 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339685bc-374f-4d45-9f68-e5aa7f6131ba admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:58.141003 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339685bc-374f-4d45-9f68-e5aa7f6131ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:58.141998 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-339685bc-374f-4d45-9f68-e5aa7f6131ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:49:58.141998 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 16:49:58.141998 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 16:49:58.143201 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339685bc-374f-4d45-9f68-e5aa7f6131ba admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:58.143588 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a6b4f-c972-4272-8922-97c1f490d445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:58.144385 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a6b4f-c972-4272-8922-97c1f490d445 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:58.144666 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a6b4f-c972-4272-8922-97c1f490d445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:58.144938 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a6b4f-c972-4272-8922-97c1f490d445 admin admin] PATH_INFO: `/v3/users/87af6af2b8004988ab13ddf21cb9801e` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:58.146101 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a6b4f-c972-4272-8922-97c1f490d445 admin admin] RBAC: Authorizing `identity:get_user(user_id=87af6af2b8004988ab13ddf21cb9801e)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:58.148181 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a6b4f-c972-4272-8922-97c1f490d445 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:58.150231 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 96/202] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:49:58 2022] GET /identity/v3/users/87af6af2b8004988ab13ddf21cb9801e => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:58.150977 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a6b4f-c972-4272-8922-97c1f490d445 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:58.164509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a6b4f-c972-4272-8922-97c1f490d445 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:58.169637 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f181633-9770-49ab-afbd-c0e00125af14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:58.173865 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f181633-9770-49ab-afbd-c0e00125af14 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:58.173865 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f181633-9770-49ab-afbd-c0e00125af14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:58.173865 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f181633-9770-49ab-afbd-c0e00125af14 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:58.173865 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f181633-9770-49ab-afbd-c0e00125af14 admin admin] RBAC: Adding query filter params (role.id=8263a29ceeed4576b3b6959c99964ed7, scope.project.id=83908d6e37ad41e2882ed8f20923b274, user.id=87af6af2b8004988ab13ddf21cb9801e) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:58.173865 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f181633-9770-49ab-afbd-c0e00125af14 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:58.174229 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f181633-9770-49ab-afbd-c0e00125af14 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:58.179034 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 97/203] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:49:58 2022] GET /identity/v3/role_assignments?user.id=87af6af2b8004988ab13ddf21cb9801e&scope.project.id=83908d6e37ad41e2882ed8f20923b274&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:49:58.179773 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f181633-9770-49ab-afbd-c0e00125af14 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:58.190432 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f181633-9770-49ab-afbd-c0e00125af14 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:58.195264 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce11e44-0973-43a9-a74f-7a0913f5e474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:58.195994 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce11e44-0973-43a9-a74f-7a0913f5e474 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:58.196291 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce11e44-0973-43a9-a74f-7a0913f5e474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:58.197262 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce11e44-0973-43a9-a74f-7a0913f5e474 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:58.206494 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce11e44-0973-43a9-a74f-7a0913f5e474 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:58.208303 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce11e44-0973-43a9-a74f-7a0913f5e474 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:58.219564 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 98/204] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:49:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:49:58.225537 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce11e44-0973-43a9-a74f-7a0913f5e474 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:58.235299 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce11e44-0973-43a9-a74f-7a0913f5e474 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:58.240136 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638aba7-fb48-42ac-bc17-7ac6e440a450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:58.241014 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638aba7-fb48-42ac-bc17-7ac6e440a450 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:58.241296 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638aba7-fb48-42ac-bc17-7ac6e440a450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:58.241571 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638aba7-fb48-42ac-bc17-7ac6e440a450 admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:58.242994 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638aba7-fb48-42ac-bc17-7ac6e440a450 admin admin] RBAC: Authorizing `identity:get_project(project_id=83908d6e37ad41e2882ed8f20923b274)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:58.245645 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638aba7-fb48-42ac-bc17-7ac6e440a450 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:58.247720 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 99/205] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:49:58 2022] GET /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:49:58.254926 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638aba7-fb48-42ac-bc17-7ac6e440a450 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:49:58.264572 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 107/206] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Feb 16 16:49:58 2022] POST /identity/v3/users => generated 297 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:49:58.269410 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638aba7-fb48-42ac-bc17-7ac6e440a450 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:49:58.274095 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68303651-2a03-43e8-a22a-419bdb863aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:49:58.276293 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68303651-2a03-43e8-a22a-419bdb863aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:49:58.276582 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68303651-2a03-43e8-a22a-419bdb863aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:49:58.276855 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68303651-2a03-43e8-a22a-419bdb863aa7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:49:58.277757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68303651-2a03-43e8-a22a-419bdb863aa7 admin admin] RBAC: Adding query filter params (role.id=cf30e55f556b4e0cbee0317b16316b0f, scope.project.id=83908d6e37ad41e2882ed8f20923b274, user.id=87af6af2b8004988ab13ddf21cb9801e) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:49:58.278043 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68303651-2a03-43e8-a22a-419bdb863aa7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:49:58.280037 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68303651-2a03-43e8-a22a-419bdb863aa7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:49:58.287319 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 100/207] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:49:58 2022] GET /identity/v3/role_assignments?user.id=87af6af2b8004988ab13ddf21cb9801e&scope.project.id=83908d6e37ad41e2882ed8f20923b274&role.id=cf30e55f556b4e0cbee0317b16316b0f => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:00.505880 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c1e92-4f88-4fa5-8281-690fb29707ed None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:00.506592 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c1e92-4f88-4fa5-8281-690fb29707ed None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:00.506592 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c1e92-4f88-4fa5-8281-690fb29707ed None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:00.508427 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 108/208] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:00.514379 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c470c6-332d-4e02-a127-035ecb4f1959 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:00.514939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c470c6-332d-4e02-a127-035ecb4f1959 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:00.514939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c470c6-332d-4e02-a127-035ecb4f1959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:00.533958 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-63c470c6-332d-4e02-a127-035ecb4f1959 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:00.535259 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-63c470c6-332d-4e02-a127-035ecb4f1959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:00.544145 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 101/209] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:00.567047 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c1e92-4f88-4fa5-8281-690fb29707ed None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:00.582829 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c1e92-4f88-4fa5-8281-690fb29707ed None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:00.587867 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489da336-5a7e-4bf2-bcf5-10b9ce65fdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:00.588651 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489da336-5a7e-4bf2-bcf5-10b9ce65fdfe admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:00.588929 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489da336-5a7e-4bf2-bcf5-10b9ce65fdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:00.589198 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489da336-5a7e-4bf2-bcf5-10b9ce65fdfe admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:00.599676 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489da336-5a7e-4bf2-bcf5-10b9ce65fdfe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:00.607813 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-489da336-5a7e-4bf2-bcf5-10b9ce65fdfe admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:50:00.609009 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 109/210] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:50:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:00.614693 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c470c6-332d-4e02-a127-035ecb4f1959 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:00.624322 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c470c6-332d-4e02-a127-035ecb4f1959 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:00.628771 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67316e4-fedd-4d8b-833f-a3ba0d104827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:00.629434 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67316e4-fedd-4d8b-833f-a3ba0d104827 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:00.629713 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67316e4-fedd-4d8b-833f-a3ba0d104827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:00.629986 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67316e4-fedd-4d8b-833f-a3ba0d104827 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:00.630775 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67316e4-fedd-4d8b-833f-a3ba0d104827 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:00.631080 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67316e4-fedd-4d8b-833f-a3ba0d104827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:00.632658 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67316e4-fedd-4d8b-833f-a3ba0d104827 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:00.642603 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 102/211] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:00.647949 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489da336-5a7e-4bf2-bcf5-10b9ce65fdfe admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:00.659537 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489da336-5a7e-4bf2-bcf5-10b9ce65fdfe admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:00.663947 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f570023-7373-439d-a06f-4a2074e24b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:00.664792 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f570023-7373-439d-a06f-4a2074e24b64 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:00.665099 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f570023-7373-439d-a06f-4a2074e24b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:00.665922 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f570023-7373-439d-a06f-4a2074e24b64 admin admin] PATH_INFO: `/v3/users/87af6af2b8004988ab13ddf21cb9801e` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:00.667168 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f570023-7373-439d-a06f-4a2074e24b64 admin admin] RBAC: Authorizing `identity:get_user(user_id=87af6af2b8004988ab13ddf21cb9801e)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:00.669276 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f570023-7373-439d-a06f-4a2074e24b64 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:00.670901 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 110/212] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:50:00 2022] GET /identity/v3/users/87af6af2b8004988ab13ddf21cb9801e => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:00.676399 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67316e4-fedd-4d8b-833f-a3ba0d104827 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:00.686906 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67316e4-fedd-4d8b-833f-a3ba0d104827 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:00.691312 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055eec6-d805-4ab8-9c06-cd97a5c3141a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:00.692159 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055eec6-d805-4ab8-9c06-cd97a5c3141a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:00.692438 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055eec6-d805-4ab8-9c06-cd97a5c3141a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:00.692711 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055eec6-d805-4ab8-9c06-cd97a5c3141a admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:00.693891 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055eec6-d805-4ab8-9c06-cd97a5c3141a admin admin] RBAC: Authorizing `identity:get_project(project_id=83908d6e37ad41e2882ed8f20923b274)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:00.699094 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055eec6-d805-4ab8-9c06-cd97a5c3141a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:00.699221 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b780b-a174-4eff-b45c-beb8a6aa7932 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:00.699221 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b780b-a174-4eff-b45c-beb8a6aa7932 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:00.699221 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b780b-a174-4eff-b45c-beb8a6aa7932 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:00.699402 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 103/213] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:00 2022] GET /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:00.700894 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 111/214] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:50:00.704439 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055eec6-d805-4ab8-9c06-cd97a5c3141a admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:00.706757 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb90b97-77a5-47b4-9cdb-d4b943d5af86 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:00.707266 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb90b97-77a5-47b4-9cdb-d4b943d5af86 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:00.707735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb90b97-77a5-47b4-9cdb-d4b943d5af86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:00.715343 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055eec6-d805-4ab8-9c06-cd97a5c3141a admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:00.720411 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408862c-2800-4803-bab0-cf85fa6478de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:00.721284 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408862c-2800-4803-bab0-cf85fa6478de admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:00.721562 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408862c-2800-4803-bab0-cf85fa6478de admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:00.721835 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408862c-2800-4803-bab0-cf85fa6478de admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274/users/87af6af2b8004988ab13ddf21cb9801e/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:00.723940 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408862c-2800-4803-bab0-cf85fa6478de admin admin] RBAC: Authorizing `identity:create_grant(project_id=83908d6e37ad41e2882ed8f20923b274, user_id=87af6af2b8004988ab13ddf21cb9801e, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:00.726596 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408862c-2800-4803-bab0-cf85fa6478de admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:00.730011 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-0eb90b97-77a5-47b4-9cdb-d4b943d5af86 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:00.732234 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0eb90b97-77a5-47b4-9cdb-d4b943d5af86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:00.739960 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 112/215] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:50:00.763272 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb90b97-77a5-47b4-9cdb-d4b943d5af86 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:00.772693 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb90b97-77a5-47b4-9cdb-d4b943d5af86 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:00.778664 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d64fb-3f57-4e65-a044-f610536e2de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:00.779480 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d64fb-3f57-4e65-a044-f610536e2de4 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:00.779759 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d64fb-3f57-4e65-a044-f610536e2de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:00.780028 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d64fb-3f57-4e65-a044-f610536e2de4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:00.791477 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d64fb-3f57-4e65-a044-f610536e2de4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:00.798845 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-688d64fb-3f57-4e65-a044-f610536e2de4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 16:50:00.799565 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 104/216] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:50:00 2022] PUT /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274/users/87af6af2b8004988ab13ddf21cb9801e/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 16:50:00.800995 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657e3a6-3a2e-4db2-b303-3c198cc82f2c None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:00.801340 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 113/217] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:50:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:00.802670 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2910602-bf45-4cc1-a8c3-2ffd4bd9c0cd None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:00.802957 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2910602-bf45-4cc1-a8c3-2ffd4bd9c0cd None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:00.803256 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2910602-bf45-4cc1-a8c3-2ffd4bd9c0cd None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:00.809409 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 114/218] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:00.809635 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657e3a6-3a2e-4db2-b303-3c198cc82f2c None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:00.809635 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657e3a6-3a2e-4db2-b303-3c198cc82f2c None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:00.809797 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2910602-bf45-4cc1-a8c3-2ffd4bd9c0cd None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:00.809903 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 105/219] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:00.812856 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bf1e4-819d-455c-9c6c-15622d569a7d None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:00.813168 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bf1e4-819d-455c-9c6c-15622d569a7d None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:00.813421 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bf1e4-819d-455c-9c6c-15622d569a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:00.834271 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-9c9bf1e4-819d-455c-9c6c-15622d569a7d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:00.835529 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-9c9bf1e4-819d-455c-9c6c-15622d569a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:00.880296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2910602-bf45-4cc1-a8c3-2ffd4bd9c0cd None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:00.886792 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836186a-63ca-4f2c-85d8-f3d0f76dd786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:00.887653 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836186a-63ca-4f2c-85d8-f3d0f76dd786 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:00.887940 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836186a-63ca-4f2c-85d8-f3d0f76dd786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:00.888212 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836186a-63ca-4f2c-85d8-f3d0f76dd786 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:00.888970 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836186a-63ca-4f2c-85d8-f3d0f76dd786 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:00.889276 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836186a-63ca-4f2c-85d8-f3d0f76dd786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:00.890950 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836186a-63ca-4f2c-85d8-f3d0f76dd786 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:00.900503 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 115/220] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:00.902022 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fe06c-fa53-496b-acaa-1a3567ff50f6 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:00.902475 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fe06c-fa53-496b-acaa-1a3567ff50f6 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:00.902681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fe06c-fa53-496b-acaa-1a3567ff50f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:00.913379 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 106/221] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:00.914522 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bf1e4-819d-455c-9c6c-15622d569a7d None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:00.926073 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bf1e4-819d-455c-9c6c-15622d569a7d None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:00.927033 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-8c6fe06c-fa53-496b-acaa-1a3567ff50f6 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:00.928677 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8c6fe06c-fa53-496b-acaa-1a3567ff50f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:00.931622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763cc87-1617-49a5-98b7-4457faad5845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:00.932983 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763cc87-1617-49a5-98b7-4457faad5845 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:00.933535 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763cc87-1617-49a5-98b7-4457faad5845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:00.934034 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763cc87-1617-49a5-98b7-4457faad5845 admin admin] PATH_INFO: `/v3/users/87af6af2b8004988ab13ddf21cb9801e` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:00.935562 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763cc87-1617-49a5-98b7-4457faad5845 admin admin] RBAC: Authorizing `identity:get_user(user_id=87af6af2b8004988ab13ddf21cb9801e)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:00.938722 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 116/222] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:00.939352 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fe06c-fa53-496b-acaa-1a3567ff50f6 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:00.947010 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763cc87-1617-49a5-98b7-4457faad5845 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:00.949714 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 107/223] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:50:00 2022] GET /identity/v3/users/87af6af2b8004988ab13ddf21cb9801e => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:00.953773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fe06c-fa53-496b-acaa-1a3567ff50f6 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:00.955908 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763cc87-1617-49a5-98b7-4457faad5845 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:00.959080 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0571533-0d6f-47c8-9429-9d110de5308a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:00.959955 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0571533-0d6f-47c8-9429-9d110de5308a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:00.960240 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0571533-0d6f-47c8-9429-9d110de5308a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:00.960518 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0571533-0d6f-47c8-9429-9d110de5308a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:00.969375 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763cc87-1617-49a5-98b7-4457faad5845 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:00.973184 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0571533-0d6f-47c8-9429-9d110de5308a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:00.975086 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bd5cf-036d-4204-96e4-8a56fe0e4a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:00.976281 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bd5cf-036d-4204-96e4-8a56fe0e4a53 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:00.976713 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bd5cf-036d-4204-96e4-8a56fe0e4a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:00.977181 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bd5cf-036d-4204-96e4-8a56fe0e4a53 admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:00.979223 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bd5cf-036d-4204-96e4-8a56fe0e4a53 admin admin] RBAC: Authorizing `identity:get_project(project_id=83908d6e37ad41e2882ed8f20923b274)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:00.980975 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-f0571533-0d6f-47c8-9429-9d110de5308a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 16:50:00.982207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bd5cf-036d-4204-96e4-8a56fe0e4a53 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:00.982467 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 117/224] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:00.986988 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0571533-0d6f-47c8-9429-9d110de5308a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:00.987076 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 108/225] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:00 2022] GET /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:00.991944 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bd5cf-036d-4204-96e4-8a56fe0e4a53 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:00.998883 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0571533-0d6f-47c8-9429-9d110de5308a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:01.003233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bd5cf-036d-4204-96e4-8a56fe0e4a53 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:01.004770 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec535b-defe-4e40-8aeb-3c901c3b54e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:01.005553 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec535b-defe-4e40-8aeb-3c901c3b54e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:01.005832 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec535b-defe-4e40-8aeb-3c901c3b54e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:01.006103 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec535b-defe-4e40-8aeb-3c901c3b54e6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:01.007279 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec535b-defe-4e40-8aeb-3c901c3b54e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:01.009225 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec535b-defe-4e40-8aeb-3c901c3b54e6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:01.009334 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db400e-33c9-47e2-936f-9e62db3199e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:01.010158 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db400e-33c9-47e2-936f-9e62db3199e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:01.010441 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db400e-33c9-47e2-936f-9e62db3199e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:01.010746 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db400e-33c9-47e2-936f-9e62db3199e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:01.011210 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 118/226] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:01.011601 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db400e-33c9-47e2-936f-9e62db3199e2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:01.011710 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec535b-defe-4e40-8aeb-3c901c3b54e6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:01.011914 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db400e-33c9-47e2-936f-9e62db3199e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:01.013626 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db400e-33c9-47e2-936f-9e62db3199e2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:01.023757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 109/227] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:50:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:01.025083 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db400e-33c9-47e2-936f-9e62db3199e2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:01.026016 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec535b-defe-4e40-8aeb-3c901c3b54e6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:01.032311 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f60b21-27d2-4c31-b6e5-c5887dc3bc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:01.033189 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f60b21-27d2-4c31-b6e5-c5887dc3bc4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:01.033463 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f60b21-27d2-4c31-b6e5-c5887dc3bc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:01.033732 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f60b21-27d2-4c31-b6e5-c5887dc3bc4a admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274/users/87af6af2b8004988ab13ddf21cb9801e/roles/cf30e55f556b4e0cbee0317b16316b0f` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:01.035911 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f60b21-27d2-4c31-b6e5-c5887dc3bc4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=83908d6e37ad41e2882ed8f20923b274, user_id=87af6af2b8004988ab13ddf21cb9801e, role_id=cf30e55f556b4e0cbee0317b16316b0f)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:01.038526 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f60b21-27d2-4c31-b6e5-c5887dc3bc4a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:01.040504 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db400e-33c9-47e2-936f-9e62db3199e2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:01.045842 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1369f-8e03-4a71-85a8-360663217d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:01.046498 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1369f-8e03-4a71-85a8-360663217d60 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:01.046824 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1369f-8e03-4a71-85a8-360663217d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:01.056134 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1369f-8e03-4a71-85a8-360663217d60 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:01.056134 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1369f-8e03-4a71-85a8-360663217d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:01.056134 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1369f-8e03-4a71-85a8-360663217d60 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:01.109095 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 119/228] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:50:01 2022] PUT /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274/users/87af6af2b8004988ab13ddf21cb9801e/roles/cf30e55f556b4e0cbee0317b16316b0f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:50:01.109912 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f60b21-27d2-4c31-b6e5-c5887dc3bc4a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:01.139585 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 110/229] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Feb 16 16:50:01 2022] POST /identity/v3/users => generated 297 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:50:01.193858 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f60b21-27d2-4c31-b6e5-c5887dc3bc4a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:01.199360 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2c3e7-f0ca-4e6b-9d59-fed776c314d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:01.200321 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2c3e7-f0ca-4e6b-9d59-fed776c314d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:01.200599 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2c3e7-f0ca-4e6b-9d59-fed776c314d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:01.200920 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2c3e7-f0ca-4e6b-9d59-fed776c314d9 admin admin] PATH_INFO: `/v3/users/5edf1d55d1604d9bbd562adbe5464216` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:01.217154 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2c3e7-f0ca-4e6b-9d59-fed776c314d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=5edf1d55d1604d9bbd562adbe5464216)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:01.219401 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2c3e7-f0ca-4e6b-9d59-fed776c314d9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:01.221546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 120/230] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:50:01 2022] GET /identity/v3/users/5edf1d55d1604d9bbd562adbe5464216 => generated 297 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:01.227223 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1369f-8e03-4a71-85a8-360663217d60 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:01.238631 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1369f-8e03-4a71-85a8-360663217d60 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:01.244094 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a8154-2a52-4608-98a2-ca3ccc170388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:01.245017 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a8154-2a52-4608-98a2-ca3ccc170388 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:01.245297 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a8154-2a52-4608-98a2-ca3ccc170388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:01.245547 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a8154-2a52-4608-98a2-ca3ccc170388 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:01.255151 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a8154-2a52-4608-98a2-ca3ccc170388 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:01.257054 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a8154-2a52-4608-98a2-ca3ccc170388 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:01.268155 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 111/231] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:01.274149 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2c3e7-f0ca-4e6b-9d59-fed776c314d9 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:01.288740 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2c3e7-f0ca-4e6b-9d59-fed776c314d9 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:01.293998 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34ac80-f15e-48eb-9e43-252544c8e411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:01.294919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34ac80-f15e-48eb-9e43-252544c8e411 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:01.295202 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34ac80-f15e-48eb-9e43-252544c8e411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:01.295474 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34ac80-f15e-48eb-9e43-252544c8e411 admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:01.296806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34ac80-f15e-48eb-9e43-252544c8e411 admin admin] RBAC: Authorizing `identity:get_project(project_id=83908d6e37ad41e2882ed8f20923b274)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:01.299047 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34ac80-f15e-48eb-9e43-252544c8e411 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:01.301042 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 121/232] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:01 2022] GET /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:01.307700 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a8154-2a52-4608-98a2-ca3ccc170388 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:01.317772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a8154-2a52-4608-98a2-ca3ccc170388 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:01.324126 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab07107-9723-4ffc-a2fe-fc40778afc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:01.324849 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab07107-9723-4ffc-a2fe-fc40778afc0d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:01.325127 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab07107-9723-4ffc-a2fe-fc40778afc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:01.325399 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab07107-9723-4ffc-a2fe-fc40778afc0d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:01.326311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab07107-9723-4ffc-a2fe-fc40778afc0d admin admin] RBAC: Adding query filter params (role.id=d361c0606e4646d3afa601176d0422ec, scope.project.id=83908d6e37ad41e2882ed8f20923b274, user.id=5edf1d55d1604d9bbd562adbe5464216) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:01.326628 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab07107-9723-4ffc-a2fe-fc40778afc0d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:01.328650 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab07107-9723-4ffc-a2fe-fc40778afc0d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:01.335236 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 112/233] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:01 2022] GET /identity/v3/role_assignments?user.id=5edf1d55d1604d9bbd562adbe5464216&scope.project.id=83908d6e37ad41e2882ed8f20923b274&role.id=d361c0606e4646d3afa601176d0422ec => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:03.466525 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55806f07-5916-4ef7-8c89-4342016bdce7 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:03.467068 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55806f07-5916-4ef7-8c89-4342016bdce7 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:03.467140 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55806f07-5916-4ef7-8c89-4342016bdce7 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:03.468887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 122/234] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:03.474489 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb020696-cdcf-4580-9883-5355c61b75d5 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:03.474919 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb020696-cdcf-4580-9883-5355c61b75d5 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:03.475128 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb020696-cdcf-4580-9883-5355c61b75d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:03.497124 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-bb020696-cdcf-4580-9883-5355c61b75d5 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:03.498314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-bb020696-cdcf-4580-9883-5355c61b75d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:03.510259 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 113/235] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:03.552069 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55806f07-5916-4ef7-8c89-4342016bdce7 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:03.568450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55806f07-5916-4ef7-8c89-4342016bdce7 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:03.584008 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97928034-a750-4c21-95db-eb1565689258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:03.584813 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97928034-a750-4c21-95db-eb1565689258 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:03.585090 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97928034-a750-4c21-95db-eb1565689258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:03.585361 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97928034-a750-4c21-95db-eb1565689258 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:03.600696 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97928034-a750-4c21-95db-eb1565689258 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:03.608315 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-97928034-a750-4c21-95db-eb1565689258 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:50:03.609691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 123/236] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:50:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:03.615403 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb020696-cdcf-4580-9883-5355c61b75d5 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:03.624899 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb020696-cdcf-4580-9883-5355c61b75d5 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:03.635287 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73083bf-dac0-4644-a98a-7d5dd76f07dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:03.635954 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73083bf-dac0-4644-a98a-7d5dd76f07dd admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:03.636234 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73083bf-dac0-4644-a98a-7d5dd76f07dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:03.636507 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73083bf-dac0-4644-a98a-7d5dd76f07dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:03.637258 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73083bf-dac0-4644-a98a-7d5dd76f07dd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:03.637677 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73083bf-dac0-4644-a98a-7d5dd76f07dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:03.639293 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73083bf-dac0-4644-a98a-7d5dd76f07dd admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:03.648202 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 114/237] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:03.653992 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97928034-a750-4c21-95db-eb1565689258 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:03.668450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97928034-a750-4c21-95db-eb1565689258 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:03.679290 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b96bb7-129a-4234-8c9c-93d4867afc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:03.680191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b96bb7-129a-4234-8c9c-93d4867afc87 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:03.680542 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b96bb7-129a-4234-8c9c-93d4867afc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:03.681376 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b96bb7-129a-4234-8c9c-93d4867afc87 admin admin] PATH_INFO: `/v3/users/87af6af2b8004988ab13ddf21cb9801e` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:03.687702 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b96bb7-129a-4234-8c9c-93d4867afc87 admin admin] RBAC: Authorizing `identity:get_user(user_id=87af6af2b8004988ab13ddf21cb9801e)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:03.689967 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b96bb7-129a-4234-8c9c-93d4867afc87 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:03.692153 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 124/238] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:50:03 2022] GET /identity/v3/users/87af6af2b8004988ab13ddf21cb9801e => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:03.697804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73083bf-dac0-4644-a98a-7d5dd76f07dd admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:03.710889 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73083bf-dac0-4644-a98a-7d5dd76f07dd admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:03.725222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692fef8-3549-4052-9726-a020a415696d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:03.725882 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692fef8-3549-4052-9726-a020a415696d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:03.726163 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692fef8-3549-4052-9726-a020a415696d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:03.726481 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692fef8-3549-4052-9726-a020a415696d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:03.737044 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692fef8-3549-4052-9726-a020a415696d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:03.741996 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692fef8-3549-4052-9726-a020a415696d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:03.749607 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 115/239] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:03.755211 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b96bb7-129a-4234-8c9c-93d4867afc87 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:03.771910 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b96bb7-129a-4234-8c9c-93d4867afc87 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:03.783297 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8afff-85d1-4394-a1b7-933db00733ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:03.784175 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8afff-85d1-4394-a1b7-933db00733ef admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:03.784454 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8afff-85d1-4394-a1b7-933db00733ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:03.784728 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8afff-85d1-4394-a1b7-933db00733ef admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:03.785970 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8afff-85d1-4394-a1b7-933db00733ef admin admin] RBAC: Authorizing `identity:get_project(project_id=83908d6e37ad41e2882ed8f20923b274)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:03.788114 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8afff-85d1-4394-a1b7-933db00733ef admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:03.789919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 125/240] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:03 2022] GET /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:03.796342 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692fef8-3549-4052-9726-a020a415696d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:03.811000 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692fef8-3549-4052-9726-a020a415696d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:03.815642 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90492db6-0ce2-4df0-8971-2ce18ac1d677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:03.816331 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90492db6-0ce2-4df0-8971-2ce18ac1d677 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:03.816609 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90492db6-0ce2-4df0-8971-2ce18ac1d677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:03.816884 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90492db6-0ce2-4df0-8971-2ce18ac1d677 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:03.817717 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90492db6-0ce2-4df0-8971-2ce18ac1d677 admin admin] RBAC: Adding query filter params (role.id=8263a29ceeed4576b3b6959c99964ed7, scope.project.id=83908d6e37ad41e2882ed8f20923b274, user.id=87af6af2b8004988ab13ddf21cb9801e) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:03.818023 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90492db6-0ce2-4df0-8971-2ce18ac1d677 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:03.819951 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90492db6-0ce2-4df0-8971-2ce18ac1d677 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:03.830064 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ac595-0e35-45ad-8a18-823cb3659a6d None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:03.830355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ac595-0e35-45ad-8a18-823cb3659a6d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:03.830617 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ac595-0e35-45ad-8a18-823cb3659a6d None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:03.832428 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 126/241] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:03.832781 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 116/242] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:03 2022] GET /identity/v3/role_assignments?user.id=87af6af2b8004988ab13ddf21cb9801e&scope.project.id=83908d6e37ad41e2882ed8f20923b274&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:03.838975 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28921f52-e61a-4872-90bb-19994c4385ba None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:03.839348 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28921f52-e61a-4872-90bb-19994c4385ba None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:03.839691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28921f52-e61a-4872-90bb-19994c4385ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:03.879956 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-28921f52-e61a-4872-90bb-19994c4385ba None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:03.881195 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-28921f52-e61a-4872-90bb-19994c4385ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:03.894492 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 127/243] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:03.926855 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90492db6-0ce2-4df0-8971-2ce18ac1d677 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:03.938704 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90492db6-0ce2-4df0-8971-2ce18ac1d677 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:03.950846 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a44bb9-8d5d-4be9-9bdb-b4d3605d0800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:03.951672 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a44bb9-8d5d-4be9-9bdb-b4d3605d0800 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:03.952041 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a44bb9-8d5d-4be9-9bdb-b4d3605d0800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:03.952316 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a44bb9-8d5d-4be9-9bdb-b4d3605d0800 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:03.971554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a44bb9-8d5d-4be9-9bdb-b4d3605d0800 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:03.979706 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-32a44bb9-8d5d-4be9-9bdb-b4d3605d0800 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 16:50:03.981314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 117/244] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:50:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:03.987645 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28921f52-e61a-4872-90bb-19994c4385ba None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:04.000097 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28921f52-e61a-4872-90bb-19994c4385ba None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:04.008655 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0190fe8-ce20-4f1a-8845-906d52d4e254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:04.010222 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0190fe8-ce20-4f1a-8845-906d52d4e254 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.010734 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0190fe8-ce20-4f1a-8845-906d52d4e254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.011159 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0190fe8-ce20-4f1a-8845-906d52d4e254 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.011949 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0190fe8-ce20-4f1a-8845-906d52d4e254 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:04.012265 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0190fe8-ce20-4f1a-8845-906d52d4e254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:04.013901 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0190fe8-ce20-4f1a-8845-906d52d4e254 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:04.026546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 128/245] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:04.031592 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a44bb9-8d5d-4be9-9bdb-b4d3605d0800 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:04.047801 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a44bb9-8d5d-4be9-9bdb-b4d3605d0800 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:04.053322 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2ccb5-f92f-442e-8e94-7558317e5b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:04.054414 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2ccb5-f92f-442e-8e94-7558317e5b63 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.054923 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2ccb5-f92f-442e-8e94-7558317e5b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.055389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2ccb5-f92f-442e-8e94-7558317e5b63 admin admin] PATH_INFO: `/v3/users/87af6af2b8004988ab13ddf21cb9801e` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.057510 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2ccb5-f92f-442e-8e94-7558317e5b63 admin admin] RBAC: Authorizing `identity:get_user(user_id=87af6af2b8004988ab13ddf21cb9801e)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:04.059862 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2ccb5-f92f-442e-8e94-7558317e5b63 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:04.061707 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 118/246] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:50:04 2022] GET /identity/v3/users/87af6af2b8004988ab13ddf21cb9801e => generated 283 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:04.067415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0190fe8-ce20-4f1a-8845-906d52d4e254 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:04.079570 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0190fe8-ce20-4f1a-8845-906d52d4e254 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:04.085119 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b6b64-6e3a-4fd6-98eb-635d12acda63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:04.085815 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b6b64-6e3a-4fd6-98eb-635d12acda63 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.086095 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b6b64-6e3a-4fd6-98eb-635d12acda63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.086370 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b6b64-6e3a-4fd6-98eb-635d12acda63 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.095774 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b6b64-6e3a-4fd6-98eb-635d12acda63 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:04.097602 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b6b64-6e3a-4fd6-98eb-635d12acda63 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:04.108008 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 129/247] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:04.113811 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2ccb5-f92f-442e-8e94-7558317e5b63 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:04.115518 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5bf0a-1bf8-4d46-91db-8e0035a43f20 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.115806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5bf0a-1bf8-4d46-91db-8e0035a43f20 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.116083 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5bf0a-1bf8-4d46-91db-8e0035a43f20 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.117838 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 130/248] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:04.125602 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2ccb5-f92f-442e-8e94-7558317e5b63 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:04.126455 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5fd46-c60f-48cd-882b-b027d824c84e None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.126915 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5fd46-c60f-48cd-882b-b027d824c84e None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.127429 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5fd46-c60f-48cd-882b-b027d824c84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.130483 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a4d8f-e09a-4ab8-8e0d-58d0bb7d530d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:04.131397 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a4d8f-e09a-4ab8-8e0d-58d0bb7d530d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.131677 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a4d8f-e09a-4ab8-8e0d-58d0bb7d530d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.132009 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a4d8f-e09a-4ab8-8e0d-58d0bb7d530d admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.133269 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a4d8f-e09a-4ab8-8e0d-58d0bb7d530d admin admin] RBAC: Authorizing `identity:get_project(project_id=83908d6e37ad41e2882ed8f20923b274)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:04.136071 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a4d8f-e09a-4ab8-8e0d-58d0bb7d530d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:04.142474 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 119/249] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:04 2022] GET /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:04.150610 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a4d8f-e09a-4ab8-8e0d-58d0bb7d530d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:04.152169 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-a1e5fd46-c60f-48cd-882b-b027d824c84e None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:04.153630 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a1e5fd46-c60f-48cd-882b-b027d824c84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:04.161018 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a4d8f-e09a-4ab8-8e0d-58d0bb7d530d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:04.163866 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 131/250] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:50:04.169347 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74c350-272a-4896-9adc-c5f127e02849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:04.170356 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74c350-272a-4896-9adc-c5f127e02849 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.170956 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74c350-272a-4896-9adc-c5f127e02849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.171452 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74c350-272a-4896-9adc-c5f127e02849 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.172588 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74c350-272a-4896-9adc-c5f127e02849 admin admin] RBAC: Adding query filter params (role.id=cf30e55f556b4e0cbee0317b16316b0f, scope.project.id=83908d6e37ad41e2882ed8f20923b274, user.id=87af6af2b8004988ab13ddf21cb9801e) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:04.173115 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74c350-272a-4896-9adc-c5f127e02849 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:04.175402 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74c350-272a-4896-9adc-c5f127e02849 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:04.182740 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 120/251] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:04 2022] GET /identity/v3/role_assignments?user.id=87af6af2b8004988ab13ddf21cb9801e&scope.project.id=83908d6e37ad41e2882ed8f20923b274&role.id=cf30e55f556b4e0cbee0317b16316b0f => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:04.204731 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5fd46-c60f-48cd-882b-b027d824c84e None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:04.217262 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5fd46-c60f-48cd-882b-b027d824c84e None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:04.226118 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ceae29-16d3-4f9e-9498-009dcd8241d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:04.227341 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceae29-16d3-4f9e-9498-009dcd8241d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.227804 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceae29-16d3-4f9e-9498-009dcd8241d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.228277 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceae29-16d3-4f9e-9498-009dcd8241d8 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.253768 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ceae29-16d3-4f9e-9498-009dcd8241d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:04.261850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-83ceae29-16d3-4f9e-9498-009dcd8241d8 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 16:50:04.263398 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 132/252] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:04.269816 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74c350-272a-4896-9adc-c5f127e02849 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:04.281260 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74c350-272a-4896-9adc-c5f127e02849 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:04.290374 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a10953-4daa-4087-8882-afc51abd3629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:04.291687 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a10953-4daa-4087-8882-afc51abd3629 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.292135 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a10953-4daa-4087-8882-afc51abd3629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.292608 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a10953-4daa-4087-8882-afc51abd3629 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.294073 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a10953-4daa-4087-8882-afc51abd3629 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:04.294073 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a10953-4daa-4087-8882-afc51abd3629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:04.296019 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a10953-4daa-4087-8882-afc51abd3629 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:04.307802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 121/253] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:50:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:04.313766 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ceae29-16d3-4f9e-9498-009dcd8241d8 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:04.325746 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ceae29-16d3-4f9e-9498-009dcd8241d8 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:04.334810 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d969a-ce42-4002-b7b1-9151f8846921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:04.335911 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d969a-ce42-4002-b7b1-9151f8846921 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.336185 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfaf38-4d90-4f68-b5ef-3494dc0ec31c None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.336290 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d969a-ce42-4002-b7b1-9151f8846921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.336453 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d969a-ce42-4002-b7b1-9151f8846921 admin admin] PATH_INFO: `/v3/users/d275dfed3bca4c0f8bb618275eec40a6` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.336871 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfaf38-4d90-4f68-b5ef-3494dc0ec31c None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.337413 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfaf38-4d90-4f68-b5ef-3494dc0ec31c None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.339612 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 122/254] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:50:04.348461 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503d96f-d341-4759-a16c-70edb30816a0 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.348793 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503d96f-d341-4759-a16c-70edb30816a0 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.349091 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503d96f-d341-4759-a16c-70edb30816a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.367222 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d969a-ce42-4002-b7b1-9151f8846921 admin admin] RBAC: Authorizing `identity:get_user(user_id=d275dfed3bca4c0f8bb618275eec40a6)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:04.370318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d969a-ce42-4002-b7b1-9151f8846921 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:04.372332 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 133/255] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:50:04 2022] GET /identity/v3/users/d275dfed3bca4c0f8bb618275eec40a6 => generated 297 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:04.376653 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-3503d96f-d341-4759-a16c-70edb30816a0 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:04.377535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d969a-ce42-4002-b7b1-9151f8846921 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:04.378433 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-3503d96f-d341-4759-a16c-70edb30816a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:04.387576 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d969a-ce42-4002-b7b1-9151f8846921 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:04.389066 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 123/256] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:50:04.394559 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1be996-40f3-4541-9a69-b2308a644b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:04.395253 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1be996-40f3-4541-9a69-b2308a644b8c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.395540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1be996-40f3-4541-9a69-b2308a644b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.395837 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1be996-40f3-4541-9a69-b2308a644b8c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.406530 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1be996-40f3-4541-9a69-b2308a644b8c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:04.408360 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1be996-40f3-4541-9a69-b2308a644b8c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:04.412801 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503d96f-d341-4759-a16c-70edb30816a0 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:04.418766 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 134/257] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:04.423020 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503d96f-d341-4759-a16c-70edb30816a0 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:04.424733 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1be996-40f3-4541-9a69-b2308a644b8c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:04.428554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e9ec3-9be7-44e9-ba49-0a74385ff1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:04.429346 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e9ec3-9be7-44e9-ba49-0a74385ff1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.429625 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e9ec3-9be7-44e9-ba49-0a74385ff1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.429898 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e9ec3-9be7-44e9-ba49-0a74385ff1d8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.434458 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1be996-40f3-4541-9a69-b2308a644b8c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:04.439400 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b6a3b-f56f-4e55-bd49-6eaf47105016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:04.440984 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b6a3b-f56f-4e55-bd49-6eaf47105016 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.441270 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b6a3b-f56f-4e55-bd49-6eaf47105016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.441545 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b6a3b-f56f-4e55-bd49-6eaf47105016 admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.442777 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b6a3b-f56f-4e55-bd49-6eaf47105016 admin admin] RBAC: Authorizing `identity:get_project(project_id=83908d6e37ad41e2882ed8f20923b274)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:04.443533 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e9ec3-9be7-44e9-ba49-0a74385ff1d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:04.444891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b6a3b-f56f-4e55-bd49-6eaf47105016 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:04.447040 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 135/258] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:04 2022] GET /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:04.452465 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-d04e9ec3-9be7-44e9-ba49-0a74385ff1d8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 16:50:04.452688 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b6a3b-f56f-4e55-bd49-6eaf47105016 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:04.453809 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 124/259] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:04.459267 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e9ec3-9be7-44e9-ba49-0a74385ff1d8 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:04.463354 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b6a3b-f56f-4e55-bd49-6eaf47105016 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:04.468550 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471cf6d-8a7e-49d8-962c-224cca1605e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:04.469551 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e9ec3-9be7-44e9-ba49-0a74385ff1d8 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:04.470193 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471cf6d-8a7e-49d8-962c-224cca1605e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.470781 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471cf6d-8a7e-49d8-962c-224cca1605e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.471202 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471cf6d-8a7e-49d8-962c-224cca1605e8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.472223 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471cf6d-8a7e-49d8-962c-224cca1605e8 admin admin] RBAC: Adding query filter params (role.id=573b191bb7f843fa9bc910a1f859c370, scope.project.id=83908d6e37ad41e2882ed8f20923b274, user.id=d275dfed3bca4c0f8bb618275eec40a6) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:04.472750 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471cf6d-8a7e-49d8-962c-224cca1605e8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:04.474015 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce53a0-1335-4160-96ad-97cd183b3122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:04.474704 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce53a0-1335-4160-96ad-97cd183b3122 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.475194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471cf6d-8a7e-49d8-962c-224cca1605e8 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:04.475267 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce53a0-1335-4160-96ad-97cd183b3122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.475267 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce53a0-1335-4160-96ad-97cd183b3122 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.475985 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce53a0-1335-4160-96ad-97cd183b3122 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:04.476292 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce53a0-1335-4160-96ad-97cd183b3122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:04.478736 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce53a0-1335-4160-96ad-97cd183b3122 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:04.482270 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 136/260] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:04 2022] GET /identity/v3/role_assignments?user.id=d275dfed3bca4c0f8bb618275eec40a6&scope.project.id=83908d6e37ad41e2882ed8f20923b274&role.id=573b191bb7f843fa9bc910a1f859c370 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:04.488775 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 125/261] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:50:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:04.495607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471cf6d-8a7e-49d8-962c-224cca1605e8 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:04.507341 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471cf6d-8a7e-49d8-962c-224cca1605e8 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:04.512810 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758c364-4a23-429b-bfc5-3b08f346440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:04.513800 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758c364-4a23-429b-bfc5-3b08f346440f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.514081 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758c364-4a23-429b-bfc5-3b08f346440f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.514356 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758c364-4a23-429b-bfc5-3b08f346440f admin admin] PATH_INFO: `/v3/users/5edf1d55d1604d9bbd562adbe5464216` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.515889 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758c364-4a23-429b-bfc5-3b08f346440f admin admin] RBAC: Authorizing `identity:get_user(user_id=5edf1d55d1604d9bbd562adbe5464216)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:04.518120 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758c364-4a23-429b-bfc5-3b08f346440f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:04.520374 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 137/262] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:50:04 2022] GET /identity/v3/users/5edf1d55d1604d9bbd562adbe5464216 => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:04.526345 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce53a0-1335-4160-96ad-97cd183b3122 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:04.537387 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce53a0-1335-4160-96ad-97cd183b3122 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:04.543134 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaca426-be8f-4a03-b4e2-c50199ed5fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:04.544160 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaca426-be8f-4a03-b4e2-c50199ed5fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.544507 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaca426-be8f-4a03-b4e2-c50199ed5fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.544889 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaca426-be8f-4a03-b4e2-c50199ed5fa8 admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.546335 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaca426-be8f-4a03-b4e2-c50199ed5fa8 admin admin] RBAC: Authorizing `identity:get_project(project_id=83908d6e37ad41e2882ed8f20923b274)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:04.548740 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaca426-be8f-4a03-b4e2-c50199ed5fa8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:04.551041 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 126/263] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:04 2022] GET /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:04.556987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019037d-6184-4051-9ce7-af46eabee476 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.557272 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaca426-be8f-4a03-b4e2-c50199ed5fa8 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:04.557371 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019037d-6184-4051-9ce7-af46eabee476 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.557618 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019037d-6184-4051-9ce7-af46eabee476 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.559499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 138/264] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:04.564833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86627c2-1e23-4203-bbce-03fa9675a2bb None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.565114 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86627c2-1e23-4203-bbce-03fa9675a2bb None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.565386 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86627c2-1e23-4203-bbce-03fa9675a2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.567927 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaca426-be8f-4a03-b4e2-c50199ed5fa8 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:04.573142 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031889d-69d2-47d5-b0e3-479ab0717b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:04.573922 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031889d-69d2-47d5-b0e3-479ab0717b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.574222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031889d-69d2-47d5-b0e3-479ab0717b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.574479 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031889d-69d2-47d5-b0e3-479ab0717b53 admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274/users/5edf1d55d1604d9bbd562adbe5464216/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.577661 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031889d-69d2-47d5-b0e3-479ab0717b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83908d6e37ad41e2882ed8f20923b274, user_id=5edf1d55d1604d9bbd562adbe5464216, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:04.579366 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031889d-69d2-47d5-b0e3-479ab0717b53 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:04.584805 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-d86627c2-1e23-4203-bbce-03fa9675a2bb None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:04.586030 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d86627c2-1e23-4203-bbce-03fa9675a2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:04.594517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 139/265] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:50:04.620728 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86627c2-1e23-4203-bbce-03fa9675a2bb None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:04.630097 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86627c2-1e23-4203-bbce-03fa9675a2bb None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:04.635086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5b5da-faf2-4e4d-bf2c-fdc61e1199a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:04.635902 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5b5da-faf2-4e4d-bf2c-fdc61e1199a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.636172 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5b5da-faf2-4e4d-bf2c-fdc61e1199a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.636442 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5b5da-faf2-4e4d-bf2c-fdc61e1199a7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.637666 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5b5da-faf2-4e4d-bf2c-fdc61e1199a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:04.639414 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5b5da-faf2-4e4d-bf2c-fdc61e1199a7 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:04.641051 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 140/266] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:04.646711 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5b5da-faf2-4e4d-bf2c-fdc61e1199a7 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:04.657351 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 127/267] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:50:04 2022] PUT /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274/users/5edf1d55d1604d9bbd562adbe5464216/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 16:50:04.657558 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5b5da-faf2-4e4d-bf2c-fdc61e1199a7 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:04.720118 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f084540-ff5c-4ecc-bd9f-007dc0f0924a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:04.720804 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f084540-ff5c-4ecc-bd9f-007dc0f0924a admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:04.721083 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f084540-ff5c-4ecc-bd9f-007dc0f0924a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:04.721358 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f084540-ff5c-4ecc-bd9f-007dc0f0924a admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:04.722080 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f084540-ff5c-4ecc-bd9f-007dc0f0924a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:04.724127 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f084540-ff5c-4ecc-bd9f-007dc0f0924a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:04.818725 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 141/268] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Feb 16 16:50:04 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 16:50:06.777620 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77714267-2760-487e-9039-2c518ed7a872 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:06.778223 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77714267-2760-487e-9039-2c518ed7a872 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:06.778223 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77714267-2760-487e-9039-2c518ed7a872 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:06.780211 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 128/269] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:06.785485 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a3de1-1ee2-4121-b520-3b865fb6a41a None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:06.785918 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a3de1-1ee2-4121-b520-3b865fb6a41a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:06.786091 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a3de1-1ee2-4121-b520-3b865fb6a41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:06.804198 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-af3a3de1-1ee2-4121-b520-3b865fb6a41a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:06.805444 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-af3a3de1-1ee2-4121-b520-3b865fb6a41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:06.813504 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 142/270] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:06.835756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77714267-2760-487e-9039-2c518ed7a872 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:06.848486 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77714267-2760-487e-9039-2c518ed7a872 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:06.852862 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c525d-8ff4-41b5-ae0d-baa8bdbd3fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:06.853623 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c525d-8ff4-41b5-ae0d-baa8bdbd3fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:06.853900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c525d-8ff4-41b5-ae0d-baa8bdbd3fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:06.854165 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c525d-8ff4-41b5-ae0d-baa8bdbd3fb6 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:06.864781 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c525d-8ff4-41b5-ae0d-baa8bdbd3fb6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:06.872345 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-856c525d-8ff4-41b5-ae0d-baa8bdbd3fb6 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 16:50:06.873850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 129/271] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:06.879507 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a3de1-1ee2-4121-b520-3b865fb6a41a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:06.889218 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a3de1-1ee2-4121-b520-3b865fb6a41a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:06.893859 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f451468-8381-4e61-96b4-bb107f40f354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:06.894532 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f451468-8381-4e61-96b4-bb107f40f354 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:06.894842 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f451468-8381-4e61-96b4-bb107f40f354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:06.895113 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f451468-8381-4e61-96b4-bb107f40f354 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:06.895871 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f451468-8381-4e61-96b4-bb107f40f354 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:06.896170 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f451468-8381-4e61-96b4-bb107f40f354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:06.897820 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f451468-8381-4e61-96b4-bb107f40f354 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:06.908577 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 143/272] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:50:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:06.914190 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c525d-8ff4-41b5-ae0d-baa8bdbd3fb6 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:06.925786 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c525d-8ff4-41b5-ae0d-baa8bdbd3fb6 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:06.931519 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a47ce-390b-42e1-a0b9-0c55a057e2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:06.932801 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a47ce-390b-42e1-a0b9-0c55a057e2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:06.933287 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a47ce-390b-42e1-a0b9-0c55a057e2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:06.933770 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a47ce-390b-42e1-a0b9-0c55a057e2b1 admin admin] PATH_INFO: `/v3/users/d275dfed3bca4c0f8bb618275eec40a6` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:06.935388 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a47ce-390b-42e1-a0b9-0c55a057e2b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=d275dfed3bca4c0f8bb618275eec40a6)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:06.937779 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a47ce-390b-42e1-a0b9-0c55a057e2b1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:06.940128 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 130/273] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:50:06 2022] GET /identity/v3/users/d275dfed3bca4c0f8bb618275eec40a6 => generated 297 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:06.945921 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f451468-8381-4e61-96b4-bb107f40f354 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:06.957037 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f451468-8381-4e61-96b4-bb107f40f354 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:06.961881 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181c00c-0625-4ae3-85dc-dc88fb74d7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:06.963000 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181c00c-0625-4ae3-85dc-dc88fb74d7ae admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:06.963476 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181c00c-0625-4ae3-85dc-dc88fb74d7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:06.963937 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181c00c-0625-4ae3-85dc-dc88fb74d7ae admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:06.965348 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181c00c-0625-4ae3-85dc-dc88fb74d7ae admin admin] RBAC: Authorizing `identity:get_project(project_id=83908d6e37ad41e2882ed8f20923b274)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:06.967612 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181c00c-0625-4ae3-85dc-dc88fb74d7ae admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:06.969782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 144/274] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:06 2022] GET /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:06.975559 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a47ce-390b-42e1-a0b9-0c55a057e2b1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:06.985971 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a47ce-390b-42e1-a0b9-0c55a057e2b1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:06.990748 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d77fe4-2ed7-4414-92e5-f04a3a3a1ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:06.991844 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d77fe4-2ed7-4414-92e5-f04a3a3a1ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:06.992327 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d77fe4-2ed7-4414-92e5-f04a3a3a1ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:06.992789 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d77fe4-2ed7-4414-92e5-f04a3a3a1ad8 admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274/users/d275dfed3bca4c0f8bb618275eec40a6/roles/573b191bb7f843fa9bc910a1f859c370` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:06.995644 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d77fe4-2ed7-4414-92e5-f04a3a3a1ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83908d6e37ad41e2882ed8f20923b274, user_id=d275dfed3bca4c0f8bb618275eec40a6, role_id=573b191bb7f843fa9bc910a1f859c370)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:06.998465 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d77fe4-2ed7-4414-92e5-f04a3a3a1ad8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:07.041765 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c18a0-1724-4aba-8923-aaa9f50ff7a2 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:07.042063 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c18a0-1724-4aba-8923-aaa9f50ff7a2 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:07.042218 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c18a0-1724-4aba-8923-aaa9f50ff7a2 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:07.044108 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 145/275] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:50:07.049374 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fac36a-fac2-4550-8abc-bfb7f9ac22f4 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:07.049736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fac36a-fac2-4550-8abc-bfb7f9ac22f4 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:07.050081 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fac36a-fac2-4550-8abc-bfb7f9ac22f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:07.068566 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-04fac36a-fac2-4550-8abc-bfb7f9ac22f4 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:07.069771 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-04fac36a-fac2-4550-8abc-bfb7f9ac22f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:07.078597 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 146/276] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:50:07.102050 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fac36a-fac2-4550-8abc-bfb7f9ac22f4 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:07.103473 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 131/277] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:50:06 2022] PUT /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274/users/d275dfed3bca4c0f8bb618275eec40a6/roles/573b191bb7f843fa9bc910a1f859c370 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 16:50:07.116397 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fac36a-fac2-4550-8abc-bfb7f9ac22f4 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:07.179554 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c02164-336b-46e0-9134-a71c7de2b99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:07.180909 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c02164-336b-46e0-9134-a71c7de2b99c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:07.181205 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c02164-336b-46e0-9134-a71c7de2b99c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:07.181691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c02164-336b-46e0-9134-a71c7de2b99c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:07.193845 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c02164-336b-46e0-9134-a71c7de2b99c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:07.202223 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-03c02164-336b-46e0-9134-a71c7de2b99c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 16:50:07.203843 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 147/278] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:07.209662 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d77fe4-2ed7-4414-92e5-f04a3a3a1ad8 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:07.220545 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d77fe4-2ed7-4414-92e5-f04a3a3a1ad8 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:07.225335 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0c6e6-33a2-4815-a54e-ed9164de4bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:07.226008 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0c6e6-33a2-4815-a54e-ed9164de4bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:07.226286 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0c6e6-33a2-4815-a54e-ed9164de4bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:07.226559 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0c6e6-33a2-4815-a54e-ed9164de4bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:07.227891 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0c6e6-33a2-4815-a54e-ed9164de4bb1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:07.228340 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0c6e6-33a2-4815-a54e-ed9164de4bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:07.230315 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0c6e6-33a2-4815-a54e-ed9164de4bb1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:07.240097 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 132/279] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:50:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:07.246601 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c02164-336b-46e0-9134-a71c7de2b99c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:07.256952 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c02164-336b-46e0-9134-a71c7de2b99c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:07.262084 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a9071-8fd1-4797-b698-41c4cf3c1a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:07.263145 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a9071-8fd1-4797-b698-41c4cf3c1a11 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:07.263474 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a9071-8fd1-4797-b698-41c4cf3c1a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:07.263745 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a9071-8fd1-4797-b698-41c4cf3c1a11 admin admin] PATH_INFO: `/v3/users/5edf1d55d1604d9bbd562adbe5464216` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:07.265090 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a9071-8fd1-4797-b698-41c4cf3c1a11 admin admin] RBAC: Authorizing `identity:get_user(user_id=5edf1d55d1604d9bbd562adbe5464216)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:07.267468 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a9071-8fd1-4797-b698-41c4cf3c1a11 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:07.269263 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 148/280] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:50:07 2022] GET /identity/v3/users/5edf1d55d1604d9bbd562adbe5464216 => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:07.275347 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0c6e6-33a2-4815-a54e-ed9164de4bb1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:07.284117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ae222-9fcf-4f56-a7e3-e6b9638de028 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:07.284434 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ae222-9fcf-4f56-a7e3-e6b9638de028 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:07.284702 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ae222-9fcf-4f56-a7e3-e6b9638de028 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:07.285863 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0c6e6-33a2-4815-a54e-ed9164de4bb1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:07.286822 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 149/281] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:07.292686 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe067c0-9cab-4805-b16d-d61cb80b936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:07.292968 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe067c0-9cab-4805-b16d-d61cb80b936c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:07.293062 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b6b82-aaa8-4fc0-8723-555afcc37d2f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:07.293223 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe067c0-9cab-4805-b16d-d61cb80b936c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:07.293312 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b6b82-aaa8-4fc0-8723-555afcc37d2f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:07.293517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b6b82-aaa8-4fc0-8723-555afcc37d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:07.293617 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe067c0-9cab-4805-b16d-d61cb80b936c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:07.302900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe067c0-9cab-4805-b16d-d61cb80b936c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:07.304659 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe067c0-9cab-4805-b16d-d61cb80b936c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:07.313495 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-0a0b6b82-aaa8-4fc0-8723-555afcc37d2f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:07.314752 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0a0b6b82-aaa8-4fc0-8723-555afcc37d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:07.314889 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 133/282] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:07.316363 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02647d5b-d8fd-4a83-99c7-4fb1e649d0aa None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:07.316646 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02647d5b-d8fd-4a83-99c7-4fb1e649d0aa None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:07.317015 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02647d5b-d8fd-4a83-99c7-4fb1e649d0aa None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:07.318719 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 134/283] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:07.321684 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02647d5b-d8fd-4a83-99c7-4fb1e649d0aa None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:07.323829 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 150/284] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:07.325700 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07d35f-2090-4d48-99af-650e01f08545 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:07.326247 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07d35f-2090-4d48-99af-650e01f08545 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:07.327367 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07d35f-2090-4d48-99af-650e01f08545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:07.338853 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02647d5b-d8fd-4a83-99c7-4fb1e649d0aa None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:07.346868 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be62281-a54c-44af-94a0-0cdd72757246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:07.348111 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be62281-a54c-44af-94a0-0cdd72757246 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:07.348242 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-df07d35f-2090-4d48-99af-650e01f08545 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:07.348711 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be62281-a54c-44af-94a0-0cdd72757246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:07.348981 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be62281-a54c-44af-94a0-0cdd72757246 admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:07.349426 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-df07d35f-2090-4d48-99af-650e01f08545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:07.350248 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be62281-a54c-44af-94a0-0cdd72757246 admin admin] RBAC: Authorizing `identity:get_project(project_id=83908d6e37ad41e2882ed8f20923b274)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:07.352868 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be62281-a54c-44af-94a0-0cdd72757246 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:07.354537 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 135/285] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:07 2022] GET /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:07.355372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be62281-a54c-44af-94a0-0cdd72757246 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:07.358862 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 151/286] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:07.361306 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07d35f-2090-4d48-99af-650e01f08545 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:07.372431 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07d35f-2090-4d48-99af-650e01f08545 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:07.375164 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be62281-a54c-44af-94a0-0cdd72757246 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:07.382883 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ab6df-c8b1-4a73-8c14-5e82553bf156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:07.384111 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ab6df-c8b1-4a73-8c14-5e82553bf156 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:07.384631 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ab6df-c8b1-4a73-8c14-5e82553bf156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:07.385225 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ab6df-c8b1-4a73-8c14-5e82553bf156 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:07.386268 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ab6df-c8b1-4a73-8c14-5e82553bf156 admin admin] RBAC: Adding query filter params (role.id=d361c0606e4646d3afa601176d0422ec, scope.project.id=83908d6e37ad41e2882ed8f20923b274, user.id=5edf1d55d1604d9bbd562adbe5464216) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:07.386605 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ab6df-c8b1-4a73-8c14-5e82553bf156 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:07.388682 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ab6df-c8b1-4a73-8c14-5e82553bf156 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:07.389799 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c8b5d-c451-4742-8ef0-53c590c31eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:07.390713 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c8b5d-c451-4742-8ef0-53c590c31eaf admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:07.390893 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c8b5d-c451-4742-8ef0-53c590c31eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:07.391154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c8b5d-c451-4742-8ef0-53c590c31eaf admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:07.395534 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 152/287] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:07 2022] GET /identity/v3/role_assignments?user.id=5edf1d55d1604d9bbd562adbe5464216&scope.project.id=83908d6e37ad41e2882ed8f20923b274&role.id=d361c0606e4646d3afa601176d0422ec => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:07.396646 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ab6df-c8b1-4a73-8c14-5e82553bf156 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:07.404617 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c8b5d-c451-4742-8ef0-53c590c31eaf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:07.407298 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ab6df-c8b1-4a73-8c14-5e82553bf156 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:07.411686 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-4f7c8b5d-c451-4742-8ef0-53c590c31eaf admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 16:50:07.413132 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 136/288] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:07.416643 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd9c00-d255-4df9-8583-93a908fbec71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:07.417822 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd9c00-d255-4df9-8583-93a908fbec71 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:07.418318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd9c00-d255-4df9-8583-93a908fbec71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:07.419049 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd9c00-d255-4df9-8583-93a908fbec71 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:07.420201 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c8b5d-c451-4742-8ef0-53c590c31eaf admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:07.420594 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd9c00-d255-4df9-8583-93a908fbec71 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:07.422814 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd9c00-d255-4df9-8583-93a908fbec71 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:07.429482 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 153/289] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:07.431660 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd9c00-d255-4df9-8583-93a908fbec71 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:07.433279 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c8b5d-c451-4742-8ef0-53c590c31eaf admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:07.438139 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0463b17-b7bf-415d-95bd-0ed9e2ffc16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:07.439180 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0463b17-b7bf-415d-95bd-0ed9e2ffc16a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:07.439613 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0463b17-b7bf-415d-95bd-0ed9e2ffc16a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:07.439900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0463b17-b7bf-415d-95bd-0ed9e2ffc16a admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:07.440655 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0463b17-b7bf-415d-95bd-0ed9e2ffc16a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:07.440957 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0463b17-b7bf-415d-95bd-0ed9e2ffc16a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:07.442582 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0463b17-b7bf-415d-95bd-0ed9e2ffc16a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:07.444447 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd9c00-d255-4df9-8583-93a908fbec71 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:07.450376 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0e35b-d5b3-4c4b-9205-ef5fc9407f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:07.451353 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0e35b-d5b3-4c4b-9205-ef5fc9407f79 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:07.451874 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0e35b-d5b3-4c4b-9205-ef5fc9407f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:07.452299 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0e35b-d5b3-4c4b-9205-ef5fc9407f79 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:07.453168 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0e35b-d5b3-4c4b-9205-ef5fc9407f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:07.453755 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 137/290] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:50:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:07.455660 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0e35b-d5b3-4c4b-9205-ef5fc9407f79 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:07.459412 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0463b17-b7bf-415d-95bd-0ed9e2ffc16a admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:07.470261 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0463b17-b7bf-415d-95bd-0ed9e2ffc16a admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:07.475013 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e8ec2-0e21-4381-b879-cb1c5be30995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:07.475999 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e8ec2-0e21-4381-b879-cb1c5be30995 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:07.487437 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e8ec2-0e21-4381-b879-cb1c5be30995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:07.487437 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e8ec2-0e21-4381-b879-cb1c5be30995 admin admin] PATH_INFO: `/v3/users/db98ec82714f47d2a1a0c3c5ccde4676` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:07.493509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e8ec2-0e21-4381-b879-cb1c5be30995 admin admin] RBAC: Authorizing `identity:get_user(user_id=db98ec82714f47d2a1a0c3c5ccde4676)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:07.495897 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e8ec2-0e21-4381-b879-cb1c5be30995 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:07.497989 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 138/291] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:50:07 2022] GET /identity/v3/users/db98ec82714f47d2a1a0c3c5ccde4676 => generated 293 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:07.503641 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e8ec2-0e21-4381-b879-cb1c5be30995 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:07.514023 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e8ec2-0e21-4381-b879-cb1c5be30995 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:07.518785 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940f6e5-c8f0-4c76-ab45-ffa5ff59e031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:07.519443 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940f6e5-c8f0-4c76-ab45-ffa5ff59e031 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:07.519722 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940f6e5-c8f0-4c76-ab45-ffa5ff59e031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:07.519996 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940f6e5-c8f0-4c76-ab45-ffa5ff59e031 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:07.520882 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940f6e5-c8f0-4c76-ab45-ffa5ff59e031 admin admin] RBAC: Adding query filter params (role.id=d361c0606e4646d3afa601176d0422ec, user.id=db98ec82714f47d2a1a0c3c5ccde4676, scope.system=all) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:07.521198 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940f6e5-c8f0-4c76-ab45-ffa5ff59e031 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:07.525727 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940f6e5-c8f0-4c76-ab45-ffa5ff59e031 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:07.533482 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 139/292] 10.222.0.42 () {56 vars in 1329 bytes} [Wed Feb 16 16:50:07 2022] GET /identity/v3/role_assignments?user.id=db98ec82714f47d2a1a0c3c5ccde4676&scope.system=all&role.id=d361c0606e4646d3afa601176d0422ec => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:07.570865 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 154/293] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Feb 16 16:50:07 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:50:09.521911 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea70b12-f51d-49ce-9cf4-2d2162adae5f None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:09.522462 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea70b12-f51d-49ce-9cf4-2d2162adae5f None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:09.522462 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea70b12-f51d-49ce-9cf4-2d2162adae5f None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:09.525431 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 140/294] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:09.531190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75601a-95d8-4481-8154-8e374a484046 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:09.531585 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75601a-95d8-4481-8154-8e374a484046 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:09.531765 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75601a-95d8-4481-8154-8e374a484046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:09.550404 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-4d75601a-95d8-4481-8154-8e374a484046 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:09.551634 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-4d75601a-95d8-4481-8154-8e374a484046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:09.559903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 155/295] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:09.585909 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea70b12-f51d-49ce-9cf4-2d2162adae5f None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:09.598840 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea70b12-f51d-49ce-9cf4-2d2162adae5f None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:09.608327 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4aefb3-1753-4521-b714-264b789151bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:09.609132 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aefb3-1753-4521-b714-264b789151bf admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:09.609412 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aefb3-1753-4521-b714-264b789151bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:09.609689 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aefb3-1753-4521-b714-264b789151bf admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:09.621506 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4aefb3-1753-4521-b714-264b789151bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:09.628424 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-eb4aefb3-1753-4521-b714-264b789151bf admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 16:50:09.629838 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 141/296] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:09.635613 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75601a-95d8-4481-8154-8e374a484046 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:09.644573 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75601a-95d8-4481-8154-8e374a484046 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:09.649084 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c68619-a1a6-4bb3-b413-411981ac6b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:09.650027 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c68619-a1a6-4bb3-b413-411981ac6b3b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:09.650307 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c68619-a1a6-4bb3-b413-411981ac6b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:09.650583 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c68619-a1a6-4bb3-b413-411981ac6b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:09.651373 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c68619-a1a6-4bb3-b413-411981ac6b3b admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:09.651678 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c68619-a1a6-4bb3-b413-411981ac6b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:09.653345 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c68619-a1a6-4bb3-b413-411981ac6b3b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:09.662195 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 156/297] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:50:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:09.668215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4aefb3-1753-4521-b714-264b789151bf admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:09.678213 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4aefb3-1753-4521-b714-264b789151bf admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:09.683539 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54b566-493e-4031-b946-8d2fb03dc768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:09.684663 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54b566-493e-4031-b946-8d2fb03dc768 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:09.685138 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54b566-493e-4031-b946-8d2fb03dc768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:09.685611 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54b566-493e-4031-b946-8d2fb03dc768 admin admin] PATH_INFO: `/v3/users/d275dfed3bca4c0f8bb618275eec40a6` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:09.687042 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54b566-493e-4031-b946-8d2fb03dc768 admin admin] RBAC: Authorizing `identity:get_user(user_id=d275dfed3bca4c0f8bb618275eec40a6)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:09.689351 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54b566-493e-4031-b946-8d2fb03dc768 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:09.691482 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 142/298] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:50:09 2022] GET /identity/v3/users/d275dfed3bca4c0f8bb618275eec40a6 => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:09.697494 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c68619-a1a6-4bb3-b413-411981ac6b3b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:09.707942 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c68619-a1a6-4bb3-b413-411981ac6b3b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:09.712712 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b750fe2-6af4-4710-853a-770bafc1c6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:09.713632 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b750fe2-6af4-4710-853a-770bafc1c6dd admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:09.714126 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b750fe2-6af4-4710-853a-770bafc1c6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:09.714598 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b750fe2-6af4-4710-853a-770bafc1c6dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:09.723899 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b750fe2-6af4-4710-853a-770bafc1c6dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:09.726035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b750fe2-6af4-4710-853a-770bafc1c6dd admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:09.737618 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 157/299] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 16:50:09.744266 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54b566-493e-4031-b946-8d2fb03dc768 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:09.754911 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54b566-493e-4031-b946-8d2fb03dc768 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:09.759970 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984bbed-daae-4fc2-8c70-8ee6d5bd1b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:09.761148 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984bbed-daae-4fc2-8c70-8ee6d5bd1b7f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:09.764214 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984bbed-daae-4fc2-8c70-8ee6d5bd1b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:09.764214 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984bbed-daae-4fc2-8c70-8ee6d5bd1b7f admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:09.764214 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984bbed-daae-4fc2-8c70-8ee6d5bd1b7f admin admin] RBAC: Authorizing `identity:get_project(project_id=83908d6e37ad41e2882ed8f20923b274)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:09.765221 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984bbed-daae-4fc2-8c70-8ee6d5bd1b7f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:09.767053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 143/300] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:09 2022] GET /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:09.773388 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b750fe2-6af4-4710-853a-770bafc1c6dd admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:09.782858 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b750fe2-6af4-4710-853a-770bafc1c6dd admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:09.787340 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698bff8-593b-45c2-be19-4628467890f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:09.787988 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698bff8-593b-45c2-be19-4628467890f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:09.788268 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698bff8-593b-45c2-be19-4628467890f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:09.788540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698bff8-593b-45c2-be19-4628467890f6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:09.789360 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698bff8-593b-45c2-be19-4628467890f6 admin admin] RBAC: Adding query filter params (role.id=573b191bb7f843fa9bc910a1f859c370, scope.project.id=83908d6e37ad41e2882ed8f20923b274, user.id=d275dfed3bca4c0f8bb618275eec40a6) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:09.790212 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698bff8-593b-45c2-be19-4628467890f6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:09.792065 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698bff8-593b-45c2-be19-4628467890f6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:09.802979 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 158/301] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:09 2022] GET /identity/v3/role_assignments?user.id=d275dfed3bca4c0f8bb618275eec40a6&scope.project.id=83908d6e37ad41e2882ed8f20923b274&role.id=573b191bb7f843fa9bc910a1f859c370 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:09.898229 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10ac72-c76a-4336-aeb6-29a1b7e4fcb0 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:09.899506 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10ac72-c76a-4336-aeb6-29a1b7e4fcb0 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:09.900091 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10ac72-c76a-4336-aeb6-29a1b7e4fcb0 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:09.902820 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 144/302] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:09.908828 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30907df7-e5c9-46c3-a009-505ba73a0518 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:09.909443 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30907df7-e5c9-46c3-a009-505ba73a0518 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:09.909919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30907df7-e5c9-46c3-a009-505ba73a0518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:09.934403 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-30907df7-e5c9-46c3-a009-505ba73a0518 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:09.936011 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-30907df7-e5c9-46c3-a009-505ba73a0518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:09.944275 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 159/303] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:09.968937 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10ac72-c76a-4336-aeb6-29a1b7e4fcb0 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:09.984567 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10ac72-c76a-4336-aeb6-29a1b7e4fcb0 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:09.988893 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263ecb9-cc40-4ddb-840d-30464188ed36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:09.989672 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263ecb9-cc40-4ddb-840d-30464188ed36 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:09.989948 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263ecb9-cc40-4ddb-840d-30464188ed36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:09.990217 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263ecb9-cc40-4ddb-840d-30464188ed36 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:10.003083 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263ecb9-cc40-4ddb-840d-30464188ed36 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:10.011113 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-2263ecb9-cc40-4ddb-840d-30464188ed36 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 16:50:10.012627 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 145/304] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:10.018368 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30907df7-e5c9-46c3-a009-505ba73a0518 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:10.028479 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30907df7-e5c9-46c3-a009-505ba73a0518 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:10.033220 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea97810-1e2b-4234-9308-57e92aa53dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:10.034306 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea97810-1e2b-4234-9308-57e92aa53dff admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:10.034853 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea97810-1e2b-4234-9308-57e92aa53dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:10.035341 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea97810-1e2b-4234-9308-57e92aa53dff admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:10.036291 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea97810-1e2b-4234-9308-57e92aa53dff admin admin] RBAC: Adding query filter params (name=member) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:10.036790 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea97810-1e2b-4234-9308-57e92aa53dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:10.038581 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea97810-1e2b-4234-9308-57e92aa53dff admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:10.048394 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 160/305] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:50:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:10.054109 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263ecb9-cc40-4ddb-840d-30464188ed36 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:10.066038 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263ecb9-cc40-4ddb-840d-30464188ed36 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:10.071521 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fbafb-3831-4573-8138-66677ac1ada8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:10.072966 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fbafb-3831-4573-8138-66677ac1ada8 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:10.073458 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fbafb-3831-4573-8138-66677ac1ada8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:10.073927 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fbafb-3831-4573-8138-66677ac1ada8 admin admin] PATH_INFO: `/v3/users/db98ec82714f47d2a1a0c3c5ccde4676` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:10.075521 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978fbafb-3831-4573-8138-66677ac1ada8 admin admin] RBAC: Authorizing `identity:get_user(user_id=db98ec82714f47d2a1a0c3c5ccde4676)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:10.077923 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978fbafb-3831-4573-8138-66677ac1ada8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:10.080129 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 146/306] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:50:10 2022] GET /identity/v3/users/db98ec82714f47d2a1a0c3c5ccde4676 => generated 293 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:10.085779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea97810-1e2b-4234-9308-57e92aa53dff admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:10.092395 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c625c-8098-49fa-916e-2538712215a4 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:10.092971 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c625c-8098-49fa-916e-2538712215a4 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:10.093444 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c625c-8098-49fa-916e-2538712215a4 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:10.095691 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 147/307] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:10.097057 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea97810-1e2b-4234-9308-57e92aa53dff admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:10.100798 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245284f1-61df-4996-acba-cd7c56bbad0c None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:10.101087 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245284f1-61df-4996-acba-cd7c56bbad0c None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:10.101321 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77922010-b657-4939-be13-b2c0c1919b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:10.101441 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245284f1-61df-4996-acba-cd7c56bbad0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:10.102579 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77922010-b657-4939-be13-b2c0c1919b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:10.103117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77922010-b657-4939-be13-b2c0c1919b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:10.103393 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77922010-b657-4939-be13-b2c0c1919b5b admin admin] PATH_INFO: `/v3/system/users/db98ec82714f47d2a1a0c3c5ccde4676/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:10.104911 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77922010-b657-4939-be13-b2c0c1919b5b admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=db98ec82714f47d2a1a0c3c5ccde4676, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:10.105925 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-77922010-b657-4939-be13-b2c0c1919b5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:50:10.105925 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 16:50:10.105925 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 16:50:10.107101 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77922010-b657-4939-be13-b2c0c1919b5b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:10.121387 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-245284f1-61df-4996-acba-cd7c56bbad0c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:10.122549 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-245284f1-61df-4996-acba-cd7c56bbad0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:10.130141 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 148/308] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:10.134940 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d21405-8959-4825-9fc5-6dc13b867f36 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:10.135244 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d21405-8959-4825-9fc5-6dc13b867f36 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:10.135518 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d21405-8959-4825-9fc5-6dc13b867f36 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:10.137156 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 149/309] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:50:10.142000 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64e176-7516-46ab-ae7d-819ed94c6bde None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:10.142275 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64e176-7516-46ab-ae7d-819ed94c6bde None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:10.142546 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64e176-7516-46ab-ae7d-819ed94c6bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:10.159562 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-1f64e176-7516-46ab-ae7d-819ed94c6bde None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:10.160701 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-1f64e176-7516-46ab-ae7d-819ed94c6bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:10.168244 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 150/310] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:50:10.168980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64e176-7516-46ab-ae7d-819ed94c6bde None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:10.177628 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64e176-7516-46ab-ae7d-819ed94c6bde None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:10.182297 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e01398-5f91-4d19-a187-12269efee85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:10.183047 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e01398-5f91-4d19-a187-12269efee85d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:10.183324 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e01398-5f91-4d19-a187-12269efee85d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:10.183594 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e01398-5f91-4d19-a187-12269efee85d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:10.184709 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e01398-5f91-4d19-a187-12269efee85d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:10.186353 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e01398-5f91-4d19-a187-12269efee85d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:10.187942 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 151/311] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:10.191070 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e01398-5f91-4d19-a187-12269efee85d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:10.201330 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e01398-5f91-4d19-a187-12269efee85d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:10.205625 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90998a6e-9daa-4a99-8ef0-d646dfb3f43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:10.206340 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90998a6e-9daa-4a99-8ef0-d646dfb3f43a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:10.206620 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90998a6e-9daa-4a99-8ef0-d646dfb3f43a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:10.206921 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90998a6e-9daa-4a99-8ef0-d646dfb3f43a admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:10.216924 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90998a6e-9daa-4a99-8ef0-d646dfb3f43a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:10.222794 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 161/312] 10.222.0.42 () {58 vars in 1355 bytes} [Wed Feb 16 16:50:10 2022] PUT /identity/v3/system/users/db98ec82714f47d2a1a0c3c5ccde4676/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:50:10.223625 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77922010-b657-4939-be13-b2c0c1919b5b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:10.223807 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-90998a6e-9daa-4a99-8ef0-d646dfb3f43a admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 16:50:10.224844 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 152/313] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:10.235064 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90998a6e-9daa-4a99-8ef0-d646dfb3f43a admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:10.235545 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77922010-b657-4939-be13-b2c0c1919b5b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:10.240395 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c5422-d1f2-4767-9a76-b0089caf58ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:10.241086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c5422-d1f2-4767-9a76-b0089caf58ad admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:10.242007 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c5422-d1f2-4767-9a76-b0089caf58ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:10.242288 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c5422-d1f2-4767-9a76-b0089caf58ad admin admin] PATH_INFO: `/v3/groups` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:10.243609 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c5422-d1f2-4767-9a76-b0089caf58ad admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:10.245026 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-364c5422-d1f2-4767-9a76-b0089caf58ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:50:10.245026 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 16:50:10.245026 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 16:50:10.246291 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c5422-d1f2-4767-9a76-b0089caf58ad admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:10.247024 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90998a6e-9daa-4a99-8ef0-d646dfb3f43a admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:10.252970 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf100d-2b45-4de4-8281-f54b96c807b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:10.252970 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf100d-2b45-4de4-8281-f54b96c807b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:10.252970 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf100d-2b45-4de4-8281-f54b96c807b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:10.252970 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf100d-2b45-4de4-8281-f54b96c807b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:10.253882 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf100d-2b45-4de4-8281-f54b96c807b9 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:10.254259 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf100d-2b45-4de4-8281-f54b96c807b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:10.255995 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf100d-2b45-4de4-8281-f54b96c807b9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:10.265470 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 153/314] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:50:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:10.271027 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf100d-2b45-4de4-8281-f54b96c807b9 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:10.281491 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf100d-2b45-4de4-8281-f54b96c807b9 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:10.285653 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d5609-1ed0-45a4-9097-7f6a5c86ed13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:10.286545 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d5609-1ed0-45a4-9097-7f6a5c86ed13 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:10.286856 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d5609-1ed0-45a4-9097-7f6a5c86ed13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:10.287133 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d5609-1ed0-45a4-9097-7f6a5c86ed13 admin admin] PATH_INFO: `/v3/users/2923f03c81024593a26a532c21600689` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:10.303064 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d5609-1ed0-45a4-9097-7f6a5c86ed13 admin admin] RBAC: Authorizing `identity:get_user(user_id=2923f03c81024593a26a532c21600689)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:10.306249 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d5609-1ed0-45a4-9097-7f6a5c86ed13 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:10.308048 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 154/315] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:50:10 2022] GET /identity/v3/users/2923f03c81024593a26a532c21600689 => generated 293 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:10.313784 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d5609-1ed0-45a4-9097-7f6a5c86ed13 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:10.323908 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d5609-1ed0-45a4-9097-7f6a5c86ed13 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:10.328366 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f9c84-1b29-4545-b384-101f26900181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:10.329057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f9c84-1b29-4545-b384-101f26900181 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:10.329333 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f9c84-1b29-4545-b384-101f26900181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:10.329602 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f9c84-1b29-4545-b384-101f26900181 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:10.330432 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f9c84-1b29-4545-b384-101f26900181 admin admin] RBAC: Adding query filter params (role.id=573b191bb7f843fa9bc910a1f859c370, user.id=2923f03c81024593a26a532c21600689, scope.system=all) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:10.330774 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f9c84-1b29-4545-b384-101f26900181 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:10.332616 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f9c84-1b29-4545-b384-101f26900181 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:10.338522 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 155/316] 10.222.0.42 () {56 vars in 1329 bytes} [Wed Feb 16 16:50:10 2022] GET /identity/v3/role_assignments?user.id=2923f03c81024593a26a532c21600689&scope.system=all&role.id=573b191bb7f843fa9bc910a1f859c370 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:10.344254 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 162/317] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Feb 16 16:50:10 2022] POST /identity/v3/groups => generated 229 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:50:12.525992 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ada61-9247-469c-8ece-2c1927e77739 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:12.525992 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ada61-9247-469c-8ece-2c1927e77739 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:12.525992 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ada61-9247-469c-8ece-2c1927e77739 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:12.526606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 156/318] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:12.532484 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f38c7-c07c-43be-83aa-34866d3c15a4 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:12.532897 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f38c7-c07c-43be-83aa-34866d3c15a4 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:12.533064 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f38c7-c07c-43be-83aa-34866d3c15a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:12.551472 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-e69f38c7-c07c-43be-83aa-34866d3c15a4 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:12.552671 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e69f38c7-c07c-43be-83aa-34866d3c15a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:12.561558 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 163/319] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:12.585432 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ada61-9247-469c-8ece-2c1927e77739 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:12.597762 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ada61-9247-469c-8ece-2c1927e77739 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:12.602723 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1622145-1c65-4f32-ac6d-6e89624efa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:12.603561 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1622145-1c65-4f32-ac6d-6e89624efa2c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:12.603882 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1622145-1c65-4f32-ac6d-6e89624efa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:12.604157 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1622145-1c65-4f32-ac6d-6e89624efa2c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:12.614676 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1622145-1c65-4f32-ac6d-6e89624efa2c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:12.622365 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-b1622145-1c65-4f32-ac6d-6e89624efa2c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 16:50:12.626689 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 157/320] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:12.628764 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f1c81-28a9-4757-bd3e-9c0f003fe25f None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:12.629059 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f1c81-28a9-4757-bd3e-9c0f003fe25f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:12.629335 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f1c81-28a9-4757-bd3e-9c0f003fe25f None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:12.629429 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1622145-1c65-4f32-ac6d-6e89624efa2c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:12.631367 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 164/321] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:50:12.637177 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271505a8-8b2c-4bee-868b-b85acffe1684 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:12.637429 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271505a8-8b2c-4bee-868b-b85acffe1684 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:12.637705 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271505a8-8b2c-4bee-868b-b85acffe1684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:12.639180 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1622145-1c65-4f32-ac6d-6e89624efa2c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:12.643423 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ac2ce-fe25-4582-9e67-d5343ff75b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:12.644067 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac2ce-fe25-4582-9e67-d5343ff75b1c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:12.644348 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac2ce-fe25-4582-9e67-d5343ff75b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:12.644625 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac2ce-fe25-4582-9e67-d5343ff75b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:12.645370 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ac2ce-fe25-4582-9e67-d5343ff75b1c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:12.645675 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ac2ce-fe25-4582-9e67-d5343ff75b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:12.647306 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ac2ce-fe25-4582-9e67-d5343ff75b1c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:12.655528 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-271505a8-8b2c-4bee-868b-b85acffe1684 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:12.656384 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 158/322] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:50:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:12.656728 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-271505a8-8b2c-4bee-868b-b85acffe1684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:12.661444 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ac2ce-fe25-4582-9e67-d5343ff75b1c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:12.666920 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 165/323] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:12.671573 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ac2ce-fe25-4582-9e67-d5343ff75b1c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:12.675886 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef62b35-c7e4-4d63-9247-bf7a1b37bad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:12.676724 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef62b35-c7e4-4d63-9247-bf7a1b37bad6 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:12.677003 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef62b35-c7e4-4d63-9247-bf7a1b37bad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:12.677278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef62b35-c7e4-4d63-9247-bf7a1b37bad6 admin admin] PATH_INFO: `/v3/users/db98ec82714f47d2a1a0c3c5ccde4676` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:12.678456 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef62b35-c7e4-4d63-9247-bf7a1b37bad6 admin admin] RBAC: Authorizing `identity:get_user(user_id=db98ec82714f47d2a1a0c3c5ccde4676)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:12.681210 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef62b35-c7e4-4d63-9247-bf7a1b37bad6 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:12.682800 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 159/324] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:50:12 2022] GET /identity/v3/users/db98ec82714f47d2a1a0c3c5ccde4676 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:12.687744 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44aac82-372a-4617-9797-ce3c07f6f57c None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:12.688028 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44aac82-372a-4617-9797-ce3c07f6f57c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:12.688302 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44aac82-372a-4617-9797-ce3c07f6f57c None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:12.688912 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef62b35-c7e4-4d63-9247-bf7a1b37bad6 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:12.690052 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 166/325] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:12.690756 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44aac82-372a-4617-9797-ce3c07f6f57c None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:12.698907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef62b35-c7e4-4d63-9247-bf7a1b37bad6 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:12.702514 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44aac82-372a-4617-9797-ce3c07f6f57c None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:12.703287 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead6642-756d-4698-9168-03a3d2430dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:12.703939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead6642-756d-4698-9168-03a3d2430dad admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:12.704232 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead6642-756d-4698-9168-03a3d2430dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:12.704506 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead6642-756d-4698-9168-03a3d2430dad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:12.705332 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead6642-756d-4698-9168-03a3d2430dad admin admin] RBAC: Adding query filter params (role.id=d361c0606e4646d3afa601176d0422ec, user.id=db98ec82714f47d2a1a0c3c5ccde4676, scope.system=all) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:12.705642 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead6642-756d-4698-9168-03a3d2430dad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:12.706824 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54baeab-1b73-4ff2-bd2f-2b07ecbb0f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:12.707500 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead6642-756d-4698-9168-03a3d2430dad admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:12.716863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54baeab-1b73-4ff2-bd2f-2b07ecbb0f74 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:12.716863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54baeab-1b73-4ff2-bd2f-2b07ecbb0f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:12.716863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54baeab-1b73-4ff2-bd2f-2b07ecbb0f74 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:12.718096 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54baeab-1b73-4ff2-bd2f-2b07ecbb0f74 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:12.722329 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 160/326] 10.222.0.42 () {56 vars in 1329 bytes} [Wed Feb 16 16:50:12 2022] GET /identity/v3/role_assignments?user.id=db98ec82714f47d2a1a0c3c5ccde4676&scope.system=all&role.id=d361c0606e4646d3afa601176d0422ec => generated 510 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:12.723567 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ec722-6d7e-41b3-93c4-e4aed3370d7f None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:12.723843 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ec722-6d7e-41b3-93c4-e4aed3370d7f None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:12.724134 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ec722-6d7e-41b3-93c4-e4aed3370d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:12.724971 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-f54baeab-1b73-4ff2-bd2f-2b07ecbb0f74 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 16:50:12.726784 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 167/327] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:12.733277 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54baeab-1b73-4ff2-bd2f-2b07ecbb0f74 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:12.744628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54baeab-1b73-4ff2-bd2f-2b07ecbb0f74 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:12.745304 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-d50ec722-6d7e-41b3-93c4-e4aed3370d7f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:12.746594 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d50ec722-6d7e-41b3-93c4-e4aed3370d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:12.749377 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d671dab-072c-40f5-9250-8e29f807670f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:12.750316 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d671dab-072c-40f5-9250-8e29f807670f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:12.750676 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d671dab-072c-40f5-9250-8e29f807670f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:12.751318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d671dab-072c-40f5-9250-8e29f807670f admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:12.751715 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d671dab-072c-40f5-9250-8e29f807670f admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:12.752025 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d671dab-072c-40f5-9250-8e29f807670f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:12.753795 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d671dab-072c-40f5-9250-8e29f807670f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:12.755025 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 161/328] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:12.763986 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 168/329] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:50:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:12.769372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ec722-6d7e-41b3-93c4-e4aed3370d7f None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:12.779250 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d671dab-072c-40f5-9250-8e29f807670f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:12.779548 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ec722-6d7e-41b3-93c4-e4aed3370d7f None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:12.784175 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f9f34-817a-411f-a573-25b9326314df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:12.785068 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f9f34-817a-411f-a573-25b9326314df admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:12.785347 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f9f34-817a-411f-a573-25b9326314df admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:12.785620 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f9f34-817a-411f-a573-25b9326314df admin admin] PATH_INFO: `/v3/users/2923f03c81024593a26a532c21600689` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:12.786995 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f9f34-817a-411f-a573-25b9326314df admin admin] RBAC: Authorizing `identity:get_user(user_id=2923f03c81024593a26a532c21600689)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:12.789141 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f9f34-817a-411f-a573-25b9326314df admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:12.790593 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d671dab-072c-40f5-9250-8e29f807670f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:12.792071 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 162/330] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:50:12 2022] GET /identity/v3/users/2923f03c81024593a26a532c21600689 => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:12.795541 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ea5a8-8e34-41d7-9a68-0c75e4e8625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:12.796571 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ea5a8-8e34-41d7-9a68-0c75e4e8625b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:12.796740 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ea5a8-8e34-41d7-9a68-0c75e4e8625b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:12.796881 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ea5a8-8e34-41d7-9a68-0c75e4e8625b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:12.797469 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f9f34-817a-411f-a573-25b9326314df admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:12.798125 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ea5a8-8e34-41d7-9a68-0c75e4e8625b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:12.799948 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ea5a8-8e34-41d7-9a68-0c75e4e8625b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:12.802028 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 169/331] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:12.808155 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f9f34-817a-411f-a573-25b9326314df admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:12.808416 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ea5a8-8e34-41d7-9a68-0c75e4e8625b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:12.831579 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca899cbb-1794-406f-ba2c-2416be67d4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:12.831579 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca899cbb-1794-406f-ba2c-2416be67d4bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:12.831579 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca899cbb-1794-406f-ba2c-2416be67d4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:12.831579 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca899cbb-1794-406f-ba2c-2416be67d4bb admin admin] PATH_INFO: `/v3/system/users/2923f03c81024593a26a532c21600689/roles/573b191bb7f843fa9bc910a1f859c370` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:12.832053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca899cbb-1794-406f-ba2c-2416be67d4bb admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2923f03c81024593a26a532c21600689, role_id=573b191bb7f843fa9bc910a1f859c370)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:12.832053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING py.warnings [None req-ca899cbb-1794-406f-ba2c-2416be67d4bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:50:12.832053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: warnings.warn(msg) Feb 16 16:50:12.832053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: Feb 16 16:50:12.832053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca899cbb-1794-406f-ba2c-2416be67d4bb admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:12.832401 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ea5a8-8e34-41d7-9a68-0c75e4e8625b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:12.832401 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03321b94-3baa-4510-a3bd-564db3bf5a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:12.832401 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03321b94-3baa-4510-a3bd-564db3bf5a5c admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:12.832401 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03321b94-3baa-4510-a3bd-564db3bf5a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:12.832694 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03321b94-3baa-4510-a3bd-564db3bf5a5c admin admin] PATH_INFO: `/v3/groups` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:12.832694 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03321b94-3baa-4510-a3bd-564db3bf5a5c admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:12.832694 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03321b94-3baa-4510-a3bd-564db3bf5a5c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:12.915558 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 163/332] 10.222.0.42 () {58 vars in 1355 bytes} [Wed Feb 16 16:50:12 2022] PUT /identity/v3/system/users/2923f03c81024593a26a532c21600689/roles/573b191bb7f843fa9bc910a1f859c370 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 16:50:13.096990 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 170/333] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Feb 16 16:50:12 2022] POST /identity/v3/groups => generated 226 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 16:50:15.433676 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e26453-5ce9-4082-bb90-9cadb9c558b5 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:15.434712 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e26453-5ce9-4082-bb90-9cadb9c558b5 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:15.435214 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e26453-5ce9-4082-bb90-9cadb9c558b5 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:15.437443 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 164/334] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:15.442776 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0ae99-2979-47db-ab1d-104c7b29ae04 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:15.443624 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0ae99-2979-47db-ab1d-104c7b29ae04 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:15.444113 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0ae99-2979-47db-ab1d-104c7b29ae04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:15.467938 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-31c0ae99-2979-47db-ab1d-104c7b29ae04 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:15.469508 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-31c0ae99-2979-47db-ab1d-104c7b29ae04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:15.482660 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 171/335] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:15.529161 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e26453-5ce9-4082-bb90-9cadb9c558b5 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:15.548466 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e26453-5ce9-4082-bb90-9cadb9c558b5 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:15.556255 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ab48a-6776-451b-835b-e852e91a6839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:15.557304 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ab48a-6776-451b-835b-e852e91a6839 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:15.557805 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ab48a-6776-451b-835b-e852e91a6839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:15.558275 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ab48a-6776-451b-835b-e852e91a6839 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:15.582764 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ab48a-6776-451b-835b-e852e91a6839 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:15.590248 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-247ab48a-6776-451b-835b-e852e91a6839 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 16:50:15.597699 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0ae99-2979-47db-ab1d-104c7b29ae04 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:15.603937 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 165/336] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:15.617079 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0ae99-2979-47db-ab1d-104c7b29ae04 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:15.632502 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7ff11-dd8a-4ecd-a778-778f1f9618d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:15.633553 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ff11-dd8a-4ecd-a778-778f1f9618d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:15.634039 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ff11-dd8a-4ecd-a778-778f1f9618d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:15.634512 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ff11-dd8a-4ecd-a778-778f1f9618d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:15.635597 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7ff11-dd8a-4ecd-a778-778f1f9618d7 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:15.636148 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7ff11-dd8a-4ecd-a778-778f1f9618d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:15.637987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7ff11-dd8a-4ecd-a778-778f1f9618d7 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:15.657085 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 172/337] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:50:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:15.676014 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ab48a-6776-451b-835b-e852e91a6839 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:15.696881 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ab48a-6776-451b-835b-e852e91a6839 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:15.716382 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f68e21-c6a6-4c51-a481-13795cae538d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:15.717621 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f68e21-c6a6-4c51-a481-13795cae538d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:15.718104 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f68e21-c6a6-4c51-a481-13795cae538d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:15.718575 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f68e21-c6a6-4c51-a481-13795cae538d admin admin] PATH_INFO: `/v3/users/2923f03c81024593a26a532c21600689` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:15.723402 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f68e21-c6a6-4c51-a481-13795cae538d admin admin] RBAC: Authorizing `identity:get_user(user_id=2923f03c81024593a26a532c21600689)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:15.726235 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f68e21-c6a6-4c51-a481-13795cae538d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:15.727892 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 166/338] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:50:15 2022] GET /identity/v3/users/2923f03c81024593a26a532c21600689 => generated 293 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:15.744249 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7ff11-dd8a-4ecd-a778-778f1f9618d7 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:15.769167 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7ff11-dd8a-4ecd-a778-778f1f9618d7 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:15.789287 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542523bf-c4e7-4785-ab23-abd96c30a597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:15.790687 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542523bf-c4e7-4785-ab23-abd96c30a597 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:15.790806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542523bf-c4e7-4785-ab23-abd96c30a597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:15.791083 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542523bf-c4e7-4785-ab23-abd96c30a597 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:15.791913 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542523bf-c4e7-4785-ab23-abd96c30a597 admin admin] RBAC: Adding query filter params (role.id=573b191bb7f843fa9bc910a1f859c370, user.id=2923f03c81024593a26a532c21600689, scope.system=all) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:15.792226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542523bf-c4e7-4785-ab23-abd96c30a597 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:15.794079 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542523bf-c4e7-4785-ab23-abd96c30a597 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:15.834745 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 173/339] 10.222.0.42 () {56 vars in 1329 bytes} [Wed Feb 16 16:50:15 2022] GET /identity/v3/role_assignments?user.id=2923f03c81024593a26a532c21600689&scope.system=all&role.id=573b191bb7f843fa9bc910a1f859c370 => generated 510 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:15.933273 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b596f9-eee1-49aa-a4e1-8008ae89c1e2 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:15.933606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b596f9-eee1-49aa-a4e1-8008ae89c1e2 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:15.933836 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b596f9-eee1-49aa-a4e1-8008ae89c1e2 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:15.935957 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 167/340] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:15.941653 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017f775-23a3-4600-885c-ea88bd26f93e None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:15.941939 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017f775-23a3-4600-885c-ea88bd26f93e None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:15.942219 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017f775-23a3-4600-885c-ea88bd26f93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:15.989891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-6017f775-23a3-4600-885c-ea88bd26f93e None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:15.991111 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-6017f775-23a3-4600-885c-ea88bd26f93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:16.014419 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 174/341] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:16.053856 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b596f9-eee1-49aa-a4e1-8008ae89c1e2 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:16.090098 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b596f9-eee1-49aa-a4e1-8008ae89c1e2 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:16.102757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e55f2-8448-4ef5-aaf6-77a22089e92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:16.103569 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e55f2-8448-4ef5-aaf6-77a22089e92b admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:16.103847 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e55f2-8448-4ef5-aaf6-77a22089e92b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:16.104122 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e55f2-8448-4ef5-aaf6-77a22089e92b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:16.141165 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e55f2-8448-4ef5-aaf6-77a22089e92b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:16.154635 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-4f4e55f2-8448-4ef5-aaf6-77a22089e92b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 16:50:16.158841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 168/342] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:16.167420 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017f775-23a3-4600-885c-ea88bd26f93e None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:16.178675 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017f775-23a3-4600-885c-ea88bd26f93e None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:16.192836 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964be3d-272b-4f36-8665-1eb75ea231d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:16.193519 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964be3d-272b-4f36-8665-1eb75ea231d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:16.193800 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964be3d-272b-4f36-8665-1eb75ea231d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:16.194072 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964be3d-272b-4f36-8665-1eb75ea231d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:16.194862 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964be3d-272b-4f36-8665-1eb75ea231d5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:16.195170 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964be3d-272b-4f36-8665-1eb75ea231d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:16.197535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964be3d-272b-4f36-8665-1eb75ea231d5 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:16.208120 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 175/343] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:50:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:16.217830 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e55f2-8448-4ef5-aaf6-77a22089e92b admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:16.235146 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e55f2-8448-4ef5-aaf6-77a22089e92b admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:16.235891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104afcdf-0444-4aa6-8da5-85358887b7bf None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:16.236287 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104afcdf-0444-4aa6-8da5-85358887b7bf None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:16.236582 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104afcdf-0444-4aa6-8da5-85358887b7bf None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:16.241786 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 176/344] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:16.245165 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06256483-d770-4bbd-acb0-74dc820bf46a None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:16.245451 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06256483-d770-4bbd-acb0-74dc820bf46a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:16.245732 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06256483-d770-4bbd-acb0-74dc820bf46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:16.249350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0121f6-e492-49bf-b805-e0a739ca0b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:16.249997 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0121f6-e492-49bf-b805-e0a739ca0b79 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:16.250271 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0121f6-e492-49bf-b805-e0a739ca0b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:16.250546 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0121f6-e492-49bf-b805-e0a739ca0b79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:16.277191 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0121f6-e492-49bf-b805-e0a739ca0b79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:16.280250 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0121f6-e492-49bf-b805-e0a739ca0b79 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:16.291436 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-06256483-d770-4bbd-acb0-74dc820bf46a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:16.292640 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-06256483-d770-4bbd-acb0-74dc820bf46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:16.304783 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 169/345] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:16.312544 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0121f6-e492-49bf-b805-e0a739ca0b79 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:16.319052 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 177/346] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:16.326101 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0121f6-e492-49bf-b805-e0a739ca0b79 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:16.335309 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e4103-31fb-43a8-a05c-85b144e45da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:16.336172 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e4103-31fb-43a8-a05c-85b144e45da4 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:16.338295 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e4103-31fb-43a8-a05c-85b144e45da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:16.338295 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e4103-31fb-43a8-a05c-85b144e45da4 admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:16.343503 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e4103-31fb-43a8-a05c-85b144e45da4 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f8319abb808492e927f6f07504c63c5)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:16.345574 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e4103-31fb-43a8-a05c-85b144e45da4 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:16.347418 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 170/347] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:16 2022] GET /identity/v3/projects/0f8319abb808492e927f6f07504c63c5 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:16.351614 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06256483-d770-4bbd-acb0-74dc820bf46a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:16.361085 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e4103-31fb-43a8-a05c-85b144e45da4 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:16.369687 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06256483-d770-4bbd-acb0-74dc820bf46a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:16.378686 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e4103-31fb-43a8-a05c-85b144e45da4 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:16.385626 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a8a3d-3c97-4733-9421-8819a3851920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:16.385626 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a8a3d-3c97-4733-9421-8819a3851920 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:16.385626 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a8a3d-3c97-4733-9421-8819a3851920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:16.385626 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a8a3d-3c97-4733-9421-8819a3851920 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:16.393619 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b3693-b2b7-4520-8d72-e264b770e6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:16.394478 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b3693-b2b7-4520-8d72-e264b770e6ba admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:16.394787 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b3693-b2b7-4520-8d72-e264b770e6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:16.395063 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b3693-b2b7-4520-8d72-e264b770e6ba admin admin] PATH_INFO: `/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:16.405098 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a8a3d-3c97-4733-9421-8819a3851920 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:16.413602 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-9f6a8a3d-3c97-4733-9421-8819a3851920 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 16:50:16.415711 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 178/348] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:50:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:16.418943 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b3693-b2b7-4520-8d72-e264b770e6ba admin admin] RBAC: Authorizing `identity:get_group(group_id=3e22d3b0492f44ff897b6fb32746b7bf)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:16.419984 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING py.warnings [None req-4e6b3693-b2b7-4520-8d72-e264b770e6ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:50:16.419984 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: warnings.warn(msg) Feb 16 16:50:16.419984 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: Feb 16 16:50:16.421352 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b3693-b2b7-4520-8d72-e264b770e6ba admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:16.423543 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 171/349] 10.222.0.42 () {56 vars in 1201 bytes} [Wed Feb 16 16:50:16 2022] GET /identity/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf => generated 226 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:16.430679 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a8a3d-3c97-4733-9421-8819a3851920 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:16.432012 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b3693-b2b7-4520-8d72-e264b770e6ba admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:16.446548 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a8a3d-3c97-4733-9421-8819a3851920 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:16.449860 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b3693-b2b7-4520-8d72-e264b770e6ba admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:16.457660 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dbf52-0b80-4a9e-8a91-1fbdf49f7295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:16.458479 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dbf52-0b80-4a9e-8a91-1fbdf49f7295 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:16.458793 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dbf52-0b80-4a9e-8a91-1fbdf49f7295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:16.459069 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dbf52-0b80-4a9e-8a91-1fbdf49f7295 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:16.459379 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b3431-cc2a-4887-ac73-9bdf78ff47c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:16.459833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6dbf52-0b80-4a9e-8a91-1fbdf49f7295 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:16.460053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b3431-cc2a-4887-ac73-9bdf78ff47c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:16.460149 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6dbf52-0b80-4a9e-8a91-1fbdf49f7295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:16.460332 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b3431-cc2a-4887-ac73-9bdf78ff47c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:16.460605 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b3431-cc2a-4887-ac73-9bdf78ff47c9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:16.462186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b3431-cc2a-4887-ac73-9bdf78ff47c9 admin admin] RBAC: Adding query filter params (group.id=3e22d3b0492f44ff897b6fb32746b7bf, role.id=d361c0606e4646d3afa601176d0422ec, scope.project.id=0f8319abb808492e927f6f07504c63c5) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:16.462368 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6dbf52-0b80-4a9e-8a91-1fbdf49f7295 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:16.462829 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b3431-cc2a-4887-ac73-9bdf78ff47c9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:16.464906 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b3431-cc2a-4887-ac73-9bdf78ff47c9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:16.474635 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 179/350] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:16.476544 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 172/351] 10.222.0.42 () {56 vars in 1397 bytes} [Wed Feb 16 16:50:16 2022] GET /identity/v3/role_assignments?group.id=3e22d3b0492f44ff897b6fb32746b7bf&scope.project.id=0f8319abb808492e927f6f07504c63c5&role.id=d361c0606e4646d3afa601176d0422ec => generated 260 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:16.482793 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dbf52-0b80-4a9e-8a91-1fbdf49f7295 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:16.496769 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dbf52-0b80-4a9e-8a91-1fbdf49f7295 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:16.512371 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26c980-b5d8-4f58-a39b-753db6a8133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:16.513043 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26c980-b5d8-4f58-a39b-753db6a8133e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:16.513325 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26c980-b5d8-4f58-a39b-753db6a8133e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:16.513598 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26c980-b5d8-4f58-a39b-753db6a8133e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:16.532585 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26c980-b5d8-4f58-a39b-753db6a8133e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:16.534381 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26c980-b5d8-4f58-a39b-753db6a8133e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:16.548983 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 180/352] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:16.554764 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b3431-cc2a-4887-ac73-9bdf78ff47c9 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:16.574078 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b3431-cc2a-4887-ac73-9bdf78ff47c9 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:16.582783 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b579b3e-65e2-4688-91bc-24e2ca5cdfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:16.583700 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b579b3e-65e2-4688-91bc-24e2ca5cdfff admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:16.583983 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b579b3e-65e2-4688-91bc-24e2ca5cdfff admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:16.584299 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b579b3e-65e2-4688-91bc-24e2ca5cdfff admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:16.587798 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b579b3e-65e2-4688-91bc-24e2ca5cdfff admin admin] RBAC: Authorizing `identity:get_project(project_id=0f8319abb808492e927f6f07504c63c5)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:16.589854 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b579b3e-65e2-4688-91bc-24e2ca5cdfff admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:16.591678 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 173/353] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:16 2022] GET /identity/v3/projects/0f8319abb808492e927f6f07504c63c5 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:16.598010 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26c980-b5d8-4f58-a39b-753db6a8133e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:16.607955 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26c980-b5d8-4f58-a39b-753db6a8133e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:16.619947 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630e366-27c9-44d6-8665-584067fd2ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:16.620846 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630e366-27c9-44d6-8665-584067fd2ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:16.621127 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630e366-27c9-44d6-8665-584067fd2ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:16.621384 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630e366-27c9-44d6-8665-584067fd2ce2 admin admin] PATH_INFO: `/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:16.622936 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630e366-27c9-44d6-8665-584067fd2ce2 admin admin] RBAC: Authorizing `identity:get_group(group_id=3e22d3b0492f44ff897b6fb32746b7bf)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:16.623878 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-9630e366-27c9-44d6-8665-584067fd2ce2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:50:16.623878 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 16:50:16.623878 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 16:50:16.625085 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630e366-27c9-44d6-8665-584067fd2ce2 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:16.632138 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 181/354] 10.222.0.42 () {56 vars in 1201 bytes} [Wed Feb 16 16:50:16 2022] GET /identity/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:16.638736 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b579b3e-65e2-4688-91bc-24e2ca5cdfff admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:16.657017 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b579b3e-65e2-4688-91bc-24e2ca5cdfff admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:16.663638 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9653b-a92e-4da3-b3b0-3e828e94eff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:16.664286 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9653b-a92e-4da3-b3b0-3e828e94eff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:16.665220 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9653b-a92e-4da3-b3b0-3e828e94eff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:16.665761 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9653b-a92e-4da3-b3b0-3e828e94eff1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:16.666776 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9653b-a92e-4da3-b3b0-3e828e94eff1 admin admin] RBAC: Adding query filter params (group.id=3e22d3b0492f44ff897b6fb32746b7bf, role.id=cf30e55f556b4e0cbee0317b16316b0f, scope.project.id=0f8319abb808492e927f6f07504c63c5) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:16.667090 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9653b-a92e-4da3-b3b0-3e828e94eff1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:16.668982 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9653b-a92e-4da3-b3b0-3e828e94eff1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:16.679452 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 174/355] 10.222.0.42 () {56 vars in 1397 bytes} [Wed Feb 16 16:50:16 2022] GET /identity/v3/role_assignments?group.id=3e22d3b0492f44ff897b6fb32746b7bf&scope.project.id=0f8319abb808492e927f6f07504c63c5&role.id=cf30e55f556b4e0cbee0317b16316b0f => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:16.867988 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a76c1c-69a1-4c23-be24-7f5eea72595b None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:16.868325 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a76c1c-69a1-4c23-be24-7f5eea72595b None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:16.868527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a76c1c-69a1-4c23-be24-7f5eea72595b None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:16.870471 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 182/356] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:16.876280 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789edc6-6800-4e91-aa52-f836349d46ca None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:16.876572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789edc6-6800-4e91-aa52-f836349d46ca None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:16.876851 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789edc6-6800-4e91-aa52-f836349d46ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:16.903792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-1789edc6-6800-4e91-aa52-f836349d46ca None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:16.905003 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-1789edc6-6800-4e91-aa52-f836349d46ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:16.917857 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 175/357] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:50:16.954771 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a76c1c-69a1-4c23-be24-7f5eea72595b None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:16.973284 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a76c1c-69a1-4c23-be24-7f5eea72595b None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:16.979363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed5045-6ea1-44d0-ae17-72c0422743ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:16.980239 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed5045-6ea1-44d0-ae17-72c0422743ba admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:16.980520 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed5045-6ea1-44d0-ae17-72c0422743ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:16.980842 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed5045-6ea1-44d0-ae17-72c0422743ba admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:16.992775 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed5045-6ea1-44d0-ae17-72c0422743ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:16.999829 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-b0ed5045-6ea1-44d0-ae17-72c0422743ba admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 16:50:17.001391 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 183/358] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:17.007185 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789edc6-6800-4e91-aa52-f836349d46ca None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:17.018816 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789edc6-6800-4e91-aa52-f836349d46ca None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:17.023327 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf961f-a829-4085-a134-ca0deff5e290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:17.024654 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf961f-a829-4085-a134-ca0deff5e290 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:17.024936 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf961f-a829-4085-a134-ca0deff5e290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:17.025209 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf961f-a829-4085-a134-ca0deff5e290 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:17.026016 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf961f-a829-4085-a134-ca0deff5e290 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:17.026325 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf961f-a829-4085-a134-ca0deff5e290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:17.027983 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf961f-a829-4085-a134-ca0deff5e290 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:17.039188 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 176/359] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:50:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:17.044887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed5045-6ea1-44d0-ae17-72c0422743ba admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:17.055242 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed5045-6ea1-44d0-ae17-72c0422743ba admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:17.060004 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5104e9-cd2f-42a8-8ff2-dbaee58770e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:17.060703 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5104e9-cd2f-42a8-8ff2-dbaee58770e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:17.060984 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5104e9-cd2f-42a8-8ff2-dbaee58770e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:17.061311 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5104e9-cd2f-42a8-8ff2-dbaee58770e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:17.071388 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5104e9-cd2f-42a8-8ff2-dbaee58770e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:17.073158 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5104e9-cd2f-42a8-8ff2-dbaee58770e7 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:17.083447 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 184/360] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:17.089233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf961f-a829-4085-a134-ca0deff5e290 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:17.099091 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf961f-a829-4085-a134-ca0deff5e290 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:17.104206 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a2357-1d1d-4f01-9372-bad37e54b30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:17.105108 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a2357-1d1d-4f01-9372-bad37e54b30d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:17.105391 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a2357-1d1d-4f01-9372-bad37e54b30d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:17.105666 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a2357-1d1d-4f01-9372-bad37e54b30d admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:17.107143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a2357-1d1d-4f01-9372-bad37e54b30d admin admin] RBAC: Authorizing `identity:get_project(project_id=83908d6e37ad41e2882ed8f20923b274)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:17.109279 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a2357-1d1d-4f01-9372-bad37e54b30d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:17.111320 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 177/361] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:17 2022] GET /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:17.117028 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5104e9-cd2f-42a8-8ff2-dbaee58770e7 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:17.126891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5104e9-cd2f-42a8-8ff2-dbaee58770e7 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:17.131505 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc326c-5ee1-4414-b687-85d15436c0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:17.132535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc326c-5ee1-4414-b687-85d15436c0ac admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:17.132812 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc326c-5ee1-4414-b687-85d15436c0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:17.133659 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc326c-5ee1-4414-b687-85d15436c0ac admin admin] PATH_INFO: `/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:17.135000 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc326c-5ee1-4414-b687-85d15436c0ac admin admin] RBAC: Authorizing `identity:get_group(group_id=3e22d3b0492f44ff897b6fb32746b7bf)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:17.136959 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc326c-5ee1-4414-b687-85d15436c0ac admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:17.139005 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 185/362] 10.222.0.42 () {56 vars in 1201 bytes} [Wed Feb 16 16:50:17 2022] GET /identity/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:17.144851 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a2357-1d1d-4f01-9372-bad37e54b30d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:17.155208 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a2357-1d1d-4f01-9372-bad37e54b30d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:17.159923 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50786f4-cfde-4da0-b50e-459b31ced605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:17.160563 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50786f4-cfde-4da0-b50e-459b31ced605 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:17.160916 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50786f4-cfde-4da0-b50e-459b31ced605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:17.161194 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50786f4-cfde-4da0-b50e-459b31ced605 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:17.162073 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50786f4-cfde-4da0-b50e-459b31ced605 admin admin] RBAC: Adding query filter params (group.id=3e22d3b0492f44ff897b6fb32746b7bf, role.id=d361c0606e4646d3afa601176d0422ec, scope.project.id=83908d6e37ad41e2882ed8f20923b274) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:17.162438 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50786f4-cfde-4da0-b50e-459b31ced605 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:17.165057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50786f4-cfde-4da0-b50e-459b31ced605 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:17.173192 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 178/363] 10.222.0.42 () {56 vars in 1397 bytes} [Wed Feb 16 16:50:17 2022] GET /identity/v3/role_assignments?group.id=3e22d3b0492f44ff897b6fb32746b7bf&scope.project.id=83908d6e37ad41e2882ed8f20923b274&role.id=d361c0606e4646d3afa601176d0422ec => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:17.903630 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f1b34-ecec-4d59-8777-3c702a97ff6a None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:17.904264 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f1b34-ecec-4d59-8777-3c702a97ff6a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:17.904264 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f1b34-ecec-4d59-8777-3c702a97ff6a None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:17.906092 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 186/364] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:17.911117 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ebaa4-ba8a-4f41-9f8d-82980459a934 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:17.911582 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ebaa4-ba8a-4f41-9f8d-82980459a934 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:17.911745 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ebaa4-ba8a-4f41-9f8d-82980459a934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:17.934626 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-a49ebaa4-ba8a-4f41-9f8d-82980459a934 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:17.935984 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-a49ebaa4-ba8a-4f41-9f8d-82980459a934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:17.949184 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 179/365] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:17.985617 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f1b34-ecec-4d59-8777-3c702a97ff6a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:17.998241 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f1b34-ecec-4d59-8777-3c702a97ff6a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:18.006130 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ed6f9-9776-4e4d-908e-2b5f987f0faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:18.006999 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ed6f9-9776-4e4d-908e-2b5f987f0faa admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:18.007262 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ed6f9-9776-4e4d-908e-2b5f987f0faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:18.007536 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ed6f9-9776-4e4d-908e-2b5f987f0faa admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:18.020232 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ed6f9-9776-4e4d-908e-2b5f987f0faa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:18.028162 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-217ed6f9-9776-4e4d-908e-2b5f987f0faa admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 16:50:18.029669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 187/366] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:50:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:18.034971 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ebaa4-ba8a-4f41-9f8d-82980459a934 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:18.044064 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ebaa4-ba8a-4f41-9f8d-82980459a934 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:18.048669 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef58038-b4c2-4807-b171-160636f1e28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:18.049324 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef58038-b4c2-4807-b171-160636f1e28d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:18.049604 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef58038-b4c2-4807-b171-160636f1e28d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:18.049878 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef58038-b4c2-4807-b171-160636f1e28d admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:18.050625 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef58038-b4c2-4807-b171-160636f1e28d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:18.050958 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef58038-b4c2-4807-b171-160636f1e28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:18.052550 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef58038-b4c2-4807-b171-160636f1e28d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:18.064593 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 180/367] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:18.069874 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ed6f9-9776-4e4d-908e-2b5f987f0faa admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:18.080636 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ed6f9-9776-4e4d-908e-2b5f987f0faa admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:18.085279 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b845949-4c96-4ab0-9295-0446bc9e6401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:18.086029 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b845949-4c96-4ab0-9295-0446bc9e6401 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:18.086422 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b845949-4c96-4ab0-9295-0446bc9e6401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:18.086724 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b845949-4c96-4ab0-9295-0446bc9e6401 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:18.097837 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b845949-4c96-4ab0-9295-0446bc9e6401 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:18.099692 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b845949-4c96-4ab0-9295-0446bc9e6401 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:18.109863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 188/368] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:18.115169 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef58038-b4c2-4807-b171-160636f1e28d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:18.131768 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef58038-b4c2-4807-b171-160636f1e28d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:18.143279 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8c50c-8e63-47ec-8ab4-e29bc0b3d776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:18.144141 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8c50c-8e63-47ec-8ab4-e29bc0b3d776 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:18.144418 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8c50c-8e63-47ec-8ab4-e29bc0b3d776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:18.144691 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8c50c-8e63-47ec-8ab4-e29bc0b3d776 admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:18.145907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8c50c-8e63-47ec-8ab4-e29bc0b3d776 admin admin] RBAC: Authorizing `identity:get_project(project_id=83908d6e37ad41e2882ed8f20923b274)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:18.147953 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8c50c-8e63-47ec-8ab4-e29bc0b3d776 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:18.149952 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 181/369] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:18 2022] GET /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:18.155466 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b845949-4c96-4ab0-9295-0446bc9e6401 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:18.164865 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b845949-4c96-4ab0-9295-0446bc9e6401 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:18.169619 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cc0bd-2838-49bc-b818-5353c044fedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:18.170551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cc0bd-2838-49bc-b818-5353c044fedf admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:18.170866 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cc0bd-2838-49bc-b818-5353c044fedf admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:18.171177 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cc0bd-2838-49bc-b818-5353c044fedf admin admin] PATH_INFO: `/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:18.172407 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520cc0bd-2838-49bc-b818-5353c044fedf admin admin] RBAC: Authorizing `identity:get_group(group_id=3e22d3b0492f44ff897b6fb32746b7bf)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:18.174408 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520cc0bd-2838-49bc-b818-5353c044fedf admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:18.176095 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 189/370] 10.222.0.42 () {56 vars in 1201 bytes} [Wed Feb 16 16:50:18 2022] GET /identity/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:18.182714 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8c50c-8e63-47ec-8ab4-e29bc0b3d776 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:18.195676 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8c50c-8e63-47ec-8ab4-e29bc0b3d776 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:18.202791 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb22b4a-fa2e-468a-b602-3abde4aef57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:18.203438 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb22b4a-fa2e-468a-b602-3abde4aef57f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:18.203718 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb22b4a-fa2e-468a-b602-3abde4aef57f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:18.203994 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb22b4a-fa2e-468a-b602-3abde4aef57f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:18.204821 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb22b4a-fa2e-468a-b602-3abde4aef57f admin admin] RBAC: Adding query filter params (group.id=3e22d3b0492f44ff897b6fb32746b7bf, role.id=cf30e55f556b4e0cbee0317b16316b0f, scope.project.id=83908d6e37ad41e2882ed8f20923b274) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:18.205129 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb22b4a-fa2e-468a-b602-3abde4aef57f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:18.207036 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb22b4a-fa2e-468a-b602-3abde4aef57f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:18.219180 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 182/371] 10.222.0.42 () {56 vars in 1397 bytes} [Wed Feb 16 16:50:18 2022] GET /identity/v3/role_assignments?group.id=3e22d3b0492f44ff897b6fb32746b7bf&scope.project.id=83908d6e37ad41e2882ed8f20923b274&role.id=cf30e55f556b4e0cbee0317b16316b0f => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:18.297786 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80e011-b3ac-4c88-85bb-a320d81300c2 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:18.298232 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80e011-b3ac-4c88-85bb-a320d81300c2 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:18.298606 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80e011-b3ac-4c88-85bb-a320d81300c2 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:18.300775 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 190/372] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:18.306962 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9aae2e-b725-4634-8f17-b7ead214c059 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:18.307248 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9aae2e-b725-4634-8f17-b7ead214c059 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:18.307523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9aae2e-b725-4634-8f17-b7ead214c059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:18.335881 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-ce9aae2e-b725-4634-8f17-b7ead214c059 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:18.337222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-ce9aae2e-b725-4634-8f17-b7ead214c059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:18.345610 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 183/373] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:18.384697 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80e011-b3ac-4c88-85bb-a320d81300c2 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:18.397447 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80e011-b3ac-4c88-85bb-a320d81300c2 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:18.406638 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e440d1-7d9e-4016-b50d-c34595880db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:18.407491 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e440d1-7d9e-4016-b50d-c34595880db7 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:18.407819 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e440d1-7d9e-4016-b50d-c34595880db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:18.408093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e440d1-7d9e-4016-b50d-c34595880db7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:18.427551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e440d1-7d9e-4016-b50d-c34595880db7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:18.435428 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-79e440d1-7d9e-4016-b50d-c34595880db7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:50:18.436994 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 191/374] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:50:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:18.442636 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9aae2e-b725-4634-8f17-b7ead214c059 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:18.456067 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9aae2e-b725-4634-8f17-b7ead214c059 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:18.472011 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fd595-b8e2-4c5c-ac0a-1112284efc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:18.472700 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fd595-b8e2-4c5c-ac0a-1112284efc17 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:18.472981 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fd595-b8e2-4c5c-ac0a-1112284efc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:18.473256 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fd595-b8e2-4c5c-ac0a-1112284efc17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:18.474029 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fd595-b8e2-4c5c-ac0a-1112284efc17 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:18.474334 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fd595-b8e2-4c5c-ac0a-1112284efc17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:18.475957 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fd595-b8e2-4c5c-ac0a-1112284efc17 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:18.490948 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 184/375] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:18.497475 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e440d1-7d9e-4016-b50d-c34595880db7 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:18.509541 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e440d1-7d9e-4016-b50d-c34595880db7 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:18.517617 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ed617-08bf-46f0-8cbe-148f1aafbe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:18.518268 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ed617-08bf-46f0-8cbe-148f1aafbe72 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:18.518552 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ed617-08bf-46f0-8cbe-148f1aafbe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:18.518944 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ed617-08bf-46f0-8cbe-148f1aafbe72 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:18.537048 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ed617-08bf-46f0-8cbe-148f1aafbe72 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:18.540212 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ed617-08bf-46f0-8cbe-148f1aafbe72 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:18.554020 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 192/376] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:18.560319 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fd595-b8e2-4c5c-ac0a-1112284efc17 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:18.576245 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fd595-b8e2-4c5c-ac0a-1112284efc17 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:18.582397 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b56cb8-f396-4391-bfa9-edf33774f3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:18.583285 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b56cb8-f396-4391-bfa9-edf33774f3fd admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:18.583564 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b56cb8-f396-4391-bfa9-edf33774f3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:18.583837 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b56cb8-f396-4391-bfa9-edf33774f3fd admin admin] PATH_INFO: `/v3/projects/604997d855554910a2aa75344774960d` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:18.585036 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b56cb8-f396-4391-bfa9-edf33774f3fd admin admin] RBAC: Authorizing `identity:get_project(project_id=604997d855554910a2aa75344774960d)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:18.587399 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b56cb8-f396-4391-bfa9-edf33774f3fd admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:18.592287 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 185/377] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:18 2022] GET /identity/v3/projects/604997d855554910a2aa75344774960d => generated 344 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:18.595146 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ed617-08bf-46f0-8cbe-148f1aafbe72 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:18.609301 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ed617-08bf-46f0-8cbe-148f1aafbe72 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:18.620415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10031d-5157-43ec-98e3-9becca0b424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:18.621338 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10031d-5157-43ec-98e3-9becca0b424a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:18.621616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10031d-5157-43ec-98e3-9becca0b424a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:18.621988 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10031d-5157-43ec-98e3-9becca0b424a admin admin] PATH_INFO: `/v3/groups/301e8a2e37e4460ab6d6f95f857f0d17` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:18.635436 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10031d-5157-43ec-98e3-9becca0b424a admin admin] RBAC: Authorizing `identity:get_group(group_id=301e8a2e37e4460ab6d6f95f857f0d17)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:18.637469 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10031d-5157-43ec-98e3-9becca0b424a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:18.639555 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 193/378] 10.222.0.42 () {56 vars in 1201 bytes} [Wed Feb 16 16:50:18 2022] GET /identity/v3/groups/301e8a2e37e4460ab6d6f95f857f0d17 => generated 229 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:18.645402 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b56cb8-f396-4391-bfa9-edf33774f3fd admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:18.665634 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b56cb8-f396-4391-bfa9-edf33774f3fd admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:18.673852 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313c847-2c58-4882-865d-39a798d7b0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:18.674504 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313c847-2c58-4882-865d-39a798d7b0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:18.674823 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313c847-2c58-4882-865d-39a798d7b0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:18.675096 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313c847-2c58-4882-865d-39a798d7b0d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:18.675936 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313c847-2c58-4882-865d-39a798d7b0d0 admin admin] RBAC: Adding query filter params (group.id=301e8a2e37e4460ab6d6f95f857f0d17, role.id=8263a29ceeed4576b3b6959c99964ed7, scope.project.id=604997d855554910a2aa75344774960d) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:18.676249 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313c847-2c58-4882-865d-39a798d7b0d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:18.678072 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313c847-2c58-4882-865d-39a798d7b0d0 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:18.687147 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 186/379] 10.222.0.42 () {56 vars in 1397 bytes} [Wed Feb 16 16:50:18 2022] GET /identity/v3/role_assignments?group.id=301e8a2e37e4460ab6d6f95f857f0d17&scope.project.id=604997d855554910a2aa75344774960d&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 260 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:19.366807 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed6f81-8108-4816-8d0f-a2742b2102a0 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:19.368071 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed6f81-8108-4816-8d0f-a2742b2102a0 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:19.368071 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed6f81-8108-4816-8d0f-a2742b2102a0 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:19.370076 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 194/380] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:19.375310 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e2577-8d6b-4fc0-94e8-286005e18402 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:19.375817 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e2577-8d6b-4fc0-94e8-286005e18402 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:19.375969 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e2577-8d6b-4fc0-94e8-286005e18402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:19.395411 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-201e2577-8d6b-4fc0-94e8-286005e18402 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:19.396588 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-201e2577-8d6b-4fc0-94e8-286005e18402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:19.406357 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 187/381] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:19.441479 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed6f81-8108-4816-8d0f-a2742b2102a0 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:19.459554 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed6f81-8108-4816-8d0f-a2742b2102a0 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:19.464123 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ea1d5-4efe-4e20-bc2d-a4fefba00444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:19.464916 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ea1d5-4efe-4e20-bc2d-a4fefba00444 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:19.465197 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ea1d5-4efe-4e20-bc2d-a4fefba00444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:19.465479 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ea1d5-4efe-4e20-bc2d-a4fefba00444 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:19.476581 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ea1d5-4efe-4e20-bc2d-a4fefba00444 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:19.488229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-bc0ea1d5-4efe-4e20-bc2d-a4fefba00444 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 16:50:19.489849 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 195/382] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:19.495800 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e2577-8d6b-4fc0-94e8-286005e18402 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:19.504975 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e2577-8d6b-4fc0-94e8-286005e18402 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:19.514458 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdae070-d5cc-4287-97b5-21b75bcfcee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:19.515155 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdae070-d5cc-4287-97b5-21b75bcfcee8 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:19.515436 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdae070-d5cc-4287-97b5-21b75bcfcee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:19.515712 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdae070-d5cc-4287-97b5-21b75bcfcee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:19.516464 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdae070-d5cc-4287-97b5-21b75bcfcee8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:19.516771 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdae070-d5cc-4287-97b5-21b75bcfcee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:19.518341 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdae070-d5cc-4287-97b5-21b75bcfcee8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:19.536033 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 188/383] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:50:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:19.541369 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ea1d5-4efe-4e20-bc2d-a4fefba00444 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:19.553058 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ea1d5-4efe-4e20-bc2d-a4fefba00444 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:19.562743 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343b4a4-d57d-4a2d-9fc0-4f7e09b0da41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:19.563609 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343b4a4-d57d-4a2d-9fc0-4f7e09b0da41 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:19.563890 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343b4a4-d57d-4a2d-9fc0-4f7e09b0da41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:19.564176 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343b4a4-d57d-4a2d-9fc0-4f7e09b0da41 admin admin] PATH_INFO: `/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:19.565364 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343b4a4-d57d-4a2d-9fc0-4f7e09b0da41 admin admin] RBAC: Authorizing `identity:get_group(group_id=3e22d3b0492f44ff897b6fb32746b7bf)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:19.567309 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343b4a4-d57d-4a2d-9fc0-4f7e09b0da41 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:19.569329 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 196/384] 10.222.0.42 () {56 vars in 1201 bytes} [Wed Feb 16 16:50:19 2022] GET /identity/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:19.579222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdae070-d5cc-4287-97b5-21b75bcfcee8 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:19.593653 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdae070-d5cc-4287-97b5-21b75bcfcee8 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:19.598719 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09cf10-1e30-4d6e-8f1e-ecdc907105de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:19.599631 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09cf10-1e30-4d6e-8f1e-ecdc907105de admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:19.599912 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09cf10-1e30-4d6e-8f1e-ecdc907105de admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:19.600240 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09cf10-1e30-4d6e-8f1e-ecdc907105de admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:19.603184 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09cf10-1e30-4d6e-8f1e-ecdc907105de admin admin] RBAC: Authorizing `identity:get_project(project_id=0f8319abb808492e927f6f07504c63c5)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:19.605329 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09cf10-1e30-4d6e-8f1e-ecdc907105de admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:19.607483 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 189/385] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:19 2022] GET /identity/v3/projects/0f8319abb808492e927f6f07504c63c5 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:19.612932 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343b4a4-d57d-4a2d-9fc0-4f7e09b0da41 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:19.624046 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343b4a4-d57d-4a2d-9fc0-4f7e09b0da41 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:19.630517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c448dd7-01b2-485b-a0f4-0f916a23b87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:19.631562 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c448dd7-01b2-485b-a0f4-0f916a23b87a admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:19.631854 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c448dd7-01b2-485b-a0f4-0f916a23b87a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:19.632130 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c448dd7-01b2-485b-a0f4-0f916a23b87a admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5/groups/3e22d3b0492f44ff897b6fb32746b7bf/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:19.634829 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c448dd7-01b2-485b-a0f4-0f916a23b87a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f8319abb808492e927f6f07504c63c5, group_id=3e22d3b0492f44ff897b6fb32746b7bf, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:19.637628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c448dd7-01b2-485b-a0f4-0f916a23b87a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:19.714407 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 197/386] 10.222.0.42 () {58 vars in 1463 bytes} [Wed Feb 16 16:50:19 2022] PUT /identity/v3/projects/0f8319abb808492e927f6f07504c63c5/groups/3e22d3b0492f44ff897b6fb32746b7bf/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:50:19.837606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c715a-10bb-46fc-ac5a-3fb53efb7f80 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:19.837956 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c715a-10bb-46fc-ac5a-3fb53efb7f80 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:19.838154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c715a-10bb-46fc-ac5a-3fb53efb7f80 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:19.840404 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 190/387] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:19.845855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bf1af-6669-4fa6-ac00-da7b770026e0 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:19.846146 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bf1af-6669-4fa6-ac00-da7b770026e0 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:19.846425 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bf1af-6669-4fa6-ac00-da7b770026e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:19.872779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-7c2bf1af-6669-4fa6-ac00-da7b770026e0 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:19.874009 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-7c2bf1af-6669-4fa6-ac00-da7b770026e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:19.950963 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 198/388] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:19.988108 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c715a-10bb-46fc-ac5a-3fb53efb7f80 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:20.004186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c715a-10bb-46fc-ac5a-3fb53efb7f80 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:20.010926 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c54b56-fbfe-4a4b-86cc-92ad1ae3199c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:20.011733 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c54b56-fbfe-4a4b-86cc-92ad1ae3199c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:20.012012 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c54b56-fbfe-4a4b-86cc-92ad1ae3199c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:20.012286 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c54b56-fbfe-4a4b-86cc-92ad1ae3199c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:20.028277 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c54b56-fbfe-4a4b-86cc-92ad1ae3199c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:20.036885 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-36c54b56-fbfe-4a4b-86cc-92ad1ae3199c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 16:50:20.042771 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 191/389] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:50:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:20.044630 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bf1af-6669-4fa6-ac00-da7b770026e0 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:20.053835 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bf1af-6669-4fa6-ac00-da7b770026e0 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:20.059044 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b83ecf-cf2b-4a30-8c8e-79466641c291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:20.059757 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b83ecf-cf2b-4a30-8c8e-79466641c291 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:20.060035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b83ecf-cf2b-4a30-8c8e-79466641c291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:20.060304 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b83ecf-cf2b-4a30-8c8e-79466641c291 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:20.061109 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b83ecf-cf2b-4a30-8c8e-79466641c291 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:20.061412 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b83ecf-cf2b-4a30-8c8e-79466641c291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:20.063054 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b83ecf-cf2b-4a30-8c8e-79466641c291 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:20.073183 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 199/390] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:20.078781 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c54b56-fbfe-4a4b-86cc-92ad1ae3199c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:20.090380 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c54b56-fbfe-4a4b-86cc-92ad1ae3199c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:20.095013 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7492b9-937a-4f28-88b4-5590e89a02d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:20.095907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7492b9-937a-4f28-88b4-5590e89a02d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:20.096188 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7492b9-937a-4f28-88b4-5590e89a02d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:20.096462 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7492b9-937a-4f28-88b4-5590e89a02d2 admin admin] PATH_INFO: `/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:20.097691 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7492b9-937a-4f28-88b4-5590e89a02d2 admin admin] RBAC: Authorizing `identity:get_group(group_id=3e22d3b0492f44ff897b6fb32746b7bf)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:20.099711 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7492b9-937a-4f28-88b4-5590e89a02d2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:20.102928 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 192/391] 10.222.0.42 () {56 vars in 1201 bytes} [Wed Feb 16 16:50:20 2022] GET /identity/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:20.107890 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b83ecf-cf2b-4a30-8c8e-79466641c291 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:20.118288 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b83ecf-cf2b-4a30-8c8e-79466641c291 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:20.123200 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a284c-e8b5-49f5-b6c0-87baa1093892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:20.124112 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a284c-e8b5-49f5-b6c0-87baa1093892 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:20.124393 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a284c-e8b5-49f5-b6c0-87baa1093892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:20.124666 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a284c-e8b5-49f5-b6c0-87baa1093892 admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:20.125935 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a284c-e8b5-49f5-b6c0-87baa1093892 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f8319abb808492e927f6f07504c63c5)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:20.128235 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a284c-e8b5-49f5-b6c0-87baa1093892 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:20.134818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 200/392] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:20 2022] GET /identity/v3/projects/0f8319abb808492e927f6f07504c63c5 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:20.137749 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7492b9-937a-4f28-88b4-5590e89a02d2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:20.148358 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7492b9-937a-4f28-88b4-5590e89a02d2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:20.153704 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721a621-cf83-47bc-804a-716fdbb7728b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:20.154675 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721a621-cf83-47bc-804a-716fdbb7728b admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:20.154966 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721a621-cf83-47bc-804a-716fdbb7728b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:20.155237 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721a621-cf83-47bc-804a-716fdbb7728b admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5/groups/3e22d3b0492f44ff897b6fb32746b7bf/roles/cf30e55f556b4e0cbee0317b16316b0f` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:20.157742 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721a621-cf83-47bc-804a-716fdbb7728b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f8319abb808492e927f6f07504c63c5, group_id=3e22d3b0492f44ff897b6fb32746b7bf, role_id=cf30e55f556b4e0cbee0317b16316b0f)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:20.160631 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721a621-cf83-47bc-804a-716fdbb7728b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:20.239805 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 193/393] 10.222.0.42 () {58 vars in 1463 bytes} [Wed Feb 16 16:50:20 2022] PUT /identity/v3/projects/0f8319abb808492e927f6f07504c63c5/groups/3e22d3b0492f44ff897b6fb32746b7bf/roles/cf30e55f556b4e0cbee0317b16316b0f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:50:20.533454 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1395aec-f8b9-4af7-8beb-e2686024ede7 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:20.533912 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1395aec-f8b9-4af7-8beb-e2686024ede7 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:20.533990 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1395aec-f8b9-4af7-8beb-e2686024ede7 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:20.536164 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 201/394] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:20.542015 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb097cc-b94c-4391-9c6d-4e318d0a8619 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:20.542479 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb097cc-b94c-4391-9c6d-4e318d0a8619 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:20.542554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb097cc-b94c-4391-9c6d-4e318d0a8619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:20.571837 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-cfb097cc-b94c-4391-9c6d-4e318d0a8619 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:20.573088 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-cfb097cc-b94c-4391-9c6d-4e318d0a8619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:20.643711 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 194/395] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:20.673093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1395aec-f8b9-4af7-8beb-e2686024ede7 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:20.689690 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1395aec-f8b9-4af7-8beb-e2686024ede7 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:20.697631 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdc508-4787-4849-8e8a-0a32fee2f4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:20.698418 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdc508-4787-4849-8e8a-0a32fee2f4eb admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:20.698772 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdc508-4787-4849-8e8a-0a32fee2f4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:20.699049 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdc508-4787-4849-8e8a-0a32fee2f4eb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:20.712868 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdc508-4787-4849-8e8a-0a32fee2f4eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:20.719808 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-4fbdc508-4787-4849-8e8a-0a32fee2f4eb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 16:50:20.721383 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 202/396] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:20.727823 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb097cc-b94c-4391-9c6d-4e318d0a8619 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:20.740622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb097cc-b94c-4391-9c6d-4e318d0a8619 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:20.750927 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee4c7b-8254-4de8-a20e-6cc991b2f39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:20.754254 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee4c7b-8254-4de8-a20e-6cc991b2f39f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:20.754254 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee4c7b-8254-4de8-a20e-6cc991b2f39f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:20.754254 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee4c7b-8254-4de8-a20e-6cc991b2f39f admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:20.754254 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee4c7b-8254-4de8-a20e-6cc991b2f39f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:20.754254 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee4c7b-8254-4de8-a20e-6cc991b2f39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:20.754840 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee4c7b-8254-4de8-a20e-6cc991b2f39f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:20.772367 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 195/397] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:50:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:20.778454 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdc508-4787-4849-8e8a-0a32fee2f4eb admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:20.791843 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdc508-4787-4849-8e8a-0a32fee2f4eb admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:20.802847 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc83c56-5793-4b4d-a587-4e952a584ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:20.803711 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc83c56-5793-4b4d-a587-4e952a584ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:20.804000 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc83c56-5793-4b4d-a587-4e952a584ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:20.804260 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc83c56-5793-4b4d-a587-4e952a584ff6 admin admin] PATH_INFO: `/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:20.811417 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc83c56-5793-4b4d-a587-4e952a584ff6 admin admin] RBAC: Authorizing `identity:get_group(group_id=3e22d3b0492f44ff897b6fb32746b7bf)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:20.813336 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc83c56-5793-4b4d-a587-4e952a584ff6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:20.815298 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 203/398] 10.222.0.42 () {56 vars in 1201 bytes} [Wed Feb 16 16:50:20 2022] GET /identity/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:20.821815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee4c7b-8254-4de8-a20e-6cc991b2f39f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:20.847611 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee4c7b-8254-4de8-a20e-6cc991b2f39f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:20.856485 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c936501-bc8f-4fa2-9577-d04ce42d0f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:20.857657 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c936501-bc8f-4fa2-9577-d04ce42d0f0d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:20.857939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c936501-bc8f-4fa2-9577-d04ce42d0f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:20.858263 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c936501-bc8f-4fa2-9577-d04ce42d0f0d admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:20.859545 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c936501-bc8f-4fa2-9577-d04ce42d0f0d admin admin] RBAC: Authorizing `identity:get_project(project_id=83908d6e37ad41e2882ed8f20923b274)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:20.861755 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c936501-bc8f-4fa2-9577-d04ce42d0f0d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:20.863695 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 196/399] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:20 2022] GET /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:20.869349 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc83c56-5793-4b4d-a587-4e952a584ff6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:20.890622 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc83c56-5793-4b4d-a587-4e952a584ff6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:20.899911 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d6289-3873-4ef5-adc8-7d8d2d83fbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:20.900824 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d6289-3873-4ef5-adc8-7d8d2d83fbbf admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:20.901101 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d6289-3873-4ef5-adc8-7d8d2d83fbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:20.901380 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d6289-3873-4ef5-adc8-7d8d2d83fbbf admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274/groups/3e22d3b0492f44ff897b6fb32746b7bf/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:20.908472 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d6289-3873-4ef5-adc8-7d8d2d83fbbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=83908d6e37ad41e2882ed8f20923b274, group_id=3e22d3b0492f44ff897b6fb32746b7bf, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:20.912055 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d6289-3873-4ef5-adc8-7d8d2d83fbbf admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:21.016089 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 204/400] 10.222.0.42 () {58 vars in 1463 bytes} [Wed Feb 16 16:50:20 2022] PUT /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274/groups/3e22d3b0492f44ff897b6fb32746b7bf/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:50:21.295574 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411d2fa-1f82-491c-9907-281c43178c28 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:21.295955 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411d2fa-1f82-491c-9907-281c43178c28 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:21.296129 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411d2fa-1f82-491c-9907-281c43178c28 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:21.298282 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 197/401] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:21.305232 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df5067-bce7-4006-8b8f-5ec23c5d7d14 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:21.305733 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df5067-bce7-4006-8b8f-5ec23c5d7d14 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:21.306163 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df5067-bce7-4006-8b8f-5ec23c5d7d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:21.331789 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-b7df5067-bce7-4006-8b8f-5ec23c5d7d14 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:21.333020 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-b7df5067-bce7-4006-8b8f-5ec23c5d7d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:21.403420 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 205/402] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:21.431462 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411d2fa-1f82-491c-9907-281c43178c28 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:21.444805 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411d2fa-1f82-491c-9907-281c43178c28 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:21.449919 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed38196-aa27-490d-8155-c1eb606c8431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:21.450822 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed38196-aa27-490d-8155-c1eb606c8431 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:21.451115 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed38196-aa27-490d-8155-c1eb606c8431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:21.451386 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed38196-aa27-490d-8155-c1eb606c8431 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:21.464403 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed38196-aa27-490d-8155-c1eb606c8431 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:21.472003 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-eed38196-aa27-490d-8155-c1eb606c8431 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 16:50:21.473653 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 198/403] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:50:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:21.483010 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df5067-bce7-4006-8b8f-5ec23c5d7d14 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:21.490171 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df5067-bce7-4006-8b8f-5ec23c5d7d14 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:21.495219 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f80fe-bba7-452c-aea8-df5bd346a5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:21.495883 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f80fe-bba7-452c-aea8-df5bd346a5af admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:21.496153 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f80fe-bba7-452c-aea8-df5bd346a5af admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:21.496422 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f80fe-bba7-452c-aea8-df5bd346a5af admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:21.497227 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f80fe-bba7-452c-aea8-df5bd346a5af admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:21.497535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f80fe-bba7-452c-aea8-df5bd346a5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:21.499195 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f80fe-bba7-452c-aea8-df5bd346a5af admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:21.509282 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 206/404] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:21.514756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed38196-aa27-490d-8155-c1eb606c8431 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:21.526384 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed38196-aa27-490d-8155-c1eb606c8431 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:21.535415 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907d3b2-656b-43ff-a960-93fa15208d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:21.536323 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907d3b2-656b-43ff-a960-93fa15208d03 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:21.536599 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907d3b2-656b-43ff-a960-93fa15208d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:21.536930 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907d3b2-656b-43ff-a960-93fa15208d03 admin admin] PATH_INFO: `/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:21.538143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907d3b2-656b-43ff-a960-93fa15208d03 admin admin] RBAC: Authorizing `identity:get_group(group_id=3e22d3b0492f44ff897b6fb32746b7bf)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:21.541332 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907d3b2-656b-43ff-a960-93fa15208d03 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:21.543530 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 199/405] 10.222.0.42 () {56 vars in 1201 bytes} [Wed Feb 16 16:50:21 2022] GET /identity/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:21.549301 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f80fe-bba7-452c-aea8-df5bd346a5af admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:21.559663 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f80fe-bba7-452c-aea8-df5bd346a5af admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:21.564263 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2e6ab-ee6b-4f94-b45f-8175c9b65b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:21.565114 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2e6ab-ee6b-4f94-b45f-8175c9b65b72 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:21.565443 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2e6ab-ee6b-4f94-b45f-8175c9b65b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:21.565712 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2e6ab-ee6b-4f94-b45f-8175c9b65b72 admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:21.567089 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2e6ab-ee6b-4f94-b45f-8175c9b65b72 admin admin] RBAC: Authorizing `identity:get_project(project_id=83908d6e37ad41e2882ed8f20923b274)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:21.569445 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2e6ab-ee6b-4f94-b45f-8175c9b65b72 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:21.572048 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 207/406] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:21 2022] GET /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:21.577977 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907d3b2-656b-43ff-a960-93fa15208d03 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:21.589847 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907d3b2-656b-43ff-a960-93fa15208d03 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:21.594552 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea952a-55e7-4f4a-8c6b-52fc440c330b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:21.596259 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea952a-55e7-4f4a-8c6b-52fc440c330b admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:21.596512 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea952a-55e7-4f4a-8c6b-52fc440c330b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:21.596779 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea952a-55e7-4f4a-8c6b-52fc440c330b admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274/groups/3e22d3b0492f44ff897b6fb32746b7bf/roles/cf30e55f556b4e0cbee0317b16316b0f` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:21.600524 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea952a-55e7-4f4a-8c6b-52fc440c330b admin admin] RBAC: Authorizing `identity:create_grant(project_id=83908d6e37ad41e2882ed8f20923b274, group_id=3e22d3b0492f44ff897b6fb32746b7bf, role_id=cf30e55f556b4e0cbee0317b16316b0f)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:21.603298 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea952a-55e7-4f4a-8c6b-52fc440c330b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:21.683737 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 200/407] 10.222.0.42 () {58 vars in 1463 bytes} [Wed Feb 16 16:50:21 2022] PUT /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274/groups/3e22d3b0492f44ff897b6fb32746b7bf/roles/cf30e55f556b4e0cbee0317b16316b0f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:50:21.735497 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e4ae5-c284-4f86-8280-9ce1bd11dad9 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:21.736167 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e4ae5-c284-4f86-8280-9ce1bd11dad9 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:21.736682 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e4ae5-c284-4f86-8280-9ce1bd11dad9 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:21.739293 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 208/408] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:50:21.748209 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefce769-5a12-464d-a316-186dee49ee5f None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:21.748491 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefce769-5a12-464d-a316-186dee49ee5f None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:21.748760 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefce769-5a12-464d-a316-186dee49ee5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:21.779622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-fefce769-5a12-464d-a316-186dee49ee5f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:21.780854 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-fefce769-5a12-464d-a316-186dee49ee5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:21.867165 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 201/409] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:50:21.912254 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e4ae5-c284-4f86-8280-9ce1bd11dad9 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:21.926658 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e4ae5-c284-4f86-8280-9ce1bd11dad9 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:21.932904 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634ea4a-9e4d-4d81-bada-3ba8bd96daaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:21.933686 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634ea4a-9e4d-4d81-bada-3ba8bd96daaa admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:21.933964 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634ea4a-9e4d-4d81-bada-3ba8bd96daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:21.934236 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634ea4a-9e4d-4d81-bada-3ba8bd96daaa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:21.951177 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634ea4a-9e4d-4d81-bada-3ba8bd96daaa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:21.958184 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-e634ea4a-9e4d-4d81-bada-3ba8bd96daaa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:50:21.964646 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 209/410] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:50:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:21.966048 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefce769-5a12-464d-a316-186dee49ee5f None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:21.975534 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefce769-5a12-464d-a316-186dee49ee5f None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:21.981984 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af9bf4-b191-4a6e-8913-1d88245eebb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:21.982717 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af9bf4-b191-4a6e-8913-1d88245eebb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:21.983047 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af9bf4-b191-4a6e-8913-1d88245eebb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:21.983318 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af9bf4-b191-4a6e-8913-1d88245eebb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:21.984072 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af9bf4-b191-4a6e-8913-1d88245eebb1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:21.984372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af9bf4-b191-4a6e-8913-1d88245eebb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:21.986071 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af9bf4-b191-4a6e-8913-1d88245eebb1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:21.999321 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 202/411] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:22.004954 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634ea4a-9e4d-4d81-bada-3ba8bd96daaa admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:22.016764 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634ea4a-9e4d-4d81-bada-3ba8bd96daaa admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:22.024446 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce5792-c89f-4afe-b433-c38a567a36fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:22.025562 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce5792-c89f-4afe-b433-c38a567a36fe admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:22.025845 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce5792-c89f-4afe-b433-c38a567a36fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:22.026116 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce5792-c89f-4afe-b433-c38a567a36fe admin admin] PATH_INFO: `/v3/groups/301e8a2e37e4460ab6d6f95f857f0d17` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:22.028108 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce5792-c89f-4afe-b433-c38a567a36fe admin admin] RBAC: Authorizing `identity:get_group(group_id=301e8a2e37e4460ab6d6f95f857f0d17)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:22.030065 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce5792-c89f-4afe-b433-c38a567a36fe admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:22.032181 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 210/412] 10.222.0.42 () {56 vars in 1201 bytes} [Wed Feb 16 16:50:22 2022] GET /identity/v3/groups/301e8a2e37e4460ab6d6f95f857f0d17 => generated 229 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:22.037804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af9bf4-b191-4a6e-8913-1d88245eebb1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:22.049050 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af9bf4-b191-4a6e-8913-1d88245eebb1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:22.055276 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33821010-a079-48bb-b2ee-7121d6b32447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:22.056406 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33821010-a079-48bb-b2ee-7121d6b32447 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:22.056681 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33821010-a079-48bb-b2ee-7121d6b32447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:22.056962 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33821010-a079-48bb-b2ee-7121d6b32447 admin admin] PATH_INFO: `/v3/projects/604997d855554910a2aa75344774960d` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:22.063441 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33821010-a079-48bb-b2ee-7121d6b32447 admin admin] RBAC: Authorizing `identity:get_project(project_id=604997d855554910a2aa75344774960d)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:22.065439 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33821010-a079-48bb-b2ee-7121d6b32447 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:22.067266 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 203/413] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:22 2022] GET /identity/v3/projects/604997d855554910a2aa75344774960d => generated 344 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:22.073691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce5792-c89f-4afe-b433-c38a567a36fe admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:22.084154 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce5792-c89f-4afe-b433-c38a567a36fe admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:22.091035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4bbaa-00f1-48dd-9de9-d550741c0326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:22.091961 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4bbaa-00f1-48dd-9de9-d550741c0326 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:22.092237 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4bbaa-00f1-48dd-9de9-d550741c0326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:22.092564 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4bbaa-00f1-48dd-9de9-d550741c0326 admin admin] PATH_INFO: `/v3/projects/604997d855554910a2aa75344774960d/groups/301e8a2e37e4460ab6d6f95f857f0d17/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:22.095814 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4bbaa-00f1-48dd-9de9-d550741c0326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=604997d855554910a2aa75344774960d, group_id=301e8a2e37e4460ab6d6f95f857f0d17, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:22.098560 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4bbaa-00f1-48dd-9de9-d550741c0326 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:22.175073 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 211/414] 10.222.0.42 () {58 vars in 1463 bytes} [Wed Feb 16 16:50:22 2022] PUT /identity/v3/projects/604997d855554910a2aa75344774960d/groups/301e8a2e37e4460ab6d6f95f857f0d17/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:50:23.245189 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd2c5f-085f-41a6-85ef-416ccfae62ef None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:23.245878 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd2c5f-085f-41a6-85ef-416ccfae62ef None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:23.245878 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd2c5f-085f-41a6-85ef-416ccfae62ef None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:23.247790 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 204/415] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:23.253532 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384742b-f4a5-4450-84d7-02bc5b7540eb None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:23.254038 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384742b-f4a5-4450-84d7-02bc5b7540eb None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:23.254187 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384742b-f4a5-4450-84d7-02bc5b7540eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:23.279182 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-0384742b-f4a5-4450-84d7-02bc5b7540eb None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:23.280401 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0384742b-f4a5-4450-84d7-02bc5b7540eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:23.329128 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fea137-6c90-4a9b-8cfa-72c3e6f2eeac None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:23.329755 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fea137-6c90-4a9b-8cfa-72c3e6f2eeac None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:23.330233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fea137-6c90-4a9b-8cfa-72c3e6f2eeac None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:23.332507 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 205/416] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:23.338674 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2c7ad-0429-4fa9-8aab-fe9a35c19b88 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:23.339249 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2c7ad-0429-4fa9-8aab-fe9a35c19b88 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:23.339749 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2c7ad-0429-4fa9-8aab-fe9a35c19b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:23.368598 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 212/417] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:50:23.383703 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-2dc2c7ad-0429-4fa9-8aab-fe9a35c19b88 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:23.384912 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-2dc2c7ad-0429-4fa9-8aab-fe9a35c19b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:23.393334 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384742b-f4a5-4450-84d7-02bc5b7540eb None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:23.397173 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 206/418] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:50:23.403763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384742b-f4a5-4450-84d7-02bc5b7540eb None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:23.415829 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c71b6f-1448-4a04-8da5-be53f36a5028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:23.416644 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c71b6f-1448-4a04-8da5-be53f36a5028 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:23.416921 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c71b6f-1448-4a04-8da5-be53f36a5028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:23.417193 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c71b6f-1448-4a04-8da5-be53f36a5028 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:23.424211 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2c7ad-0429-4fa9-8aab-fe9a35c19b88 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:23.438664 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2c7ad-0429-4fa9-8aab-fe9a35c19b88 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:23.440564 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c71b6f-1448-4a04-8da5-be53f36a5028 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:23.447929 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-03c71b6f-1448-4a04-8da5-be53f36a5028 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 16:50:23.449170 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 213/419] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:23.457698 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea2e33-5055-4846-99f2-400a93c5162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:23.458517 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea2e33-5055-4846-99f2-400a93c5162e admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:23.458825 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea2e33-5055-4846-99f2-400a93c5162e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:23.459096 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea2e33-5055-4846-99f2-400a93c5162e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:23.459859 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c71b6f-1448-4a04-8da5-be53f36a5028 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:23.471151 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea2e33-5055-4846-99f2-400a93c5162e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:23.475721 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c71b6f-1448-4a04-8da5-be53f36a5028 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:23.480277 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-06ea2e33-5055-4846-99f2-400a93c5162e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 16:50:23.482274 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 207/420] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:50:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:23.488067 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea2e33-5055-4846-99f2-400a93c5162e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:23.488311 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5440002-3dc1-450c-94bc-c2d9b451e1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:23.488985 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5440002-3dc1-450c-94bc-c2d9b451e1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:23.489267 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5440002-3dc1-450c-94bc-c2d9b451e1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:23.489539 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5440002-3dc1-450c-94bc-c2d9b451e1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:23.490286 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5440002-3dc1-450c-94bc-c2d9b451e1f7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:23.490592 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5440002-3dc1-450c-94bc-c2d9b451e1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:23.492291 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5440002-3dc1-450c-94bc-c2d9b451e1f7 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:23.498117 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea2e33-5055-4846-99f2-400a93c5162e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:23.502418 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1080e10-7a7f-47d1-a7fb-8c285b4759fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:23.503243 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1080e10-7a7f-47d1-a7fb-8c285b4759fd admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:23.503524 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1080e10-7a7f-47d1-a7fb-8c285b4759fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:23.503793 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1080e10-7a7f-47d1-a7fb-8c285b4759fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:23.504720 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1080e10-7a7f-47d1-a7fb-8c285b4759fd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:23.505032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1080e10-7a7f-47d1-a7fb-8c285b4759fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:23.506612 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1080e10-7a7f-47d1-a7fb-8c285b4759fd admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:23.510618 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 214/421] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:50:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:23.516640 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5440002-3dc1-450c-94bc-c2d9b451e1f7 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:23.518460 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 208/422] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:23.532977 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1080e10-7a7f-47d1-a7fb-8c285b4759fd admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:23.543088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5440002-3dc1-450c-94bc-c2d9b451e1f7 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:23.544522 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1080e10-7a7f-47d1-a7fb-8c285b4759fd admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:23.552086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c02f1c-d87c-42a1-aa29-2a660752783e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:23.553478 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257e5c2-776b-4b4e-bfdf-e94abf32caeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:23.554120 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257e5c2-776b-4b4e-bfdf-e94abf32caeb admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:23.554398 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257e5c2-776b-4b4e-bfdf-e94abf32caeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:23.554737 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257e5c2-776b-4b4e-bfdf-e94abf32caeb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:23.555815 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c02f1c-d87c-42a1-aa29-2a660752783e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:23.556085 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c02f1c-d87c-42a1-aa29-2a660752783e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:23.556347 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c02f1c-d87c-42a1-aa29-2a660752783e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:23.571155 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c02f1c-d87c-42a1-aa29-2a660752783e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:23.573102 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c02f1c-d87c-42a1-aa29-2a660752783e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:23.578988 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257e5c2-776b-4b4e-bfdf-e94abf32caeb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:23.579621 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257e5c2-776b-4b4e-bfdf-e94abf32caeb admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:23.591476 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 215/423] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 16:50:23.597781 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 209/424] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:23.600732 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c02f1c-d87c-42a1-aa29-2a660752783e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:23.603562 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257e5c2-776b-4b4e-bfdf-e94abf32caeb admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:23.616988 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257e5c2-776b-4b4e-bfdf-e94abf32caeb admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:23.618222 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c02f1c-d87c-42a1-aa29-2a660752783e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:23.622928 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce8c4d-4d37-4de4-8786-42d00fa2b733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:23.623785 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce8c4d-4d37-4de4-8786-42d00fa2b733 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:23.624108 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce8c4d-4d37-4de4-8786-42d00fa2b733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:23.624488 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce8c4d-4d37-4de4-8786-42d00fa2b733 admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:23.625946 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce8c4d-4d37-4de4-8786-42d00fa2b733 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f8319abb808492e927f6f07504c63c5)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:23.631802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce8c4d-4d37-4de4-8786-42d00fa2b733 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:23.632150 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bc969-be48-491d-ba5a-367580188f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:23.633616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bc969-be48-491d-ba5a-367580188f10 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:23.634059 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bc969-be48-491d-ba5a-367580188f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:23.634410 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 210/425] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:23 2022] GET /identity/v3/projects/0f8319abb808492e927f6f07504c63c5 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:23.634700 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bc969-be48-491d-ba5a-367580188f10 admin admin] PATH_INFO: `/v3/projects/0f8319abb808492e927f6f07504c63c5` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:23.639586 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bc969-be48-491d-ba5a-367580188f10 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f8319abb808492e927f6f07504c63c5)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:23.640102 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce8c4d-4d37-4de4-8786-42d00fa2b733 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:23.641639 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bc969-be48-491d-ba5a-367580188f10 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:23.647874 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 216/426] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:23 2022] GET /identity/v3/projects/0f8319abb808492e927f6f07504c63c5 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:23.650073 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce8c4d-4d37-4de4-8786-42d00fa2b733 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:23.653949 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bc969-be48-491d-ba5a-367580188f10 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:23.656127 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eeab2d-0353-4630-9795-ca5c0079340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:23.656975 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeab2d-0353-4630-9795-ca5c0079340d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:23.657248 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeab2d-0353-4630-9795-ca5c0079340d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:23.657517 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeab2d-0353-4630-9795-ca5c0079340d admin admin] PATH_INFO: `/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:23.658705 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eeab2d-0353-4630-9795-ca5c0079340d admin admin] RBAC: Authorizing `identity:get_group(group_id=3e22d3b0492f44ff897b6fb32746b7bf)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:23.663140 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eeab2d-0353-4630-9795-ca5c0079340d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:23.665665 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bc969-be48-491d-ba5a-367580188f10 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:23.669759 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 211/427] 10.222.0.42 () {56 vars in 1201 bytes} [Wed Feb 16 16:50:23 2022] GET /identity/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:23.672042 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eeab2d-0353-4630-9795-ca5c0079340d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:23.681483 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c80d99-5c51-4b76-8fcd-aee6548c53a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:23.682418 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c80d99-5c51-4b76-8fcd-aee6548c53a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:23.682730 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c80d99-5c51-4b76-8fcd-aee6548c53a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:23.683049 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c80d99-5c51-4b76-8fcd-aee6548c53a4 admin admin] PATH_INFO: `/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:23.685540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eeab2d-0353-4630-9795-ca5c0079340d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:23.687565 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c80d99-5c51-4b76-8fcd-aee6548c53a4 admin admin] RBAC: Authorizing `identity:get_group(group_id=3e22d3b0492f44ff897b6fb32746b7bf)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:23.689750 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c80d99-5c51-4b76-8fcd-aee6548c53a4 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:23.690118 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc6c27-1487-425f-bb74-f2f3ab393cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:23.690820 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc6c27-1487-425f-bb74-f2f3ab393cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:23.691100 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc6c27-1487-425f-bb74-f2f3ab393cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:23.691372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc6c27-1487-425f-bb74-f2f3ab393cd4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:23.692275 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc6c27-1487-425f-bb74-f2f3ab393cd4 admin admin] RBAC: Adding query filter params (group.id=3e22d3b0492f44ff897b6fb32746b7bf, role.id=cf30e55f556b4e0cbee0317b16316b0f, scope.project.id=0f8319abb808492e927f6f07504c63c5) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:23.692591 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc6c27-1487-425f-bb74-f2f3ab393cd4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:23.693049 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 217/428] 10.222.0.42 () {56 vars in 1201 bytes} [Wed Feb 16 16:50:23 2022] GET /identity/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:23.694450 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc6c27-1487-425f-bb74-f2f3ab393cd4 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:23.699196 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c80d99-5c51-4b76-8fcd-aee6548c53a4 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:23.702732 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 212/429] 10.222.0.42 () {56 vars in 1397 bytes} [Wed Feb 16 16:50:23 2022] GET /identity/v3/role_assignments?group.id=3e22d3b0492f44ff897b6fb32746b7bf&scope.project.id=0f8319abb808492e927f6f07504c63c5&role.id=cf30e55f556b4e0cbee0317b16316b0f => generated 611 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:23.710419 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c80d99-5c51-4b76-8fcd-aee6548c53a4 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:23.722507 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69345c78-adc8-4944-b2c0-b96881120c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:23.723251 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69345c78-adc8-4944-b2c0-b96881120c28 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:23.723535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69345c78-adc8-4944-b2c0-b96881120c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:23.723857 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69345c78-adc8-4944-b2c0-b96881120c28 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:23.724711 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69345c78-adc8-4944-b2c0-b96881120c28 admin admin] RBAC: Adding query filter params (group.id=3e22d3b0492f44ff897b6fb32746b7bf, role.id=d361c0606e4646d3afa601176d0422ec, scope.project.id=0f8319abb808492e927f6f07504c63c5) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:23.725075 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69345c78-adc8-4944-b2c0-b96881120c28 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:23.727895 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69345c78-adc8-4944-b2c0-b96881120c28 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:23.744790 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 218/430] 10.222.0.42 () {56 vars in 1397 bytes} [Wed Feb 16 16:50:23 2022] GET /identity/v3/role_assignments?group.id=3e22d3b0492f44ff897b6fb32746b7bf&scope.project.id=0f8319abb808492e927f6f07504c63c5&role.id=d361c0606e4646d3afa601176d0422ec => generated 611 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:24.080779 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4046eb-d21a-41b1-b50c-d2f23d12f2b3 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:24.081048 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4046eb-d21a-41b1-b50c-d2f23d12f2b3 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:24.081326 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4046eb-d21a-41b1-b50c-d2f23d12f2b3 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:24.083937 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 213/431] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:24.089927 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfacc57-c4f3-4f5d-a67b-4951709abf86 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:24.090239 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfacc57-c4f3-4f5d-a67b-4951709abf86 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:24.090545 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfacc57-c4f3-4f5d-a67b-4951709abf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:24.111528 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-ebfacc57-c4f3-4f5d-a67b-4951709abf86 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:24.112729 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-ebfacc57-c4f3-4f5d-a67b-4951709abf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:24.123570 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 219/432] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:24.150368 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4046eb-d21a-41b1-b50c-d2f23d12f2b3 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:24.166062 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4046eb-d21a-41b1-b50c-d2f23d12f2b3 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:24.170996 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f442cba-c82f-4653-8ea3-1e1fd990b90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:24.171809 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f442cba-c82f-4653-8ea3-1e1fd990b90e admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:24.172083 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f442cba-c82f-4653-8ea3-1e1fd990b90e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:24.172352 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f442cba-c82f-4653-8ea3-1e1fd990b90e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:24.185235 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f442cba-c82f-4653-8ea3-1e1fd990b90e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:24.192642 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-0f442cba-c82f-4653-8ea3-1e1fd990b90e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 16:50:24.194167 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 214/433] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:24.200203 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfacc57-c4f3-4f5d-a67b-4951709abf86 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:24.210242 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfacc57-c4f3-4f5d-a67b-4951709abf86 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:24.216811 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde8938-7609-4013-8d0a-3cacb98b42ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:24.217487 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde8938-7609-4013-8d0a-3cacb98b42ae admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:24.217770 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde8938-7609-4013-8d0a-3cacb98b42ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:24.218045 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde8938-7609-4013-8d0a-3cacb98b42ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:24.219014 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde8938-7609-4013-8d0a-3cacb98b42ae admin admin] RBAC: Adding query filter params (name=member) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:24.219332 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde8938-7609-4013-8d0a-3cacb98b42ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:24.220917 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde8938-7609-4013-8d0a-3cacb98b42ae admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:24.231191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 220/434] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:50:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:24.237471 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f442cba-c82f-4653-8ea3-1e1fd990b90e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:24.249432 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f442cba-c82f-4653-8ea3-1e1fd990b90e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:24.254137 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bca9b-8493-41b6-a476-cf9261039666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:24.254828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bca9b-8493-41b6-a476-cf9261039666 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:24.255111 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bca9b-8493-41b6-a476-cf9261039666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:24.255385 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bca9b-8493-41b6-a476-cf9261039666 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:24.263973 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bca9b-8493-41b6-a476-cf9261039666 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:24.265731 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bca9b-8493-41b6-a476-cf9261039666 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:24.276331 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 215/435] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:24.282047 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde8938-7609-4013-8d0a-3cacb98b42ae admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:24.293677 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde8938-7609-4013-8d0a-3cacb98b42ae admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:24.298637 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e558463-0c99-4598-b2da-8566e842061f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:24.298637 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e558463-0c99-4598-b2da-8566e842061f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:24.298637 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e558463-0c99-4598-b2da-8566e842061f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:24.298637 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e558463-0c99-4598-b2da-8566e842061f admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:24.302557 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e558463-0c99-4598-b2da-8566e842061f admin admin] RBAC: Authorizing `identity:get_project(project_id=83908d6e37ad41e2882ed8f20923b274)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:24.304790 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e558463-0c99-4598-b2da-8566e842061f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:24.306745 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 221/436] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:24 2022] GET /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:24.312719 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bca9b-8493-41b6-a476-cf9261039666 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:24.322510 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bca9b-8493-41b6-a476-cf9261039666 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:24.327781 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083b53f-3603-4466-8356-0495b2e792be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:24.328965 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083b53f-3603-4466-8356-0495b2e792be admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:24.329533 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083b53f-3603-4466-8356-0495b2e792be admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:24.330011 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083b53f-3603-4466-8356-0495b2e792be admin admin] PATH_INFO: `/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:24.331533 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083b53f-3603-4466-8356-0495b2e792be admin admin] RBAC: Authorizing `identity:get_group(group_id=3e22d3b0492f44ff897b6fb32746b7bf)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:24.333798 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083b53f-3603-4466-8356-0495b2e792be admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:24.335758 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 216/437] 10.222.0.42 () {56 vars in 1201 bytes} [Wed Feb 16 16:50:24 2022] GET /identity/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:24.342892 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e558463-0c99-4598-b2da-8566e842061f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:24.355079 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e558463-0c99-4598-b2da-8566e842061f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:24.360691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc7fb6-29dd-48ee-adcf-406344224c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:24.361781 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc7fb6-29dd-48ee-adcf-406344224c97 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:24.362271 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc7fb6-29dd-48ee-adcf-406344224c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:24.362842 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc7fb6-29dd-48ee-adcf-406344224c97 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:24.363900 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc7fb6-29dd-48ee-adcf-406344224c97 admin admin] RBAC: Adding query filter params (group.id=3e22d3b0492f44ff897b6fb32746b7bf, role.id=d361c0606e4646d3afa601176d0422ec, scope.project.id=83908d6e37ad41e2882ed8f20923b274) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:24.364527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc7fb6-29dd-48ee-adcf-406344224c97 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:24.366880 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc7fb6-29dd-48ee-adcf-406344224c97 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:24.374621 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 222/438] 10.222.0.42 () {56 vars in 1397 bytes} [Wed Feb 16 16:50:24 2022] GET /identity/v3/role_assignments?group.id=3e22d3b0492f44ff897b6fb32746b7bf&scope.project.id=83908d6e37ad41e2882ed8f20923b274&role.id=d361c0606e4646d3afa601176d0422ec => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:24.723146 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d29a9b-0ff9-4984-9121-89ac97550b86 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:24.723444 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d29a9b-0ff9-4984-9121-89ac97550b86 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:24.723708 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d29a9b-0ff9-4984-9121-89ac97550b86 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:24.725476 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 217/439] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:24.731008 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcafac-798b-4d75-b40b-f3b558662f83 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:24.731296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcafac-798b-4d75-b40b-f3b558662f83 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:24.731818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcafac-798b-4d75-b40b-f3b558662f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:24.750366 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-f6fcafac-798b-4d75-b40b-f3b558662f83 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:24.751753 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f6fcafac-798b-4d75-b40b-f3b558662f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:24.760396 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 223/440] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:24.784792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d29a9b-0ff9-4984-9121-89ac97550b86 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:24.797340 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d29a9b-0ff9-4984-9121-89ac97550b86 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:24.801608 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd03b0-7135-4213-8d82-576b1c9184b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:24.802399 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd03b0-7135-4213-8d82-576b1c9184b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:24.802767 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd03b0-7135-4213-8d82-576b1c9184b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:24.803043 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd03b0-7135-4213-8d82-576b1c9184b5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:24.815764 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd03b0-7135-4213-8d82-576b1c9184b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:24.823781 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-e5bd03b0-7135-4213-8d82-576b1c9184b5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 16:50:24.825303 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 218/441] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:50:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:24.830820 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcafac-798b-4d75-b40b-f3b558662f83 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:24.841693 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcafac-798b-4d75-b40b-f3b558662f83 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:24.846421 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe8a6e-6214-4500-b5a9-40360f4db411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:24.847157 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe8a6e-6214-4500-b5a9-40360f4db411 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:24.847438 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe8a6e-6214-4500-b5a9-40360f4db411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:24.847711 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe8a6e-6214-4500-b5a9-40360f4db411 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:24.848461 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe8a6e-6214-4500-b5a9-40360f4db411 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:24.849566 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe8a6e-6214-4500-b5a9-40360f4db411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:24.852978 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe8a6e-6214-4500-b5a9-40360f4db411 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:24.861009 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 224/442] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:24.866315 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd03b0-7135-4213-8d82-576b1c9184b5 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:24.877079 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd03b0-7135-4213-8d82-576b1c9184b5 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:24.882401 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde2dc7-4699-45a1-af33-e4eb479f551a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:24.883823 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde2dc7-4699-45a1-af33-e4eb479f551a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:24.884096 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde2dc7-4699-45a1-af33-e4eb479f551a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:24.884370 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde2dc7-4699-45a1-af33-e4eb479f551a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:24.893186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde2dc7-4699-45a1-af33-e4eb479f551a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:24.895158 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde2dc7-4699-45a1-af33-e4eb479f551a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:24.904542 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 219/443] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:24.909953 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe8a6e-6214-4500-b5a9-40360f4db411 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:24.920121 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe8a6e-6214-4500-b5a9-40360f4db411 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:24.926621 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ec5ed-c6f6-4b00-83a9-2cd4ead7084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:24.927523 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ec5ed-c6f6-4b00-83a9-2cd4ead7084c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:24.927803 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ec5ed-c6f6-4b00-83a9-2cd4ead7084c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:24.928075 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ec5ed-c6f6-4b00-83a9-2cd4ead7084c admin admin] PATH_INFO: `/v3/projects/83908d6e37ad41e2882ed8f20923b274` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:24.929247 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ec5ed-c6f6-4b00-83a9-2cd4ead7084c admin admin] RBAC: Authorizing `identity:get_project(project_id=83908d6e37ad41e2882ed8f20923b274)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:24.931881 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ec5ed-c6f6-4b00-83a9-2cd4ead7084c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:24.933561 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 225/444] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:24 2022] GET /identity/v3/projects/83908d6e37ad41e2882ed8f20923b274 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:24.939076 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde2dc7-4699-45a1-af33-e4eb479f551a admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:24.948212 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde2dc7-4699-45a1-af33-e4eb479f551a admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:24.952739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6445aa-cfca-47ab-a734-86afc85c3053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:24.953582 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6445aa-cfca-47ab-a734-86afc85c3053 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:24.953862 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6445aa-cfca-47ab-a734-86afc85c3053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:24.954134 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6445aa-cfca-47ab-a734-86afc85c3053 admin admin] PATH_INFO: `/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:24.955350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6445aa-cfca-47ab-a734-86afc85c3053 admin admin] RBAC: Authorizing `identity:get_group(group_id=3e22d3b0492f44ff897b6fb32746b7bf)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:24.957213 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6445aa-cfca-47ab-a734-86afc85c3053 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:24.958834 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 220/445] 10.222.0.42 () {56 vars in 1201 bytes} [Wed Feb 16 16:50:24 2022] GET /identity/v3/groups/3e22d3b0492f44ff897b6fb32746b7bf => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:24.965269 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ec5ed-c6f6-4b00-83a9-2cd4ead7084c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:24.977403 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ec5ed-c6f6-4b00-83a9-2cd4ead7084c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:24.982089 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a3c3d-5b5c-4ecd-9495-8d952b284c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:24.982752 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a3c3d-5b5c-4ecd-9495-8d952b284c8d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:24.983029 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a3c3d-5b5c-4ecd-9495-8d952b284c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:24.983301 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a3c3d-5b5c-4ecd-9495-8d952b284c8d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:24.984181 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a3c3d-5b5c-4ecd-9495-8d952b284c8d admin admin] RBAC: Adding query filter params (group.id=3e22d3b0492f44ff897b6fb32746b7bf, role.id=cf30e55f556b4e0cbee0317b16316b0f, scope.project.id=83908d6e37ad41e2882ed8f20923b274) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:24.984499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a3c3d-5b5c-4ecd-9495-8d952b284c8d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:24.986320 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a3c3d-5b5c-4ecd-9495-8d952b284c8d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:24.992693 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 226/446] 10.222.0.42 () {56 vars in 1397 bytes} [Wed Feb 16 16:50:24 2022] GET /identity/v3/role_assignments?group.id=3e22d3b0492f44ff897b6fb32746b7bf&scope.project.id=83908d6e37ad41e2882ed8f20923b274&role.id=cf30e55f556b4e0cbee0317b16316b0f => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:25.393989 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb2be4-d16f-448e-8ce1-9f6ef1198784 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:25.394465 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb2be4-d16f-448e-8ce1-9f6ef1198784 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:25.394554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb2be4-d16f-448e-8ce1-9f6ef1198784 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:25.396288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 221/447] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:25.402418 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209604e1-5fef-4f6a-a422-3d41825e388d None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:25.402871 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209604e1-5fef-4f6a-a422-3d41825e388d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:25.402999 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209604e1-5fef-4f6a-a422-3d41825e388d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:25.420729 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-209604e1-5fef-4f6a-a422-3d41825e388d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:25.421891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-209604e1-5fef-4f6a-a422-3d41825e388d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:25.429291 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 227/448] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:25.453154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb2be4-d16f-448e-8ce1-9f6ef1198784 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:25.465341 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb2be4-d16f-448e-8ce1-9f6ef1198784 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:25.469558 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55877f32-39e5-4e7a-9cdb-b8f705b81702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:25.470315 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55877f32-39e5-4e7a-9cdb-b8f705b81702 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:25.470590 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55877f32-39e5-4e7a-9cdb-b8f705b81702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:25.470900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55877f32-39e5-4e7a-9cdb-b8f705b81702 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:25.481835 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55877f32-39e5-4e7a-9cdb-b8f705b81702 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:25.488674 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-55877f32-39e5-4e7a-9cdb-b8f705b81702 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:50:25.489795 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 222/449] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:50:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:25.495655 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209604e1-5fef-4f6a-a422-3d41825e388d None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:25.504256 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209604e1-5fef-4f6a-a422-3d41825e388d None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:25.508611 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7471c-4cc9-4e11-8fb6-c0655a284fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:25.509245 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7471c-4cc9-4e11-8fb6-c0655a284fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:25.509525 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7471c-4cc9-4e11-8fb6-c0655a284fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:25.509796 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7471c-4cc9-4e11-8fb6-c0655a284fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:25.510540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7471c-4cc9-4e11-8fb6-c0655a284fe7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:25.510874 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7471c-4cc9-4e11-8fb6-c0655a284fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:25.512434 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7471c-4cc9-4e11-8fb6-c0655a284fe7 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:25.520352 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 228/450] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:25.525475 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55877f32-39e5-4e7a-9cdb-b8f705b81702 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:25.534940 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55877f32-39e5-4e7a-9cdb-b8f705b81702 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:25.539724 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cea0f-0986-4f6a-9f19-271ae842767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:25.540507 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cea0f-0986-4f6a-9f19-271ae842767c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:25.540787 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cea0f-0986-4f6a-9f19-271ae842767c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:25.541059 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cea0f-0986-4f6a-9f19-271ae842767c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:25.548926 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cea0f-0986-4f6a-9f19-271ae842767c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:25.550639 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cea0f-0986-4f6a-9f19-271ae842767c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:25.559854 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 223/451] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:25.565065 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7471c-4cc9-4e11-8fb6-c0655a284fe7 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:25.574493 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7471c-4cc9-4e11-8fb6-c0655a284fe7 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:25.578850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4d609-49e5-460b-9197-b680b706fad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:25.579704 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4d609-49e5-460b-9197-b680b706fad3 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:25.579987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4d609-49e5-460b-9197-b680b706fad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:25.580263 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4d609-49e5-460b-9197-b680b706fad3 admin admin] PATH_INFO: `/v3/projects/604997d855554910a2aa75344774960d` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:25.581437 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4d609-49e5-460b-9197-b680b706fad3 admin admin] RBAC: Authorizing `identity:get_project(project_id=604997d855554910a2aa75344774960d)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:25.583252 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4d609-49e5-460b-9197-b680b706fad3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:25.584882 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 229/452] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:50:25 2022] GET /identity/v3/projects/604997d855554910a2aa75344774960d => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:25.590497 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cea0f-0986-4f6a-9f19-271ae842767c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:25.599929 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cea0f-0986-4f6a-9f19-271ae842767c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:25.605151 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af8aa1-46e8-4a7f-a426-cec4de0afa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:25.606226 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af8aa1-46e8-4a7f-a426-cec4de0afa5f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:25.606954 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af8aa1-46e8-4a7f-a426-cec4de0afa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:25.607232 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af8aa1-46e8-4a7f-a426-cec4de0afa5f admin admin] PATH_INFO: `/v3/groups/301e8a2e37e4460ab6d6f95f857f0d17` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:25.608399 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af8aa1-46e8-4a7f-a426-cec4de0afa5f admin admin] RBAC: Authorizing `identity:get_group(group_id=301e8a2e37e4460ab6d6f95f857f0d17)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:25.610244 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af8aa1-46e8-4a7f-a426-cec4de0afa5f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:25.611816 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 224/453] 10.222.0.42 () {56 vars in 1201 bytes} [Wed Feb 16 16:50:25 2022] GET /identity/v3/groups/301e8a2e37e4460ab6d6f95f857f0d17 => generated 229 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:25.617029 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4d609-49e5-460b-9197-b680b706fad3 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:25.626927 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4d609-49e5-460b-9197-b680b706fad3 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:25.631219 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48105ce8-5e29-4216-a7c3-f0ad4be78d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:25.631833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48105ce8-5e29-4216-a7c3-f0ad4be78d65 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:25.632115 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48105ce8-5e29-4216-a7c3-f0ad4be78d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:25.632387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48105ce8-5e29-4216-a7c3-f0ad4be78d65 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:25.633387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48105ce8-5e29-4216-a7c3-f0ad4be78d65 admin admin] RBAC: Adding query filter params (group.id=301e8a2e37e4460ab6d6f95f857f0d17, role.id=8263a29ceeed4576b3b6959c99964ed7, scope.project.id=604997d855554910a2aa75344774960d) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:25.633836 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48105ce8-5e29-4216-a7c3-f0ad4be78d65 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:25.635700 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48105ce8-5e29-4216-a7c3-f0ad4be78d65 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:25.641345 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 230/454] 10.222.0.42 () {56 vars in 1397 bytes} [Wed Feb 16 16:50:25 2022] GET /identity/v3/role_assignments?group.id=301e8a2e37e4460ab6d6f95f857f0d17&scope.project.id=604997d855554910a2aa75344774960d&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:28.551237 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01d97d-b6ec-4620-8c1b-f1444433d912 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:28.552181 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01d97d-b6ec-4620-8c1b-f1444433d912 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:28.552650 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01d97d-b6ec-4620-8c1b-f1444433d912 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:28.555314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 225/455] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:28.560664 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca412114-cec9-44a3-aa70-9c33964c0521 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:28.561508 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca412114-cec9-44a3-aa70-9c33964c0521 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:28.561979 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca412114-cec9-44a3-aa70-9c33964c0521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:28.592596 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-ca412114-cec9-44a3-aa70-9c33964c0521 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:28.594136 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-ca412114-cec9-44a3-aa70-9c33964c0521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:28.609048 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 231/456] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:28.617632 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfd86d-746e-4e7a-a6bd-5eeed331245f None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:28.618268 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfd86d-746e-4e7a-a6bd-5eeed331245f None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:28.618791 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfd86d-746e-4e7a-a6bd-5eeed331245f None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:28.620848 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 226/457] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:50:28.626906 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0da611-20a0-4f78-bc07-9f46ba7e93ae None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:28.627441 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0da611-20a0-4f78-bc07-9f46ba7e93ae None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:28.627941 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0da611-20a0-4f78-bc07-9f46ba7e93ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:28.635365 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfd86d-746e-4e7a-a6bd-5eeed331245f None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:28.654159 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfd86d-746e-4e7a-a6bd-5eeed331245f None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:28.660729 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-0f0da611-20a0-4f78-bc07-9f46ba7e93ae None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:28.663482 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8336f6-c462-4ecb-a21c-3b9fd0967b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:28.665264 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8336f6-c462-4ecb-a21c-3b9fd0967b8a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:28.665739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8336f6-c462-4ecb-a21c-3b9fd0967b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:28.666198 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8336f6-c462-4ecb-a21c-3b9fd0967b8a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:28.667411 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0f0da611-20a0-4f78-bc07-9f46ba7e93ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:28.683000 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8336f6-c462-4ecb-a21c-3b9fd0967b8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:28.685566 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8336f6-c462-4ecb-a21c-3b9fd0967b8a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:28.687033 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 232/458] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:28.713041 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-3c8336f6-c462-4ecb-a21c-3b9fd0967b8a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:28.715500 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 227/459] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:28.716681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0da611-20a0-4f78-bc07-9f46ba7e93ae None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:28.720658 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8336f6-c462-4ecb-a21c-3b9fd0967b8a admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:28.732382 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0da611-20a0-4f78-bc07-9f46ba7e93ae None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:28.738451 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8336f6-c462-4ecb-a21c-3b9fd0967b8a admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:28.743826 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd156dc-6c6b-4b2f-965b-ec634e0b4dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:28.743992 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176bcd5-18b6-4105-b7ca-8c432de9a4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:28.744690 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176bcd5-18b6-4105-b7ca-8c432de9a4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:28.745022 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176bcd5-18b6-4105-b7ca-8c432de9a4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:28.745176 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd156dc-6c6b-4b2f-965b-ec634e0b4dbe admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:28.745345 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176bcd5-18b6-4105-b7ca-8c432de9a4b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:28.745640 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd156dc-6c6b-4b2f-965b-ec634e0b4dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:28.746024 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176bcd5-18b6-4105-b7ca-8c432de9a4b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:28.746126 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd156dc-6c6b-4b2f-965b-ec634e0b4dbe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:28.746332 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176bcd5-18b6-4105-b7ca-8c432de9a4b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:28.747408 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING py.warnings [None req-c176bcd5-18b6-4105-b7ca-8c432de9a4b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:50:28.747408 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: warnings.warn(msg) Feb 16 16:50:28.747408 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: Feb 16 16:50:28.748292 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176bcd5-18b6-4105-b7ca-8c432de9a4b1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:28.763358 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd156dc-6c6b-4b2f-965b-ec634e0b4dbe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:28.765189 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd156dc-6c6b-4b2f-965b-ec634e0b4dbe admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:28.767026 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 228/460] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:28.772387 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176bcd5-18b6-4105-b7ca-8c432de9a4b1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:28.782203 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176bcd5-18b6-4105-b7ca-8c432de9a4b1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:28.798541 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5d4ec-48b7-4f8d-b061-02554bee4361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:28.799243 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5d4ec-48b7-4f8d-b061-02554bee4361 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:28.799528 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5d4ec-48b7-4f8d-b061-02554bee4361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:28.799803 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5d4ec-48b7-4f8d-b061-02554bee4361 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:28.800517 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5d4ec-48b7-4f8d-b061-02554bee4361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:28.802427 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5d4ec-48b7-4f8d-b061-02554bee4361 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:28.805624 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-4dd156dc-6c6b-4b2f-965b-ec634e0b4dbe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:28.814180 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 233/461] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:28.815082 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd156dc-6c6b-4b2f-965b-ec634e0b4dbe admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:28.833983 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd156dc-6c6b-4b2f-965b-ec634e0b4dbe admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:28.839447 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06e189-673a-4756-81ac-afc16404c707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:28.840201 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06e189-673a-4756-81ac-afc16404c707 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:28.840489 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06e189-673a-4756-81ac-afc16404c707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:28.842117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06e189-673a-4756-81ac-afc16404c707 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:28.842117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06e189-673a-4756-81ac-afc16404c707 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:28.842117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06e189-673a-4756-81ac-afc16404c707 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:28.843559 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06e189-673a-4756-81ac-afc16404c707 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:28.856113 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 234/462] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:28.857839 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c9cce-54e5-4f04-9544-fd276f11889c None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:28.858133 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c9cce-54e5-4f04-9544-fd276f11889c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:28.859507 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c9cce-54e5-4f04-9544-fd276f11889c None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:28.860313 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 235/463] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:28.865990 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41eb01-c27b-4d09-a2dc-1225348b52e7 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:28.866291 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41eb01-c27b-4d09-a2dc-1225348b52e7 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:28.866570 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41eb01-c27b-4d09-a2dc-1225348b52e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:28.886331 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-be41eb01-c27b-4d09-a2dc-1225348b52e7 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:28.887605 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-be41eb01-c27b-4d09-a2dc-1225348b52e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:28.896665 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 229/464] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Feb 16 16:50:28 2022] POST /identity/v3/users => generated 246 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 16:50:28.903198 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5d4ec-48b7-4f8d-b061-02554bee4361 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:28.905764 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 236/465] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:28.920615 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5d4ec-48b7-4f8d-b061-02554bee4361 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:28.930284 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c0b1d-afa2-4c7e-9239-119ff80d0dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:28.931310 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c0b1d-afa2-4c7e-9239-119ff80d0dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:28.931592 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c0b1d-afa2-4c7e-9239-119ff80d0dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:28.931867 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c0b1d-afa2-4c7e-9239-119ff80d0dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:28.932584 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c0b1d-afa2-4c7e-9239-119ff80d0dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:28.934575 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c0b1d-afa2-4c7e-9239-119ff80d0dd7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:28.938054 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41eb01-c27b-4d09-a2dc-1225348b52e7 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:28.950894 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41eb01-c27b-4d09-a2dc-1225348b52e7 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:28.956698 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6e0e6-49d7-48de-bb76-25715a6d2c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:28.957871 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6e0e6-49d7-48de-bb76-25715a6d2c92 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:28.958325 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6e0e6-49d7-48de-bb76-25715a6d2c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:28.958791 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6e0e6-49d7-48de-bb76-25715a6d2c92 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:28.972235 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6e0e6-49d7-48de-bb76-25715a6d2c92 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:28.974971 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6e0e6-49d7-48de-bb76-25715a6d2c92 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:28.996691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-91e6e0e6-49d7-48de-bb76-25715a6d2c92 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:28.998582 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 237/466] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:29.004886 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6e0e6-49d7-48de-bb76-25715a6d2c92 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:29.016868 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 230/467] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Feb 16 16:50:28 2022] POST /identity/v3/users => generated 248 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:50:29.017387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6e0e6-49d7-48de-bb76-25715a6d2c92 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:29.023012 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920c966-cf2f-4b55-95b4-0c2cfdc644f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:29.023976 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830ebef-d074-48a4-90dc-16610f2417c9 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:29.024437 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830ebef-d074-48a4-90dc-16610f2417c9 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:29.024885 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830ebef-d074-48a4-90dc-16610f2417c9 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:29.025571 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920c966-cf2f-4b55-95b4-0c2cfdc644f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:29.026074 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920c966-cf2f-4b55-95b4-0c2cfdc644f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:29.026523 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920c966-cf2f-4b55-95b4-0c2cfdc644f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:29.027426 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 231/468] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:29.028066 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920c966-cf2f-4b55-95b4-0c2cfdc644f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:29.028535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920c966-cf2f-4b55-95b4-0c2cfdc644f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:29.030674 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920c966-cf2f-4b55-95b4-0c2cfdc644f1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:29.033479 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee31e03-5197-45be-b358-22718781bf89 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:29.033767 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee31e03-5197-45be-b358-22718781bf89 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:29.034508 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee31e03-5197-45be-b358-22718781bf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:29.046624 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 238/469] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:29.052813 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920c966-cf2f-4b55-95b4-0c2cfdc644f1 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:29.064287 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920c966-cf2f-4b55-95b4-0c2cfdc644f1 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:29.069693 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711eb1c-253c-4ca0-ac48-47afad1967b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:29.071707 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711eb1c-253c-4ca0-ac48-47afad1967b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:29.072227 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711eb1c-253c-4ca0-ac48-47afad1967b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:29.072680 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711eb1c-253c-4ca0-ac48-47afad1967b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:29.072792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-aee31e03-5197-45be-b358-22718781bf89 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:29.073685 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711eb1c-253c-4ca0-ac48-47afad1967b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:29.074195 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-aee31e03-5197-45be-b358-22718781bf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:29.076348 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711eb1c-253c-4ca0-ac48-47afad1967b1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:29.094691 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 232/470] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:29.117466 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee31e03-5197-45be-b358-22718781bf89 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:29.127848 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee31e03-5197-45be-b358-22718781bf89 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:29.134811 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182140-753b-47c6-9310-262b029386f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:29.135631 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182140-753b-47c6-9310-262b029386f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:29.135914 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182140-753b-47c6-9310-262b029386f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:29.136207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182140-753b-47c6-9310-262b029386f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:29.149702 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad182140-753b-47c6-9310-262b029386f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:29.152386 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad182140-753b-47c6-9310-262b029386f3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:29.172129 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-ad182140-753b-47c6-9310-262b029386f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:29.173690 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 233/471] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:29.180015 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182140-753b-47c6-9310-262b029386f3 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:29.192277 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182140-753b-47c6-9310-262b029386f3 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:29.196980 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 239/472] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Feb 16 16:50:29 2022] POST /identity/v3/users => generated 248 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:50:29.199150 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1b1ab-736b-4b1e-9ec1-ef09646b3985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:29.199150 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1b1ab-736b-4b1e-9ec1-ef09646b3985 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:29.199150 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1b1ab-736b-4b1e-9ec1-ef09646b3985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:29.199150 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1b1ab-736b-4b1e-9ec1-ef09646b3985 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:29.201040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1b1ab-736b-4b1e-9ec1-ef09646b3985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:29.201040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1b1ab-736b-4b1e-9ec1-ef09646b3985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:29.201847 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1b1ab-736b-4b1e-9ec1-ef09646b3985 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:29.216651 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 234/473] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:29.222626 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711eb1c-253c-4ca0-ac48-47afad1967b1 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:29.239447 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711eb1c-253c-4ca0-ac48-47afad1967b1 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:29.245557 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05df3b-7b47-4e5f-814f-7e3dc57fdc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:29.246561 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05df3b-7b47-4e5f-814f-7e3dc57fdc73 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:29.247071 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05df3b-7b47-4e5f-814f-7e3dc57fdc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:29.247546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05df3b-7b47-4e5f-814f-7e3dc57fdc73 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:29.248633 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05df3b-7b47-4e5f-814f-7e3dc57fdc73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:29.251060 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05df3b-7b47-4e5f-814f-7e3dc57fdc73 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:29.331538 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 240/474] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Feb 16 16:50:29 2022] POST /identity/v3/users => generated 249 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:50:30.058938 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d571fda-36fa-40d8-8f81-1d7c8e8c9834 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:30.059947 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d571fda-36fa-40d8-8f81-1d7c8e8c9834 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:30.060460 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d571fda-36fa-40d8-8f81-1d7c8e8c9834 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:30.062854 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 235/475] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:30.068051 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bdd4e-4030-402a-a26c-4e33d98a01f9 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:30.068884 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bdd4e-4030-402a-a26c-4e33d98a01f9 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:30.069520 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bdd4e-4030-402a-a26c-4e33d98a01f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:30.099630 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-1a3bdd4e-4030-402a-a26c-4e33d98a01f9 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:30.101241 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-1a3bdd4e-4030-402a-a26c-4e33d98a01f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:30.110786 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 241/476] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:30.154694 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d571fda-36fa-40d8-8f81-1d7c8e8c9834 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:30.169549 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d571fda-36fa-40d8-8f81-1d7c8e8c9834 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:30.180428 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc8375-2c81-4dde-929c-08f8785df1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:30.181377 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc8375-2c81-4dde-929c-08f8785df1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:30.181858 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc8375-2c81-4dde-929c-08f8785df1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:30.182330 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc8375-2c81-4dde-929c-08f8785df1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:30.183335 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc8375-2c81-4dde-929c-08f8785df1f6 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:30.185189 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc8375-2c81-4dde-929c-08f8785df1f6 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:30.227594 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.sql.core [None req-2ecc8375-2c81-4dde-929c-08f8785df1f6 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 16 16:50:30.227594 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 16 16:50:30.227594 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [parameters: {'id': '1a1b0c01a1074b32a0615a0288d4a681', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 16 16:50:30.227594 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79468) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 16 16:50:30.243608 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-2ecc8375-2c81-4dde-929c-08f8785df1f6 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 16 16:50:30.251517 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 236/477] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 16:50:30 2022] POST /identity/v3/roles => generated 144 bytes in 97 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:30.257240 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bdd4e-4030-402a-a26c-4e33d98a01f9 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:30.267989 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bdd4e-4030-402a-a26c-4e33d98a01f9 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:30.277434 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3265155-9c55-401b-90b9-bf73df05044c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:30.278528 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3265155-9c55-401b-90b9-bf73df05044c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:30.279040 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3265155-9c55-401b-90b9-bf73df05044c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:30.279515 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3265155-9c55-401b-90b9-bf73df05044c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:30.295558 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3265155-9c55-401b-90b9-bf73df05044c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:30.302698 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-e3265155-9c55-401b-90b9-bf73df05044c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 16:50:30.304205 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 242/478] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:50:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:30.310278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc8375-2c81-4dde-929c-08f8785df1f6 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:30.324823 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc8375-2c81-4dde-929c-08f8785df1f6 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:30.334227 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4078991-0c6f-4d1d-9cf4-bffa5c702cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:30.335172 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4078991-0c6f-4d1d-9cf4-bffa5c702cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:30.336215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4078991-0c6f-4d1d-9cf4-bffa5c702cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:30.336775 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4078991-0c6f-4d1d-9cf4-bffa5c702cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:30.337782 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4078991-0c6f-4d1d-9cf4-bffa5c702cb6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:30.338286 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4078991-0c6f-4d1d-9cf4-bffa5c702cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:30.340094 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4078991-0c6f-4d1d-9cf4-bffa5c702cb6 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:30.354957 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 237/479] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:31.687181 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dde4fd-4286-48f5-a780-61beeb99ea50 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:31.687683 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dde4fd-4286-48f5-a780-61beeb99ea50 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:31.687782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dde4fd-4286-48f5-a780-61beeb99ea50 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:31.689740 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 243/480] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:31.696086 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f1ae3-c00d-4d68-9947-2fecf24095fd None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:31.697008 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f1ae3-c00d-4d68-9947-2fecf24095fd None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:31.697483 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f1ae3-c00d-4d68-9947-2fecf24095fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:31.723643 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-6a0f1ae3-c00d-4d68-9947-2fecf24095fd None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:31.725192 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6a0f1ae3-c00d-4d68-9947-2fecf24095fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:31.738406 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 238/481] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:31.783019 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dde4fd-4286-48f5-a780-61beeb99ea50 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:31.801678 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dde4fd-4286-48f5-a780-61beeb99ea50 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:31.812162 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fe8f9-8beb-40a2-8e33-39e812c16326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:31.812958 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fe8f9-8beb-40a2-8e33-39e812c16326 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:31.813234 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fe8f9-8beb-40a2-8e33-39e812c16326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:31.813504 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fe8f9-8beb-40a2-8e33-39e812c16326 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:31.833067 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fe8f9-8beb-40a2-8e33-39e812c16326 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:31.839030 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef3fb3-fbf1-4314-8c33-f10399dfee54 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:31.839557 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef3fb3-fbf1-4314-8c33-f10399dfee54 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:31.840025 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef3fb3-fbf1-4314-8c33-f10399dfee54 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:31.841266 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-293fe8f9-8beb-40a2-8e33-39e812c16326 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:50:31.842738 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 244/483] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:31.842927 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 239/483] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:31.847480 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9a7ac-4720-4521-a553-708c0baa034d None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:31.847763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9a7ac-4720-4521-a553-708c0baa034d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:31.848033 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9a7ac-4720-4521-a553-708c0baa034d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:31.848532 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef3fb3-fbf1-4314-8c33-f10399dfee54 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:31.868997 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef3fb3-fbf1-4314-8c33-f10399dfee54 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:31.875041 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-e0a9a7ac-4720-4521-a553-708c0baa034d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:31.876268 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e0a9a7ac-4720-4521-a553-708c0baa034d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:31.881041 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31386140-f759-401c-8183-bc37d0ad2cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:31.881713 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31386140-f759-401c-8183-bc37d0ad2cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:31.881990 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31386140-f759-401c-8183-bc37d0ad2cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:31.882262 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31386140-f759-401c-8183-bc37d0ad2cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:31.883859 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31386140-f759-401c-8183-bc37d0ad2cc3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:31.884169 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31386140-f759-401c-8183-bc37d0ad2cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:31.885792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31386140-f759-401c-8183-bc37d0ad2cc3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:31.897214 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 245/484] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:31.904888 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 240/485] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:50:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:31.910392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9a7ac-4720-4521-a553-708c0baa034d None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:31.923789 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9a7ac-4720-4521-a553-708c0baa034d None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:31.925627 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31386140-f759-401c-8183-bc37d0ad2cc3 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:31.938522 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31386140-f759-401c-8183-bc37d0ad2cc3 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:31.940274 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3bfa6-0648-4e5c-8a7f-fa317188bd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:31.941068 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3bfa6-0648-4e5c-8a7f-fa317188bd14 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:31.941343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3bfa6-0648-4e5c-8a7f-fa317188bd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:31.941608 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3bfa6-0648-4e5c-8a7f-fa317188bd14 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:31.952366 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1da055-32eb-4e56-b512-99ba57c0ee47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:31.953185 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1da055-32eb-4e56-b512-99ba57c0ee47 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:31.953461 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1da055-32eb-4e56-b512-99ba57c0ee47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:31.953731 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1da055-32eb-4e56-b512-99ba57c0ee47 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:31.962057 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3bfa6-0648-4e5c-8a7f-fa317188bd14 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:31.963908 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3bfa6-0648-4e5c-8a7f-fa317188bd14 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:31.976177 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1da055-32eb-4e56-b512-99ba57c0ee47 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:31.984498 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-dd1da055-32eb-4e56-b512-99ba57c0ee47 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:50:31.986057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 241/486] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:31.991553 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-f3e3bfa6-0648-4e5c-8a7f-fa317188bd14 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:31.997970 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 246/487] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:31.998672 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1da055-32eb-4e56-b512-99ba57c0ee47 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.003638 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3bfa6-0648-4e5c-8a7f-fa317188bd14 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.013344 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1da055-32eb-4e56-b512-99ba57c0ee47 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.017828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cacf86-0c7b-4c91-be7f-52f49380002d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.018471 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cacf86-0c7b-4c91-be7f-52f49380002d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.018782 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cacf86-0c7b-4c91-be7f-52f49380002d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.019053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cacf86-0c7b-4c91-be7f-52f49380002d admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.019791 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cacf86-0c7b-4c91-be7f-52f49380002d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:32.020092 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cacf86-0c7b-4c91-be7f-52f49380002d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.021445 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3bfa6-0648-4e5c-8a7f-fa317188bd14 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.021656 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cacf86-0c7b-4c91-be7f-52f49380002d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.032834 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 242/488] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:50:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:32.034016 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a947e1-9899-45d9-9cf4-ba7bce98de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.034621 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a947e1-9899-45d9-9cf4-ba7bce98de3e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.034923 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a947e1-9899-45d9-9cf4-ba7bce98de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.035199 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a947e1-9899-45d9-9cf4-ba7bce98de3e admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.035908 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a947e1-9899-45d9-9cf4-ba7bce98de3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:32.036208 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a947e1-9899-45d9-9cf4-ba7bce98de3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.038587 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cacf86-0c7b-4c91-be7f-52f49380002d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.040717 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a947e1-9899-45d9-9cf4-ba7bce98de3e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.057305 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cacf86-0c7b-4c91-be7f-52f49380002d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.063242 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 247/489] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:32.065154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d8138-5545-4998-86a0-9dc1db672002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.065956 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d8138-5545-4998-86a0-9dc1db672002 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.066233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d8138-5545-4998-86a0-9dc1db672002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.066500 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d8138-5545-4998-86a0-9dc1db672002 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.068813 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a947e1-9899-45d9-9cf4-ba7bce98de3e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.090042 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a947e1-9899-45d9-9cf4-ba7bce98de3e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.091467 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d8138-5545-4998-86a0-9dc1db672002 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.093359 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d8138-5545-4998-86a0-9dc1db672002 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.101835 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07e61b-547c-4585-873c-4a8ae993a80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.103140 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07e61b-547c-4585-873c-4a8ae993a80e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.103421 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07e61b-547c-4585-873c-4a8ae993a80e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.103692 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07e61b-547c-4585-873c-4a8ae993a80e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.112926 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07e61b-547c-4585-873c-4a8ae993a80e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.115551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07e61b-547c-4585-873c-4a8ae993a80e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.130691 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-e19d8138-5545-4998-86a0-9dc1db672002 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:32.130872 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-ff07e61b-547c-4585-873c-4a8ae993a80e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 16:50:32.132441 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 248/490] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:32.132716 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 243/491] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:32.139679 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07e61b-547c-4585-873c-4a8ae993a80e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.142824 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d8138-5545-4998-86a0-9dc1db672002 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.153115 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07e61b-547c-4585-873c-4a8ae993a80e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.158345 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338e28a-655f-42d7-a230-0508104f8021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.159223 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338e28a-655f-42d7-a230-0508104f8021 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.159505 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338e28a-655f-42d7-a230-0508104f8021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.159779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338e28a-655f-42d7-a230-0508104f8021 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.160665 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338e28a-655f-42d7-a230-0508104f8021 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:32.160972 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338e28a-655f-42d7-a230-0508104f8021 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.161949 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d8138-5545-4998-86a0-9dc1db672002 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.162067 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-2338e28a-655f-42d7-a230-0508104f8021 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:50:32.162067 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 16:50:32.162067 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 16:50:32.166672 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338e28a-655f-42d7-a230-0508104f8021 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.175864 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445cab5-e938-461c-a885-b6147270702d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.176804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445cab5-e938-461c-a885-b6147270702d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.177295 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445cab5-e938-461c-a885-b6147270702d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.177552 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445cab5-e938-461c-a885-b6147270702d admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.178284 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445cab5-e938-461c-a885-b6147270702d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:32.178590 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445cab5-e938-461c-a885-b6147270702d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.181183 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445cab5-e938-461c-a885-b6147270702d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.207725 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 249/492] 10.222.0.42 () {56 vars in 1154 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:32.208123 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 244/493] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:32.215963 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338e28a-655f-42d7-a230-0508104f8021 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.223903 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445cab5-e938-461c-a885-b6147270702d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.235318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338e28a-655f-42d7-a230-0508104f8021 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.237874 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445cab5-e938-461c-a885-b6147270702d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.245550 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850347e-8afd-457c-a9a1-0d4c351f962a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.246200 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850347e-8afd-457c-a9a1-0d4c351f962a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.246481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850347e-8afd-457c-a9a1-0d4c351f962a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.247248 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e49542-f7dc-46f1-a37d-89e60b1d0518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.248013 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e49542-f7dc-46f1-a37d-89e60b1d0518 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.248284 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e49542-f7dc-46f1-a37d-89e60b1d0518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.248550 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e49542-f7dc-46f1-a37d-89e60b1d0518 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.249198 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850347e-8afd-457c-a9a1-0d4c351f962a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.262935 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850347e-8afd-457c-a9a1-0d4c351f962a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.264689 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850347e-8afd-457c-a9a1-0d4c351f962a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.269183 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e49542-f7dc-46f1-a37d-89e60b1d0518 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.271209 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e49542-f7dc-46f1-a37d-89e60b1d0518 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.290814 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 250/494] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:32.291693 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850347e-8afd-457c-a9a1-0d4c351f962a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.294028 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-31e49542-f7dc-46f1-a37d-89e60b1d0518 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 16 16:50:32.295494 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 245/495] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:32.300882 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e49542-f7dc-46f1-a37d-89e60b1d0518 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.302909 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850347e-8afd-457c-a9a1-0d4c351f962a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.313676 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100d9c3-bffc-48d9-970b-0cd20e33059c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.314465 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100d9c3-bffc-48d9-970b-0cd20e33059c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.314801 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100d9c3-bffc-48d9-970b-0cd20e33059c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.315041 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100d9c3-bffc-48d9-970b-0cd20e33059c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.317936 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e49542-f7dc-46f1-a37d-89e60b1d0518 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.332550 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adba1ee-ddbb-4a76-a6e0-ab55102c4b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.333222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adba1ee-ddbb-4a76-a6e0-ab55102c4b70 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.333506 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adba1ee-ddbb-4a76-a6e0-ab55102c4b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.333775 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adba1ee-ddbb-4a76-a6e0-ab55102c4b70 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.334614 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adba1ee-ddbb-4a76-a6e0-ab55102c4b70 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:32.334950 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adba1ee-ddbb-4a76-a6e0-ab55102c4b70 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.336045 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING py.warnings [None req-7adba1ee-ddbb-4a76-a6e0-ab55102c4b70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:50:32.336045 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: warnings.warn(msg) Feb 16 16:50:32.336045 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: Feb 16 16:50:32.337169 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adba1ee-ddbb-4a76-a6e0-ab55102c4b70 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.339777 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100d9c3-bffc-48d9-970b-0cd20e33059c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.341953 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100d9c3-bffc-48d9-970b-0cd20e33059c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.368858 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-6100d9c3-bffc-48d9-970b-0cd20e33059c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:32.375566 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 251/496] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:32.377158 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a3aa6-309a-49a6-a182-c87a03f694f1 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.377648 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a3aa6-309a-49a6-a182-c87a03f694f1 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.378161 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a3aa6-309a-49a6-a182-c87a03f694f1 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.380661 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 252/497] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:32.381552 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a3aa6-309a-49a6-a182-c87a03f694f1 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.399636 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a3aa6-309a-49a6-a182-c87a03f694f1 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.404085 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59317878-122f-4b6d-b6fd-f4bd51b29ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.404498 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 246/498] 10.222.0.42 () {56 vars in 1158 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:32.404731 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59317878-122f-4b6d-b6fd-f4bd51b29ffd admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.405014 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59317878-122f-4b6d-b6fd-f4bd51b29ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.405288 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59317878-122f-4b6d-b6fd-f4bd51b29ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.406001 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59317878-122f-4b6d-b6fd-f4bd51b29ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:32.406305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59317878-122f-4b6d-b6fd-f4bd51b29ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.408011 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59317878-122f-4b6d-b6fd-f4bd51b29ffd admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.410113 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c91aed-423d-42a9-bfc9-5d307f06fbec None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.410425 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c91aed-423d-42a9-bfc9-5d307f06fbec None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.410731 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c91aed-423d-42a9-bfc9-5d307f06fbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.421388 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 253/499] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:32.422230 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59317878-122f-4b6d-b6fd-f4bd51b29ffd admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.432760 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59317878-122f-4b6d-b6fd-f4bd51b29ffd admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.435895 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-e7c91aed-423d-42a9-bfc9-5d307f06fbec None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:32.437080 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e7c91aed-423d-42a9-bfc9-5d307f06fbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:32.437423 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd3830-c932-4929-a071-01cf08731a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.438183 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd3830-c932-4929-a071-01cf08731a66 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.438468 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd3830-c932-4929-a071-01cf08731a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.438844 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd3830-c932-4929-a071-01cf08731a66 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.444933 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 247/500] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:32.446498 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c91aed-423d-42a9-bfc9-5d307f06fbec None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.455394 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c91aed-423d-42a9-bfc9-5d307f06fbec None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.456976 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd3830-c932-4929-a071-01cf08731a66 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.459568 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd3830-c932-4929-a071-01cf08731a66 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.460211 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e4245-ef36-46f7-8c07-20d4aca8921b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.461713 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e4245-ef36-46f7-8c07-20d4aca8921b admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.462054 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e4245-ef36-46f7-8c07-20d4aca8921b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.462396 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e4245-ef36-46f7-8c07-20d4aca8921b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.469647 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e4245-ef36-46f7-8c07-20d4aca8921b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.472335 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e4245-ef36-46f7-8c07-20d4aca8921b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.477203 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 254/501] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:32.478511 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0375d-8239-4c9f-89d7-e8a6f7903148 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.478883 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0375d-8239-4c9f-89d7-e8a6f7903148 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.479219 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0375d-8239-4c9f-89d7-e8a6f7903148 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.481200 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 255/502] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:32.482157 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0375d-8239-4c9f-89d7-e8a6f7903148 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.492559 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-eb2e4245-ef36-46f7-8c07-20d4aca8921b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:32.494205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 248/503] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:32.494939 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0375d-8239-4c9f-89d7-e8a6f7903148 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.499324 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4b469-20ce-449e-b768-b40bbc883a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.499566 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e4245-ef36-46f7-8c07-20d4aca8921b admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.500085 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4b469-20ce-449e-b768-b40bbc883a18 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.500398 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4b469-20ce-449e-b768-b40bbc883a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.500685 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4b469-20ce-449e-b768-b40bbc883a18 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.510881 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e4245-ef36-46f7-8c07-20d4aca8921b admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.511791 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4b469-20ce-449e-b768-b40bbc883a18 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:32.515485 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94634438-f66d-4dd4-91b5-d11dc46de252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.516321 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94634438-f66d-4dd4-91b5-d11dc46de252 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.516599 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94634438-f66d-4dd4-91b5-d11dc46de252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.516923 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94634438-f66d-4dd4-91b5-d11dc46de252 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.518678 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-b4c4b469-20ce-449e-b768-b40bbc883a18 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:50:32.524861 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 256/504] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:32.524861 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d02ba3-f206-4cb0-86f9-7747edae1b0a None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.524861 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d02ba3-f206-4cb0-86f9-7747edae1b0a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.524861 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d02ba3-f206-4cb0-86f9-7747edae1b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.532096 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94634438-f66d-4dd4-91b5-d11dc46de252 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.533929 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94634438-f66d-4dd4-91b5-d11dc46de252 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.543358 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-98d02ba3-f206-4cb0-86f9-7747edae1b0a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:32.544744 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-98d02ba3-f206-4cb0-86f9-7747edae1b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:32.550940 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-94634438-f66d-4dd4-91b5-d11dc46de252 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:32.556819 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 249/505] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:32.556953 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 257/506] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:32.556953 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d02ba3-f206-4cb0-86f9-7747edae1b0a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.558905 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94634438-f66d-4dd4-91b5-d11dc46de252 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.567145 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d02ba3-f206-4cb0-86f9-7747edae1b0a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.570962 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94634438-f66d-4dd4-91b5-d11dc46de252 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.572476 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ac354-fe84-48d9-8523-ccbe7a323be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.573383 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ac354-fe84-48d9-8523-ccbe7a323be8 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.573820 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ac354-fe84-48d9-8523-ccbe7a323be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.574219 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ac354-fe84-48d9-8523-ccbe7a323be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.575215 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ac354-fe84-48d9-8523-ccbe7a323be8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:32.575624 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ac354-fe84-48d9-8523-ccbe7a323be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.576730 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49789447-322c-44b2-a11e-7cd328035e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.577530 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49789447-322c-44b2-a11e-7cd328035e10 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.577729 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ac354-fe84-48d9-8523-ccbe7a323be8 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.578109 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49789447-322c-44b2-a11e-7cd328035e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.578527 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49789447-322c-44b2-a11e-7cd328035e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.579676 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49789447-322c-44b2-a11e-7cd328035e10 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:32.580135 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49789447-322c-44b2-a11e-7cd328035e10 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.581739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING py.warnings [None req-49789447-322c-44b2-a11e-7cd328035e10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:50:32.581739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: warnings.warn(msg) Feb 16 16:50:32.581739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: Feb 16 16:50:32.582890 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49789447-322c-44b2-a11e-7cd328035e10 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.587909 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 258/507] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:32.588630 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ac354-fe84-48d9-8523-ccbe7a323be8 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.597847 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ac354-fe84-48d9-8523-ccbe7a323be8 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.602201 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a96c8-713b-4251-9e2a-ede626a96253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.602845 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a96c8-713b-4251-9e2a-ede626a96253 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.603119 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a96c8-713b-4251-9e2a-ede626a96253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.603392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a96c8-713b-4251-9e2a-ede626a96253 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.604087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a96c8-713b-4251-9e2a-ede626a96253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:32.604384 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a96c8-713b-4251-9e2a-ede626a96253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.605946 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a96c8-713b-4251-9e2a-ede626a96253 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.607330 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 250/508] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:32.608916 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49789447-322c-44b2-a11e-7cd328035e10 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.618541 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 259/509] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:32.619424 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a96c8-713b-4251-9e2a-ede626a96253 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.624972 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49789447-322c-44b2-a11e-7cd328035e10 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.628636 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a96c8-713b-4251-9e2a-ede626a96253 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.630445 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322a9e1-98b0-4e3d-8562-c7afb22abafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.631441 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322a9e1-98b0-4e3d-8562-c7afb22abafa admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.631897 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322a9e1-98b0-4e3d-8562-c7afb22abafa admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.632308 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322a9e1-98b0-4e3d-8562-c7afb22abafa admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.633328 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e0b89-146d-4f8c-a9a0-2bc3d56b6f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.634081 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e0b89-146d-4f8c-a9a0-2bc3d56b6f6a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.634358 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e0b89-146d-4f8c-a9a0-2bc3d56b6f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.634625 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e0b89-146d-4f8c-a9a0-2bc3d56b6f6a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.645283 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e0b89-146d-4f8c-a9a0-2bc3d56b6f6a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.647118 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322a9e1-98b0-4e3d-8562-c7afb22abafa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:32.647261 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e0b89-146d-4f8c-a9a0-2bc3d56b6f6a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.656516 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-a322a9e1-98b0-4e3d-8562-c7afb22abafa admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:50:32.658353 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 251/510] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:32.659172 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322a9e1-98b0-4e3d-8562-c7afb22abafa admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.664856 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-3c1e0b89-146d-4f8c-a9a0-2bc3d56b6f6a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:32.666146 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 260/511] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:32.666870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e0b89-146d-4f8c-a9a0-2bc3d56b6f6a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.672482 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322a9e1-98b0-4e3d-8562-c7afb22abafa admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.676521 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e0b89-146d-4f8c-a9a0-2bc3d56b6f6a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.677905 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75e4dd-0e36-414c-b0bb-2e545d723181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.678543 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75e4dd-0e36-414c-b0bb-2e545d723181 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.678858 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75e4dd-0e36-414c-b0bb-2e545d723181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.679182 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75e4dd-0e36-414c-b0bb-2e545d723181 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.680757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75e4dd-0e36-414c-b0bb-2e545d723181 admin admin] RBAC: Adding query filter params (role.id=9209cdab986041f1a45283ada1ae297a, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=9a30603a236e4681a7702eec7029e9db) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:32.681075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75e4dd-0e36-414c-b0bb-2e545d723181 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.681822 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390de34-2aaa-4c29-a2d4-e1bff72148ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.682575 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390de34-2aaa-4c29-a2d4-e1bff72148ee admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.682897 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390de34-2aaa-4c29-a2d4-e1bff72148ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.682987 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75e4dd-0e36-414c-b0bb-2e545d723181 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.683169 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390de34-2aaa-4c29-a2d4-e1bff72148ee admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.690181 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 252/512] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/role_assignments?user.id=9a30603a236e4681a7702eec7029e9db&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=9209cdab986041f1a45283ada1ae297a => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:32.690298 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390de34-2aaa-4c29-a2d4-e1bff72148ee admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.690830 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75e4dd-0e36-414c-b0bb-2e545d723181 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.692190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390de34-2aaa-4c29-a2d4-e1bff72148ee admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.709594 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75e4dd-0e36-414c-b0bb-2e545d723181 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.713674 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-6390de34-2aaa-4c29-a2d4-e1bff72148ee admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:32.714937 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 261/513] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:32.715781 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390de34-2aaa-4c29-a2d4-e1bff72148ee admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.716039 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25e063-d62e-4af8-8fd6-574e7d4cba9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.716925 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25e063-d62e-4af8-8fd6-574e7d4cba9a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.717408 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25e063-d62e-4af8-8fd6-574e7d4cba9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.717855 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25e063-d62e-4af8-8fd6-574e7d4cba9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.718807 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25e063-d62e-4af8-8fd6-574e7d4cba9a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:32.719292 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25e063-d62e-4af8-8fd6-574e7d4cba9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.721387 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25e063-d62e-4af8-8fd6-574e7d4cba9a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.727870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390de34-2aaa-4c29-a2d4-e1bff72148ee admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.733205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 253/514] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:32.733381 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6ff21-2d4f-4dfe-a117-47f2aeabd38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.733930 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6ff21-2d4f-4dfe-a117-47f2aeabd38e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.734265 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6ff21-2d4f-4dfe-a117-47f2aeabd38e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.734589 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6ff21-2d4f-4dfe-a117-47f2aeabd38e admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.735106 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25e063-d62e-4af8-8fd6-574e7d4cba9a admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.735451 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6ff21-2d4f-4dfe-a117-47f2aeabd38e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:32.735756 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6ff21-2d4f-4dfe-a117-47f2aeabd38e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.737487 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6ff21-2d4f-4dfe-a117-47f2aeabd38e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.748037 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25e063-d62e-4af8-8fd6-574e7d4cba9a admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.751179 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 262/515] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:32.752091 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6ff21-2d4f-4dfe-a117-47f2aeabd38e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.753897 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0b4da-50a6-497b-9f70-7ef38e52fbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.754936 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0b4da-50a6-497b-9f70-7ef38e52fbaf admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.755426 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0b4da-50a6-497b-9f70-7ef38e52fbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.755907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0b4da-50a6-497b-9f70-7ef38e52fbaf admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.757229 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0b4da-50a6-497b-9f70-7ef38e52fbaf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:32.758471 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0b4da-50a6-497b-9f70-7ef38e52fbaf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.761692 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0b4da-50a6-497b-9f70-7ef38e52fbaf admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.763655 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6ff21-2d4f-4dfe-a117-47f2aeabd38e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.768303 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40522c0c-75fb-4bf7-ad44-854b9001dac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.769154 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40522c0c-75fb-4bf7-ad44-854b9001dac4 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.769639 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40522c0c-75fb-4bf7-ad44-854b9001dac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.769888 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40522c0c-75fb-4bf7-ad44-854b9001dac4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.777241 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 254/516] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:32.778280 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0b4da-50a6-497b-9f70-7ef38e52fbaf admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.784231 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40522c0c-75fb-4bf7-ad44-854b9001dac4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.786372 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40522c0c-75fb-4bf7-ad44-854b9001dac4 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.788547 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0b4da-50a6-497b-9f70-7ef38e52fbaf admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.793779 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa9fe7-3609-4381-b862-85695650c39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.794829 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa9fe7-3609-4381-b862-85695650c39e admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.794829 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa9fe7-3609-4381-b862-85695650c39e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.795123 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa9fe7-3609-4381-b862-85695650c39e admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.803405 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa9fe7-3609-4381-b862-85695650c39e admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.806205 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-40522c0c-75fb-4bf7-ad44-854b9001dac4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:32.806341 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa9fe7-3609-4381-b862-85695650c39e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.807801 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 263/517] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:32.808776 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40522c0c-75fb-4bf7-ad44-854b9001dac4 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.819175 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40522c0c-75fb-4bf7-ad44-854b9001dac4 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.822457 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-7dfa9fe7-3609-4381-b862-85695650c39e admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 16 16:50:32.823945 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 255/518] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:32.824688 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa9fe7-3609-4381-b862-85695650c39e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.825886 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed8d8d-74d1-4eb4-a951-e4926e73da2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.826772 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed8d8d-74d1-4eb4-a951-e4926e73da2b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.827261 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed8d8d-74d1-4eb4-a951-e4926e73da2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.827716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed8d8d-74d1-4eb4-a951-e4926e73da2b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.828719 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed8d8d-74d1-4eb4-a951-e4926e73da2b admin admin] RBAC: Adding query filter params (role.id=9209cdab986041f1a45283ada1ae297a, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=c7b2c52a60aa499e82129ef29f8907ca) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:32.829202 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed8d8d-74d1-4eb4-a951-e4926e73da2b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.831381 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed8d8d-74d1-4eb4-a951-e4926e73da2b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.835022 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa9fe7-3609-4381-b862-85695650c39e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.837763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 264/519] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/role_assignments?user.id=c7b2c52a60aa499e82129ef29f8907ca&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=9209cdab986041f1a45283ada1ae297a => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:32.838688 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed8d8d-74d1-4eb4-a951-e4926e73da2b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.841711 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d893b-9177-40cd-be5c-949eeb5f4154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.842550 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d893b-9177-40cd-be5c-949eeb5f4154 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.843035 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d893b-9177-40cd-be5c-949eeb5f4154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.843450 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d893b-9177-40cd-be5c-949eeb5f4154 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.844323 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d893b-9177-40cd-be5c-949eeb5f4154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:32.844811 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d893b-9177-40cd-be5c-949eeb5f4154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.846639 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d893b-9177-40cd-be5c-949eeb5f4154 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.850106 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed8d8d-74d1-4eb4-a951-e4926e73da2b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.855586 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542785e2-067f-4f7e-9fa6-c0039082efe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.856378 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542785e2-067f-4f7e-9fa6-c0039082efe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.856990 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542785e2-067f-4f7e-9fa6-c0039082efe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.857329 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542785e2-067f-4f7e-9fa6-c0039082efe8 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.858251 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542785e2-067f-4f7e-9fa6-c0039082efe8 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:32.858628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542785e2-067f-4f7e-9fa6-c0039082efe8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.860634 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542785e2-067f-4f7e-9fa6-c0039082efe8 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.862702 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 256/520] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:32.868076 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d893b-9177-40cd-be5c-949eeb5f4154 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.881103 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d893b-9177-40cd-be5c-949eeb5f4154 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.885212 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 265/521] 10.222.0.42 () {56 vars in 1158 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:32.887192 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcaa37-40f1-4e74-bca6-a0bb89dead6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.888153 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcaa37-40f1-4e74-bca6-a0bb89dead6d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.888588 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcaa37-40f1-4e74-bca6-a0bb89dead6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.888984 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcaa37-40f1-4e74-bca6-a0bb89dead6d admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.890898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542785e2-067f-4f7e-9fa6-c0039082efe8 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.899993 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcaa37-40f1-4e74-bca6-a0bb89dead6d admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.902467 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcaa37-40f1-4e74-bca6-a0bb89dead6d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.921106 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-f3fcaa37-40f1-4e74-bca6-a0bb89dead6d admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 16 16:50:32.921313 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542785e2-067f-4f7e-9fa6-c0039082efe8 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.923285 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 257/522] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:32.928887 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcaa37-40f1-4e74-bca6-a0bb89dead6d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:32.936472 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd41fc-f461-45f0-805c-75775527f875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.938663 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd41fc-f461-45f0-805c-75775527f875 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.939205 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd41fc-f461-45f0-805c-75775527f875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.941081 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd41fc-f461-45f0-805c-75775527f875 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.952394 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcaa37-40f1-4e74-bca6-a0bb89dead6d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:32.961684 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd41fc-f461-45f0-805c-75775527f875 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.964815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57b4ca-0cac-4e23-b1fa-488d77454ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:32.965828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57b4ca-0cac-4e23-b1fa-488d77454ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:32.966800 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd41fc-f461-45f0-805c-75775527f875 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.967295 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57b4ca-0cac-4e23-b1fa-488d77454ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:32.968353 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57b4ca-0cac-4e23-b1fa-488d77454ac5 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:32.970423 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57b4ca-0cac-4e23-b1fa-488d77454ac5 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:32.973019 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57b4ca-0cac-4e23-b1fa-488d77454ac5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:32.975724 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57b4ca-0cac-4e23-b1fa-488d77454ac5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:32.988634 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 266/523] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:32.996031 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd41fc-f461-45f0-805c-75775527f875 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:33.001707 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 258/524] 10.222.0.42 () {56 vars in 1160 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:33.008892 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57b4ca-0cac-4e23-b1fa-488d77454ac5 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:33.010990 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd41fc-f461-45f0-805c-75775527f875 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:33.017990 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522e59b-6f67-44bb-8afc-476113d4853c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:33.019129 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522e59b-6f67-44bb-8afc-476113d4853c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:33.019417 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522e59b-6f67-44bb-8afc-476113d4853c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:33.019687 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522e59b-6f67-44bb-8afc-476113d4853c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:33.022016 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57b4ca-0cac-4e23-b1fa-488d77454ac5 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:33.027655 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b140732-8d98-4ec1-b2fc-0fe0ade45fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:33.029186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b140732-8d98-4ec1-b2fc-0fe0ade45fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:33.029671 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b140732-8d98-4ec1-b2fc-0fe0ade45fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:33.030501 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b140732-8d98-4ec1-b2fc-0fe0ade45fc3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:33.032240 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522e59b-6f67-44bb-8afc-476113d4853c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:33.034229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522e59b-6f67-44bb-8afc-476113d4853c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:33.041409 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b140732-8d98-4ec1-b2fc-0fe0ade45fc3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:33.043545 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b140732-8d98-4ec1-b2fc-0fe0ade45fc3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:33.054225 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 259/525] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:33.069709 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b140732-8d98-4ec1-b2fc-0fe0ade45fc3 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:33.079881 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b140732-8d98-4ec1-b2fc-0fe0ade45fc3 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:33.085083 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f20ce-08cb-41c5-bac7-4a0fb6c4b656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:33.086342 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f20ce-08cb-41c5-bac7-4a0fb6c4b656 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:33.086970 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f20ce-08cb-41c5-bac7-4a0fb6c4b656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:33.087459 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f20ce-08cb-41c5-bac7-4a0fb6c4b656 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:33.099268 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f20ce-08cb-41c5-bac7-4a0fb6c4b656 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:33.101985 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f20ce-08cb-41c5-bac7-4a0fb6c4b656 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:33.124217 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-cd3f20ce-08cb-41c5-bac7-4a0fb6c4b656 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:33.126306 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 260/526] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:33.131645 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f20ce-08cb-41c5-bac7-4a0fb6c4b656 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:33.142567 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f20ce-08cb-41c5-bac7-4a0fb6c4b656 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:33.149306 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01551a5d-06d1-4207-9c98-f047d30cf8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:33.150522 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01551a5d-06d1-4207-9c98-f047d30cf8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:33.151033 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01551a5d-06d1-4207-9c98-f047d30cf8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:33.151500 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01551a5d-06d1-4207-9c98-f047d30cf8a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:33.152523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01551a5d-06d1-4207-9c98-f047d30cf8a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:33.153029 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01551a5d-06d1-4207-9c98-f047d30cf8a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:33.154960 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01551a5d-06d1-4207-9c98-f047d30cf8a1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:33.179093 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 261/527] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:33.185221 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01551a5d-06d1-4207-9c98-f047d30cf8a1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:33.197300 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01551a5d-06d1-4207-9c98-f047d30cf8a1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:33.208737 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-7522e59b-6f67-44bb-8afc-476113d4853c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:33.209716 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce18541-3a02-4a25-9aea-1c00c677f109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:33.210223 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 267/528] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:33.210512 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce18541-3a02-4a25-9aea-1c00c677f109 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:33.211399 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce18541-3a02-4a25-9aea-1c00c677f109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:33.211675 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce18541-3a02-4a25-9aea-1c00c677f109 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:33.216243 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522e59b-6f67-44bb-8afc-476113d4853c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:33.223773 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce18541-3a02-4a25-9aea-1c00c677f109 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:33.225738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce18541-3a02-4a25-9aea-1c00c677f109 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:33.230773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522e59b-6f67-44bb-8afc-476113d4853c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:33.242395 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67308b97-a07d-40df-8ae8-5f55d342b0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:33.243148 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67308b97-a07d-40df-8ae8-5f55d342b0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:33.243436 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67308b97-a07d-40df-8ae8-5f55d342b0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:33.243719 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67308b97-a07d-40df-8ae8-5f55d342b0a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:33.244402 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67308b97-a07d-40df-8ae8-5f55d342b0a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:33.244703 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67308b97-a07d-40df-8ae8-5f55d342b0a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:33.246297 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67308b97-a07d-40df-8ae8-5f55d342b0a3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:33.258606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-cce18541-3a02-4a25-9aea-1c00c677f109 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:33.259069 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 268/529] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:33.259859 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 262/530] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:33.264468 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67308b97-a07d-40df-8ae8-5f55d342b0a3 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:33.267596 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce18541-3a02-4a25-9aea-1c00c677f109 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:33.284617 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67308b97-a07d-40df-8ae8-5f55d342b0a3 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:33.286996 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce18541-3a02-4a25-9aea-1c00c677f109 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:33.295067 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf970db-b414-4384-8ce3-9dd9007e33ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:33.297154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472c06c-0fec-4de3-bb42-da0ab051e19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:33.298054 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf970db-b414-4384-8ce3-9dd9007e33ef admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:33.298522 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf970db-b414-4384-8ce3-9dd9007e33ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:33.298802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472c06c-0fec-4de3-bb42-da0ab051e19f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:33.299257 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf970db-b414-4384-8ce3-9dd9007e33ef admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:33.299764 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472c06c-0fec-4de3-bb42-da0ab051e19f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:33.300744 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472c06c-0fec-4de3-bb42-da0ab051e19f admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:33.301942 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472c06c-0fec-4de3-bb42-da0ab051e19f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:33.303423 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472c06c-0fec-4de3-bb42-da0ab051e19f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:33.308596 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472c06c-0fec-4de3-bb42-da0ab051e19f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:33.314954 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf970db-b414-4384-8ce3-9dd9007e33ef admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:33.321437 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf970db-b414-4384-8ce3-9dd9007e33ef admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:33.333540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 263/531] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:33.340340 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472c06c-0fec-4de3-bb42-da0ab051e19f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:33.347011 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-9bf970db-b414-4384-8ce3-9dd9007e33ef admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:33.350992 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 269/532] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:33.353479 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472c06c-0fec-4de3-bb42-da0ab051e19f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:33.355038 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf970db-b414-4384-8ce3-9dd9007e33ef admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:33.366142 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f022c9-caec-4189-bcad-4205b3e5d591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:33.367896 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f022c9-caec-4189-bcad-4205b3e5d591 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:33.368406 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f022c9-caec-4189-bcad-4205b3e5d591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:33.368871 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f022c9-caec-4189-bcad-4205b3e5d591 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:33.371964 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f022c9-caec-4189-bcad-4205b3e5d591 admin admin] RBAC: Adding query filter params (role.id=9209cdab986041f1a45283ada1ae297a, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=f6db9534cc094e8281b0aa34e2cb4b46) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:33.372792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f022c9-caec-4189-bcad-4205b3e5d591 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:33.375958 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f022c9-caec-4189-bcad-4205b3e5d591 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:33.380926 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf970db-b414-4384-8ce3-9dd9007e33ef admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:33.383593 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 264/533] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:33 2022] GET /identity/v3/role_assignments?user.id=f6db9534cc094e8281b0aa34e2cb4b46&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=9209cdab986041f1a45283ada1ae297a => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:33.395190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d48b4-710d-46c6-91e2-cb6ff6e01944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:33.396302 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d48b4-710d-46c6-91e2-cb6ff6e01944 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:33.396775 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d48b4-710d-46c6-91e2-cb6ff6e01944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:33.397383 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d48b4-710d-46c6-91e2-cb6ff6e01944 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:33.398986 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d48b4-710d-46c6-91e2-cb6ff6e01944 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:33.399569 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d48b4-710d-46c6-91e2-cb6ff6e01944 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:33.400900 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-b05d48b4-710d-46c6-91e2-cb6ff6e01944 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:50:33.400900 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 16:50:33.400900 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 16:50:33.402550 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d48b4-710d-46c6-91e2-cb6ff6e01944 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:33.436284 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 270/534] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:33.437940 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f022c9-caec-4189-bcad-4205b3e5d591 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:33.451045 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f022c9-caec-4189-bcad-4205b3e5d591 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:33.456716 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17a760-b329-4c57-8f20-1977a5819448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:33.457752 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17a760-b329-4c57-8f20-1977a5819448 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:33.458275 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17a760-b329-4c57-8f20-1977a5819448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:33.458779 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17a760-b329-4c57-8f20-1977a5819448 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:33.459895 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17a760-b329-4c57-8f20-1977a5819448 admin admin] RBAC: Adding query filter params (role.id=9209cdab986041f1a45283ada1ae297a, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=07ca3e2a770f463a95dfb045ffd51dd6) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:33.460418 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17a760-b329-4c57-8f20-1977a5819448 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:33.462822 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17a760-b329-4c57-8f20-1977a5819448 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:33.473658 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 265/535] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:33 2022] GET /identity/v3/role_assignments?user.id=07ca3e2a770f463a95dfb045ffd51dd6&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=9209cdab986041f1a45283ada1ae297a => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:33.619763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaab6c-5585-40b7-ba8d-040b47446b36 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:33.620367 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaab6c-5585-40b7-ba8d-040b47446b36 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:33.620857 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaab6c-5585-40b7-ba8d-040b47446b36 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:33.622861 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 271/536] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:33.628816 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c5084-1f38-4ba7-b07e-c63821173a03 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:33.629227 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c5084-1f38-4ba7-b07e-c63821173a03 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:33.629597 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c5084-1f38-4ba7-b07e-c63821173a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:33.651377 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-147c5084-1f38-4ba7-b07e-c63821173a03 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:33.652723 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-147c5084-1f38-4ba7-b07e-c63821173a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:33.664968 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 266/537] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:33.702274 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaab6c-5585-40b7-ba8d-040b47446b36 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:33.720468 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaab6c-5585-40b7-ba8d-040b47446b36 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:33.725037 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571d6d0-2e10-418b-bcce-8f5550040603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:33.725918 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571d6d0-2e10-418b-bcce-8f5550040603 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:33.726971 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571d6d0-2e10-418b-bcce-8f5550040603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:33.727485 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571d6d0-2e10-418b-bcce-8f5550040603 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:33.742082 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571d6d0-2e10-418b-bcce-8f5550040603 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:33.744085 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571d6d0-2e10-418b-bcce-8f5550040603 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:33.766791 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-4571d6d0-2e10-418b-bcce-8f5550040603 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:33.768928 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 272/538] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:33.774465 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c5084-1f38-4ba7-b07e-c63821173a03 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:33.784994 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c5084-1f38-4ba7-b07e-c63821173a03 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:33.790852 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88caba-b035-418b-946d-d966d86d989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:33.791619 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88caba-b035-418b-946d-d966d86d989f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:33.792083 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88caba-b035-418b-946d-d966d86d989f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:33.792460 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88caba-b035-418b-946d-d966d86d989f admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:33.793287 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88caba-b035-418b-946d-d966d86d989f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:33.793699 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88caba-b035-418b-946d-d966d86d989f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:33.795385 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88caba-b035-418b-946d-d966d86d989f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:33.807815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 267/539] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:33.813735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571d6d0-2e10-418b-bcce-8f5550040603 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:33.824628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571d6d0-2e10-418b-bcce-8f5550040603 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:33.829364 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34636473-7426-431e-af25-867509b5285d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:33.830172 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34636473-7426-431e-af25-867509b5285d admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:33.830546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34636473-7426-431e-af25-867509b5285d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:33.830985 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34636473-7426-431e-af25-867509b5285d admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:33.831909 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34636473-7426-431e-af25-867509b5285d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:33.833968 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34636473-7426-431e-af25-867509b5285d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:33.935406 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 273/540] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Feb 16 16:50:33 2022] POST /identity/v3/users => generated 247 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:50:35.434467 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00663b7d-86e0-4d07-b1af-9fea34d9a3af None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:35.435551 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00663b7d-86e0-4d07-b1af-9fea34d9a3af None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:35.436060 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00663b7d-86e0-4d07-b1af-9fea34d9a3af None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:35.438323 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 268/541] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:35.443399 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44213b3-e692-4bd3-9cfa-ca50ee5a956c None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:35.444267 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44213b3-e692-4bd3-9cfa-ca50ee5a956c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:35.444745 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44213b3-e692-4bd3-9cfa-ca50ee5a956c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:35.470248 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-e44213b3-e692-4bd3-9cfa-ca50ee5a956c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:35.471792 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e44213b3-e692-4bd3-9cfa-ca50ee5a956c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:35.485182 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 274/542] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:35.522769 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00663b7d-86e0-4d07-b1af-9fea34d9a3af None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:35.546076 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00663b7d-86e0-4d07-b1af-9fea34d9a3af None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:35.553927 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe2e9f-1cec-4ab0-bcd2-bd0758634653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:35.555261 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe2e9f-1cec-4ab0-bcd2-bd0758634653 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:35.555536 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe2e9f-1cec-4ab0-bcd2-bd0758634653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:35.555929 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe2e9f-1cec-4ab0-bcd2-bd0758634653 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:35.568713 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe2e9f-1cec-4ab0-bcd2-bd0758634653 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:35.576152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-28fe2e9f-1cec-4ab0-bcd2-bd0758634653 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:50:35.577730 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 269/543] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:35.583164 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44213b3-e692-4bd3-9cfa-ca50ee5a956c None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:35.597546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44213b3-e692-4bd3-9cfa-ca50ee5a956c None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:35.598836 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b306c82-2319-4f03-bd5d-da324e0ad319 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:35.599125 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b306c82-2319-4f03-bd5d-da324e0ad319 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:35.599404 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b306c82-2319-4f03-bd5d-da324e0ad319 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:35.601457 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 270/544] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:50:35.605350 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68658c57-86f3-47db-810d-ba0bd860232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:35.606600 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7fe51-e9e3-4e25-af12-ffa69cd82ea2 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:35.607249 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7fe51-e9e3-4e25-af12-ffa69cd82ea2 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:35.607590 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7fe51-e9e3-4e25-af12-ffa69cd82ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:35.610243 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68658c57-86f3-47db-810d-ba0bd860232e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:35.611534 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68658c57-86f3-47db-810d-ba0bd860232e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:35.611885 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68658c57-86f3-47db-810d-ba0bd860232e admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:35.613753 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68658c57-86f3-47db-810d-ba0bd860232e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:35.614137 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68658c57-86f3-47db-810d-ba0bd860232e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:35.617816 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68658c57-86f3-47db-810d-ba0bd860232e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:35.636846 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 275/545] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:50:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:35.640843 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-eee7fe51-e9e3-4e25-af12-ffa69cd82ea2 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:35.642101 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-eee7fe51-e9e3-4e25-af12-ffa69cd82ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:35.643097 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68658c57-86f3-47db-810d-ba0bd860232e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:35.656297 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 271/546] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:35.666384 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68658c57-86f3-47db-810d-ba0bd860232e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:35.671345 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca1136-a600-4ae6-be75-822de077f85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:35.672708 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca1136-a600-4ae6-be75-822de077f85b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:35.673010 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca1136-a600-4ae6-be75-822de077f85b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:35.673288 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca1136-a600-4ae6-be75-822de077f85b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:35.681680 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7fe51-e9e3-4e25-af12-ffa69cd82ea2 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:35.692325 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7fe51-e9e3-4e25-af12-ffa69cd82ea2 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:35.692826 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca1136-a600-4ae6-be75-822de077f85b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:35.702669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca1136-a600-4ae6-be75-822de077f85b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:35.707900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e00578-f4e4-4cee-b760-7690795cddc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:35.708836 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e00578-f4e4-4cee-b760-7690795cddc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:35.709212 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e00578-f4e4-4cee-b760-7690795cddc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:35.709584 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e00578-f4e4-4cee-b760-7690795cddc3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:35.720333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-30ca1136-a600-4ae6-be75-822de077f85b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:35.730501 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 276/547] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:35.735377 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e00578-f4e4-4cee-b760-7690795cddc3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:35.743202 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-85e00578-f4e4-4cee-b760-7690795cddc3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:50:35.744889 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 272/548] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:35.750509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e00578-f4e4-4cee-b760-7690795cddc3 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:35.750751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca1136-a600-4ae6-be75-822de077f85b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:35.762432 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e00578-f4e4-4cee-b760-7690795cddc3 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:35.766502 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca1136-a600-4ae6-be75-822de077f85b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:35.772210 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6539d-ca41-411d-ba2b-e4ff18a4b960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:35.773142 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6539d-ca41-411d-ba2b-e4ff18a4b960 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:35.774040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6539d-ca41-411d-ba2b-e4ff18a4b960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:35.774905 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6539d-ca41-411d-ba2b-e4ff18a4b960 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:35.775824 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6539d-ca41-411d-ba2b-e4ff18a4b960 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:35.776599 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6539d-ca41-411d-ba2b-e4ff18a4b960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:35.778824 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6539d-ca41-411d-ba2b-e4ff18a4b960 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:35.779546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd107fa-6f27-4619-b368-cde725befbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:35.780353 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd107fa-6f27-4619-b368-cde725befbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:35.780786 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd107fa-6f27-4619-b368-cde725befbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:35.781258 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd107fa-6f27-4619-b368-cde725befbe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:35.782881 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd107fa-6f27-4619-b368-cde725befbe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:35.784162 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd107fa-6f27-4619-b368-cde725befbe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:35.785880 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd107fa-6f27-4619-b368-cde725befbe9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:35.804498 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 273/549] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:50:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:35.812716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 277/550] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:35.814546 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6539d-ca41-411d-ba2b-e4ff18a4b960 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:35.818724 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd107fa-6f27-4619-b368-cde725befbe9 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:35.835242 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6539d-ca41-411d-ba2b-e4ff18a4b960 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:35.838198 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd107fa-6f27-4619-b368-cde725befbe9 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:35.846378 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d416-1bc1-462f-bd9e-1e68abaeb244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:35.847205 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd67de4-e90f-426b-8306-63fa595a782f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:35.848099 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd67de4-e90f-426b-8306-63fa595a782f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:35.848968 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d416-1bc1-462f-bd9e-1e68abaeb244 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:35.849344 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d416-1bc1-462f-bd9e-1e68abaeb244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:35.849727 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd67de4-e90f-426b-8306-63fa595a782f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:35.850139 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd67de4-e90f-426b-8306-63fa595a782f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:35.850505 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d416-1bc1-462f-bd9e-1e68abaeb244 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:35.872006 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd67de4-e90f-426b-8306-63fa595a782f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:35.874248 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd67de4-e90f-426b-8306-63fa595a782f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:35.875685 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2d416-1bc1-462f-bd9e-1e68abaeb244 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:35.878214 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2d416-1bc1-462f-bd9e-1e68abaeb244 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:35.898973 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-0cd67de4-e90f-426b-8306-63fa595a782f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 16:50:35.900740 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 278/551] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Feb 16 16:50:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:35.909775 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-f5f2d416-1bc1-462f-bd9e-1e68abaeb244 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:35.910875 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd67de4-e90f-426b-8306-63fa595a782f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:35.911493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 274/552] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:35.925106 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d416-1bc1-462f-bd9e-1e68abaeb244 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:35.926415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd67de4-e90f-426b-8306-63fa595a782f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:35.936435 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d416-1bc1-462f-bd9e-1e68abaeb244 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:35.937768 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895703b9-a9a8-4f51-ad7e-5e6311f25c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:35.938902 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895703b9-a9a8-4f51-ad7e-5e6311f25c92 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:35.939681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895703b9-a9a8-4f51-ad7e-5e6311f25c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:35.940376 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895703b9-a9a8-4f51-ad7e-5e6311f25c92 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:35.941783 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895703b9-a9a8-4f51-ad7e-5e6311f25c92 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:35.942736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895703b9-a9a8-4f51-ad7e-5e6311f25c92 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:35.945587 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895703b9-a9a8-4f51-ad7e-5e6311f25c92 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:35.949159 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014caa6e-a392-42f2-894b-6f48997f7430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:35.949913 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014caa6e-a392-42f2-894b-6f48997f7430 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:35.950329 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014caa6e-a392-42f2-894b-6f48997f7430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:35.950733 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014caa6e-a392-42f2-894b-6f48997f7430 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:35.951550 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014caa6e-a392-42f2-894b-6f48997f7430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:35.951950 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014caa6e-a392-42f2-894b-6f48997f7430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:35.953604 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014caa6e-a392-42f2-894b-6f48997f7430 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:35.980744 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 275/553] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:35.986368 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014caa6e-a392-42f2-894b-6f48997f7430 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:35.993776 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 279/554] 10.222.0.42 () {56 vars in 1154 bytes} [Wed Feb 16 16:50:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:36.002414 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014caa6e-a392-42f2-894b-6f48997f7430 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.003553 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895703b9-a9a8-4f51-ad7e-5e6311f25c92 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.006940 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f424d0-aa73-4a09-9da8-09c33c1a293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.008572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f424d0-aa73-4a09-9da8-09c33c1a293d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.009060 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f424d0-aa73-4a09-9da8-09c33c1a293d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.009433 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f424d0-aa73-4a09-9da8-09c33c1a293d admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.017642 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f424d0-aa73-4a09-9da8-09c33c1a293d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.019769 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f424d0-aa73-4a09-9da8-09c33c1a293d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.022080 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895703b9-a9a8-4f51-ad7e-5e6311f25c92 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.034268 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-88f424d0-aa73-4a09-9da8-09c33c1a293d admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 16 16:50:36.035258 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71215a4-3dd5-4f87-91aa-534b562e9aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.035988 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 276/555] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:36.036404 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71215a4-3dd5-4f87-91aa-534b562e9aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.036687 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71215a4-3dd5-4f87-91aa-534b562e9aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.036961 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71215a4-3dd5-4f87-91aa-534b562e9aa7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.044393 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f424d0-aa73-4a09-9da8-09c33c1a293d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.062974 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71215a4-3dd5-4f87-91aa-534b562e9aa7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.064367 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f424d0-aa73-4a09-9da8-09c33c1a293d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.065667 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71215a4-3dd5-4f87-91aa-534b562e9aa7 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.074123 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca77996-f4aa-41d4-b4f5-7e8b832c050d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.076103 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca77996-f4aa-41d4-b4f5-7e8b832c050d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.077953 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca77996-f4aa-41d4-b4f5-7e8b832c050d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.078241 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca77996-f4aa-41d4-b4f5-7e8b832c050d admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.079135 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca77996-f4aa-41d4-b4f5-7e8b832c050d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:36.080104 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca77996-f4aa-41d4-b4f5-7e8b832c050d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.084396 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca77996-f4aa-41d4-b4f5-7e8b832c050d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.099930 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-a71215a4-3dd5-4f87-91aa-534b562e9aa7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:36.103121 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 280/556] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:36.107617 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71215a4-3dd5-4f87-91aa-534b562e9aa7 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.120284 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71215a4-3dd5-4f87-91aa-534b562e9aa7 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.125453 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5823e48-e61a-4be6-9b1a-079743a66856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.126167 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 277/557] 10.222.0.42 () {56 vars in 1158 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:36.126588 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5823e48-e61a-4be6-9b1a-079743a66856 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.127169 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5823e48-e61a-4be6-9b1a-079743a66856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.127645 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5823e48-e61a-4be6-9b1a-079743a66856 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.128569 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5823e48-e61a-4be6-9b1a-079743a66856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:36.129084 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5823e48-e61a-4be6-9b1a-079743a66856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.131034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5823e48-e61a-4be6-9b1a-079743a66856 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.131358 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca77996-f4aa-41d4-b4f5-7e8b832c050d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.152716 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca77996-f4aa-41d4-b4f5-7e8b832c050d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.159306 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 281/558] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:36.161523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f554f4-c6e2-4484-896e-b2c2fd76fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.162576 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f554f4-c6e2-4484-896e-b2c2fd76fbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.163206 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f554f4-c6e2-4484-896e-b2c2fd76fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.165305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5823e48-e61a-4be6-9b1a-079743a66856 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.166225 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f554f4-c6e2-4484-896e-b2c2fd76fbd1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.183556 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5823e48-e61a-4be6-9b1a-079743a66856 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.189847 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f554f4-c6e2-4484-896e-b2c2fd76fbd1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.193437 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f554f4-c6e2-4484-896e-b2c2fd76fbd1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.197122 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ab119-8947-4722-9cc6-4523b96c04db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.198210 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ab119-8947-4722-9cc6-4523b96c04db admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.199360 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ab119-8947-4722-9cc6-4523b96c04db admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.200425 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ab119-8947-4722-9cc6-4523b96c04db admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.217007 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ab119-8947-4722-9cc6-4523b96c04db admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.222496 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ab119-8947-4722-9cc6-4523b96c04db admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.228355 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-77f554f4-c6e2-4484-896e-b2c2fd76fbd1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:36.230443 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 278/559] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:36.232203 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53378d46-325b-4cb9-888d-fd37d23a31ec None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.232997 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53378d46-325b-4cb9-888d-fd37d23a31ec None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.233476 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53378d46-325b-4cb9-888d-fd37d23a31ec None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.235411 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 279/560] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:36.236335 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53378d46-325b-4cb9-888d-fd37d23a31ec None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.244714 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-758ab119-8947-4722-9cc6-4523b96c04db admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:36.246174 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 282/561] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:36.247457 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e00de-5b26-44a0-87e0-97b44c5c010d None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.247725 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e00de-5b26-44a0-87e0-97b44c5c010d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.248018 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e00de-5b26-44a0-87e0-97b44c5c010d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.251546 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53378d46-325b-4cb9-888d-fd37d23a31ec None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.257766 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecf175-3b76-4507-98fc-6f5fc8a1cfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.258890 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecf175-3b76-4507-98fc-6f5fc8a1cfa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.259467 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecf175-3b76-4507-98fc-6f5fc8a1cfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.259956 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecf175-3b76-4507-98fc-6f5fc8a1cfa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.261416 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecf175-3b76-4507-98fc-6f5fc8a1cfa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:36.262200 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecf175-3b76-4507-98fc-6f5fc8a1cfa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.264114 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecf175-3b76-4507-98fc-6f5fc8a1cfa0 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.265833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-f91e00de-5b26-44a0-87e0-97b44c5c010d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:36.267225 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f91e00de-5b26-44a0-87e0-97b44c5c010d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:36.277488 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 283/562] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:36.277868 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 280/563] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:36.278293 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e00de-5b26-44a0-87e0-97b44c5c010d None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.287987 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecf175-3b76-4507-98fc-6f5fc8a1cfa0 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.293579 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e00de-5b26-44a0-87e0-97b44c5c010d None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.299346 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b99314-f799-443d-916a-e9c8ca500548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.300179 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b99314-f799-443d-916a-e9c8ca500548 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.300601 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b99314-f799-443d-916a-e9c8ca500548 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.300879 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b99314-f799-443d-916a-e9c8ca500548 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.301661 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b99314-f799-443d-916a-e9c8ca500548 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:36.301968 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b99314-f799-443d-916a-e9c8ca500548 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.302470 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecf175-3b76-4507-98fc-6f5fc8a1cfa0 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.303862 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b99314-f799-443d-916a-e9c8ca500548 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.307586 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93d8db-082c-4c5f-9548-58bbad5e8c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.308361 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93d8db-082c-4c5f-9548-58bbad5e8c39 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.308649 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93d8db-082c-4c5f-9548-58bbad5e8c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.308918 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93d8db-082c-4c5f-9548-58bbad5e8c39 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.315851 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93d8db-082c-4c5f-9548-58bbad5e8c39 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.316992 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 284/564] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:36.318106 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d9178-3d98-4046-9e2e-3682970add17 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.318392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d9178-3d98-4046-9e2e-3682970add17 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.318684 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d9178-3d98-4046-9e2e-3682970add17 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.319936 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93d8db-082c-4c5f-9548-58bbad5e8c39 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.320812 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 285/565] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:36.321507 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d9178-3d98-4046-9e2e-3682970add17 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.334754 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d9178-3d98-4046-9e2e-3682970add17 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.337284 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-fc93d8db-082c-4c5f-9548-58bbad5e8c39 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:36.338754 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 281/566] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:36.339678 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93d8db-082c-4c5f-9548-58bbad5e8c39 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.340490 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0de3c-be16-4920-8c05-3158d2fcaa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.341368 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0de3c-be16-4920-8c05-3158d2fcaa6e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.341707 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0de3c-be16-4920-8c05-3158d2fcaa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.342122 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0de3c-be16-4920-8c05-3158d2fcaa6e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.348827 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93d8db-082c-4c5f-9548-58bbad5e8c39 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.354040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896166c-2548-401b-a1a8-9e679a3c45e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.354969 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896166c-2548-401b-a1a8-9e679a3c45e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.355313 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896166c-2548-401b-a1a8-9e679a3c45e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.355417 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0de3c-be16-4920-8c05-3158d2fcaa6e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:36.355703 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896166c-2548-401b-a1a8-9e679a3c45e1 admin admin] PATH_INFO: `/v3/projects/6160f9606d06486b9a11a23ee717af79/users/9a30603a236e4681a7702eec7029e9db/roles/9209cdab986041f1a45283ada1ae297a` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.364869 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-2fa0de3c-be16-4920-8c05-3158d2fcaa6e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:50:36.368110 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 286/567] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:36.369312 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc171a7-c5ea-4857-86b1-f593e55c59fa None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.369857 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc171a7-c5ea-4857-86b1-f593e55c59fa None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.370135 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc171a7-c5ea-4857-86b1-f593e55c59fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.371513 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896166c-2548-401b-a1a8-9e679a3c45e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6160f9606d06486b9a11a23ee717af79, user_id=9a30603a236e4681a7702eec7029e9db, role_id=9209cdab986041f1a45283ada1ae297a)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.374234 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896166c-2548-401b-a1a8-9e679a3c45e1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.389622 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-2bc171a7-c5ea-4857-86b1-f593e55c59fa None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:36.393328 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2bc171a7-c5ea-4857-86b1-f593e55c59fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:36.398898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 287/568] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:36.399722 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc171a7-c5ea-4857-86b1-f593e55c59fa None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.408784 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc171a7-c5ea-4857-86b1-f593e55c59fa None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.413102 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da12ef6-181b-4a05-956b-bdffb5d487ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.413838 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da12ef6-181b-4a05-956b-bdffb5d487ce admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.414154 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da12ef6-181b-4a05-956b-bdffb5d487ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.414485 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da12ef6-181b-4a05-956b-bdffb5d487ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.415348 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da12ef6-181b-4a05-956b-bdffb5d487ce admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:36.415716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da12ef6-181b-4a05-956b-bdffb5d487ce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.417590 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da12ef6-181b-4a05-956b-bdffb5d487ce admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.429110 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 288/569] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:36.430525 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da12ef6-181b-4a05-956b-bdffb5d487ce admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.439808 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da12ef6-181b-4a05-956b-bdffb5d487ce admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.444135 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656409a-51bf-4a22-9a40-fdc0a18995c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.444705 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656409a-51bf-4a22-9a40-fdc0a18995c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.445719 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656409a-51bf-4a22-9a40-fdc0a18995c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.446046 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656409a-51bf-4a22-9a40-fdc0a18995c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.446933 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656409a-51bf-4a22-9a40-fdc0a18995c3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:36.447235 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656409a-51bf-4a22-9a40-fdc0a18995c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.448880 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656409a-51bf-4a22-9a40-fdc0a18995c3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.456940 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 289/570] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:36.457713 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656409a-51bf-4a22-9a40-fdc0a18995c3 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.467029 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656409a-51bf-4a22-9a40-fdc0a18995c3 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.473741 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 282/571] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:50:36 2022] PUT /identity/v3/projects/6160f9606d06486b9a11a23ee717af79/users/9a30603a236e4681a7702eec7029e9db/roles/9209cdab986041f1a45283ada1ae297a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:50:36.474319 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896166c-2548-401b-a1a8-9e679a3c45e1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.547049 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8efedb-96ea-467c-b5ec-e7db345821b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.550708 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8efedb-96ea-467c-b5ec-e7db345821b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.550708 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8efedb-96ea-467c-b5ec-e7db345821b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.550708 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8efedb-96ea-467c-b5ec-e7db345821b3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.562849 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896166c-2548-401b-a1a8-9e679a3c45e1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.563083 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8efedb-96ea-467c-b5ec-e7db345821b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:36.567848 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f0bb5-8bd6-43c5-9330-8c9a0caeeb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.568793 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f0bb5-8bd6-43c5-9330-8c9a0caeeb15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.569078 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f0bb5-8bd6-43c5-9330-8c9a0caeeb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.569497 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f0bb5-8bd6-43c5-9330-8c9a0caeeb15 admin admin] PATH_INFO: `/v3/projects/6160f9606d06486b9a11a23ee717af79/users/c7b2c52a60aa499e82129ef29f8907ca/roles/9209cdab986041f1a45283ada1ae297a` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.570535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-6c8efedb-96ea-467c-b5ec-e7db345821b3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:50:36.572126 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 290/572] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:36.572951 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8efedb-96ea-467c-b5ec-e7db345821b3 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.593735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8efedb-96ea-467c-b5ec-e7db345821b3 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.594671 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f0bb5-8bd6-43c5-9330-8c9a0caeeb15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6160f9606d06486b9a11a23ee717af79, user_id=c7b2c52a60aa499e82129ef29f8907ca, role_id=9209cdab986041f1a45283ada1ae297a)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.597939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f0bb5-8bd6-43c5-9330-8c9a0caeeb15 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.598443 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729015d-481f-49c9-8efb-e5b1fd82897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.599450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729015d-481f-49c9-8efb-e5b1fd82897b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.599814 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729015d-481f-49c9-8efb-e5b1fd82897b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.600154 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729015d-481f-49c9-8efb-e5b1fd82897b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.612495 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729015d-481f-49c9-8efb-e5b1fd82897b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.619492 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729015d-481f-49c9-8efb-e5b1fd82897b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.632117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-c729015d-481f-49c9-8efb-e5b1fd82897b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:36.634801 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 291/573] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:36.635381 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729015d-481f-49c9-8efb-e5b1fd82897b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.649548 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729015d-481f-49c9-8efb-e5b1fd82897b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.654176 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d5a7f-d86f-44b8-b6ba-b66f1dd42d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.655019 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d5a7f-d86f-44b8-b6ba-b66f1dd42d8c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.655198 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d5a7f-d86f-44b8-b6ba-b66f1dd42d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.655462 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d5a7f-d86f-44b8-b6ba-b66f1dd42d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.656212 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d5a7f-d86f-44b8-b6ba-b66f1dd42d8c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:36.656514 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d5a7f-d86f-44b8-b6ba-b66f1dd42d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.658118 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d5a7f-d86f-44b8-b6ba-b66f1dd42d8c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.667721 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 292/574] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:36.668009 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d5a7f-d86f-44b8-b6ba-b66f1dd42d8c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.683158 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d5a7f-d86f-44b8-b6ba-b66f1dd42d8c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.688408 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23acdbf9-33b1-43f6-ac10-c9f75e746dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.689061 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acdbf9-33b1-43f6-ac10-c9f75e746dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.689340 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acdbf9-33b1-43f6-ac10-c9f75e746dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.689609 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acdbf9-33b1-43f6-ac10-c9f75e746dd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.690326 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23acdbf9-33b1-43f6-ac10-c9f75e746dd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:36.690624 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23acdbf9-33b1-43f6-ac10-c9f75e746dd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.692233 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23acdbf9-33b1-43f6-ac10-c9f75e746dd7 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.705535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 293/575] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:36.706283 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23acdbf9-33b1-43f6-ac10-c9f75e746dd7 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.722378 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 283/576] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:50:36 2022] PUT /identity/v3/projects/6160f9606d06486b9a11a23ee717af79/users/c7b2c52a60aa499e82129ef29f8907ca/roles/9209cdab986041f1a45283ada1ae297a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:50:36.722378 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f0bb5-8bd6-43c5-9330-8c9a0caeeb15 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.723745 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23acdbf9-33b1-43f6-ac10-c9f75e746dd7 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.846806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e0468-78dc-4c0d-84ed-66de20f61091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.847673 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e0468-78dc-4c0d-84ed-66de20f61091 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.847948 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e0468-78dc-4c0d-84ed-66de20f61091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.848217 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e0468-78dc-4c0d-84ed-66de20f61091 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.862006 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e0468-78dc-4c0d-84ed-66de20f61091 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.863928 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e0468-78dc-4c0d-84ed-66de20f61091 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.878614 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f0bb5-8bd6-43c5-9330-8c9a0caeeb15 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.886922 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-a17e0468-78dc-4c0d-84ed-66de20f61091 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:36.888470 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 294/577] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:36.889282 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbfcd5-da0c-4e96-9a56-94cdf7fe2144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.890200 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbfcd5-da0c-4e96-9a56-94cdf7fe2144 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.890581 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbfcd5-da0c-4e96-9a56-94cdf7fe2144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.890981 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbfcd5-da0c-4e96-9a56-94cdf7fe2144 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.903199 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e0468-78dc-4c0d-84ed-66de20f61091 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.912969 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbfcd5-da0c-4e96-9a56-94cdf7fe2144 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.917368 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbfcd5-da0c-4e96-9a56-94cdf7fe2144 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.922439 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e0468-78dc-4c0d-84ed-66de20f61091 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.936284 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3fe24-81e2-46e4-af91-5734dab4890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.936961 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3fe24-81e2-46e4-af91-5734dab4890e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.937290 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3fe24-81e2-46e4-af91-5734dab4890e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.937562 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3fe24-81e2-46e4-af91-5734dab4890e admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.938201 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-b5fbfcd5-da0c-4e96-9a56-94cdf7fe2144 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 16 16:50:36.938312 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3fe24-81e2-46e4-af91-5734dab4890e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:36.938630 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3fe24-81e2-46e4-af91-5734dab4890e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.939614 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 284/578] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:36.940355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3fe24-81e2-46e4-af91-5734dab4890e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.944927 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbfcd5-da0c-4e96-9a56-94cdf7fe2144 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.955081 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 295/579] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:36.961849 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbfcd5-da0c-4e96-9a56-94cdf7fe2144 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.964878 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3fe24-81e2-46e4-af91-5734dab4890e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:36.968643 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9825a4-69b9-4e5f-a9b6-3fadd54d22e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.969312 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9825a4-69b9-4e5f-a9b6-3fadd54d22e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.969691 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9825a4-69b9-4e5f-a9b6-3fadd54d22e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.970002 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9825a4-69b9-4e5f-a9b6-3fadd54d22e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.970880 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9825a4-69b9-4e5f-a9b6-3fadd54d22e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:36.971191 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9825a4-69b9-4e5f-a9b6-3fadd54d22e1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:36.973030 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9825a4-69b9-4e5f-a9b6-3fadd54d22e1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:36.978186 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3fe24-81e2-46e4-af91-5734dab4890e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:36.984987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ad9ba-8ac0-498c-a36b-76aa82e529db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:36.985781 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ad9ba-8ac0-498c-a36b-76aa82e529db admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:36.986748 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ad9ba-8ac0-498c-a36b-76aa82e529db admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:36.986748 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ad9ba-8ac0-498c-a36b-76aa82e529db admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:36.997748 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ad9ba-8ac0-498c-a36b-76aa82e529db admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.002483 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ad9ba-8ac0-498c-a36b-76aa82e529db admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:37.003149 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 285/580] 10.222.0.42 () {56 vars in 1160 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:37.004241 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9825a4-69b9-4e5f-a9b6-3fadd54d22e1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.014539 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9825a4-69b9-4e5f-a9b6-3fadd54d22e1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.016972 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-cf3ad9ba-8ac0-498c-a36b-76aa82e529db admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 16 16:50:37.022681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 296/581] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:37.022795 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ece82-a36c-44b9-9086-43a4dec830de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.023963 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ece82-a36c-44b9-9086-43a4dec830de admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.024242 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ece82-a36c-44b9-9086-43a4dec830de admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.024531 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ece82-a36c-44b9-9086-43a4dec830de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.025500 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ad9ba-8ac0-498c-a36b-76aa82e529db admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.035638 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ad9ba-8ac0-498c-a36b-76aa82e529db admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.041140 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cba07-fdf9-407d-9a76-29f64f922b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.041785 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cba07-fdf9-407d-9a76-29f64f922b62 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.042066 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cba07-fdf9-407d-9a76-29f64f922b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.042340 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cba07-fdf9-407d-9a76-29f64f922b62 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.043215 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cba07-fdf9-407d-9a76-29f64f922b62 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:37.043761 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cba07-fdf9-407d-9a76-29f64f922b62 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.045317 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cba07-fdf9-407d-9a76-29f64f922b62 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:37.046303 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ece82-a36c-44b9-9086-43a4dec830de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.049418 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ece82-a36c-44b9-9086-43a4dec830de admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:37.063546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 297/582] 10.222.0.42 () {56 vars in 1158 bytes} [Wed Feb 16 16:50:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:37.068934 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cba07-fdf9-407d-9a76-29f64f922b62 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.071154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-c78ece82-a36c-44b9-9086-43a4dec830de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:37.072846 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 286/583] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:37.078392 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ece82-a36c-44b9-9086-43a4dec830de admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.079781 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cba07-fdf9-407d-9a76-29f64f922b62 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.084555 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bbcd7-c929-4d23-81b6-750370b1f332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.085331 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bbcd7-c929-4d23-81b6-750370b1f332 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.086181 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bbcd7-c929-4d23-81b6-750370b1f332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.086501 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bbcd7-c929-4d23-81b6-750370b1f332 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.091512 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ece82-a36c-44b9-9086-43a4dec830de admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.096410 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825f115-d2ad-45c1-b7af-ab3328f35098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.097317 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825f115-d2ad-45c1-b7af-ab3328f35098 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.097798 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825f115-d2ad-45c1-b7af-ab3328f35098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.098273 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825f115-d2ad-45c1-b7af-ab3328f35098 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.098376 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bbcd7-c929-4d23-81b6-750370b1f332 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.099338 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825f115-d2ad-45c1-b7af-ab3328f35098 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:37.099865 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825f115-d2ad-45c1-b7af-ab3328f35098 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.100252 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bbcd7-c929-4d23-81b6-750370b1f332 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:37.102816 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825f115-d2ad-45c1-b7af-ab3328f35098 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:37.115710 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 287/584] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:37.119380 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-5f5bbcd7-c929-4d23-81b6-750370b1f332 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:37.121009 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 298/585] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:37.122205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825f115-d2ad-45c1-b7af-ab3328f35098 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.125889 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bbcd7-c929-4d23-81b6-750370b1f332 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.132841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825f115-d2ad-45c1-b7af-ab3328f35098 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.135848 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bbcd7-c929-4d23-81b6-750370b1f332 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.138561 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b91bdf-3811-408f-8d9b-8b082c6dfd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.139590 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b91bdf-3811-408f-8d9b-8b082c6dfd70 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.139877 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b91bdf-3811-408f-8d9b-8b082c6dfd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.140154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b91bdf-3811-408f-8d9b-8b082c6dfd70 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.141366 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a101d47-fd5d-4f82-90ab-8a9db4ec254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.142309 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a101d47-fd5d-4f82-90ab-8a9db4ec254c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.142822 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a101d47-fd5d-4f82-90ab-8a9db4ec254c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.143316 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a101d47-fd5d-4f82-90ab-8a9db4ec254c admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.144252 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a101d47-fd5d-4f82-90ab-8a9db4ec254c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:37.144767 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a101d47-fd5d-4f82-90ab-8a9db4ec254c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.146744 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a101d47-fd5d-4f82-90ab-8a9db4ec254c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:37.147548 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b91bdf-3811-408f-8d9b-8b082c6dfd70 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.150040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b91bdf-3811-408f-8d9b-8b082c6dfd70 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:37.160694 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 299/586] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:37.165283 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-b2b91bdf-3811-408f-8d9b-8b082c6dfd70 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:37.167428 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a101d47-fd5d-4f82-90ab-8a9db4ec254c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.170725 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 288/587] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:37.173299 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b91bdf-3811-408f-8d9b-8b082c6dfd70 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.183614 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a101d47-fd5d-4f82-90ab-8a9db4ec254c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.192579 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b91bdf-3811-408f-8d9b-8b082c6dfd70 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.198862 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89854672-09fc-4312-aa45-bb32e5459e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.200402 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89854672-09fc-4312-aa45-bb32e5459e30 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.201341 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89854672-09fc-4312-aa45-bb32e5459e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.202668 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89854672-09fc-4312-aa45-bb32e5459e30 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.204308 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4431b-1f13-4d7f-a155-fb06cd3c5643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.205985 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4431b-1f13-4d7f-a155-fb06cd3c5643 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.207376 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4431b-1f13-4d7f-a155-fb06cd3c5643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.207877 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4431b-1f13-4d7f-a155-fb06cd3c5643 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.209961 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4431b-1f13-4d7f-a155-fb06cd3c5643 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:37.210762 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4431b-1f13-4d7f-a155-fb06cd3c5643 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.213351 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4431b-1f13-4d7f-a155-fb06cd3c5643 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:37.219509 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89854672-09fc-4312-aa45-bb32e5459e30 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.227333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89854672-09fc-4312-aa45-bb32e5459e30 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:37.238176 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 289/588] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:37.244546 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4431b-1f13-4d7f-a155-fb06cd3c5643 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.261598 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4431b-1f13-4d7f-a155-fb06cd3c5643 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.262612 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-89854672-09fc-4312-aa45-bb32e5459e30 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:37.265427 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 300/589] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:37.267938 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467fae0-f59a-4bcb-8d0d-cf8ed784d4cc None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.268591 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467fae0-f59a-4bcb-8d0d-cf8ed784d4cc None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.269078 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467fae0-f59a-4bcb-8d0d-cf8ed784d4cc None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.271188 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 301/590] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:37.272095 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467fae0-f59a-4bcb-8d0d-cf8ed784d4cc None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.276508 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544d5e1-7fad-47dc-912e-2b716d82e6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.276508 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544d5e1-7fad-47dc-912e-2b716d82e6f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.276508 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544d5e1-7fad-47dc-912e-2b716d82e6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.276508 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544d5e1-7fad-47dc-912e-2b716d82e6f3 admin admin] PATH_INFO: `/v3/projects/6160f9606d06486b9a11a23ee717af79/users/f6db9534cc094e8281b0aa34e2cb4b46/roles/9209cdab986041f1a45283ada1ae297a` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.291596 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467fae0-f59a-4bcb-8d0d-cf8ed784d4cc None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.294187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544d5e1-7fad-47dc-912e-2b716d82e6f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6160f9606d06486b9a11a23ee717af79, user_id=f6db9534cc094e8281b0aa34e2cb4b46, role_id=9209cdab986041f1a45283ada1ae297a)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.296771 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abee18-e495-4ea3-b8d5-ac9d343821ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.297626 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abee18-e495-4ea3-b8d5-ac9d343821ec admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.297732 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544d5e1-7fad-47dc-912e-2b716d82e6f3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:37.298240 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abee18-e495-4ea3-b8d5-ac9d343821ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.298737 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abee18-e495-4ea3-b8d5-ac9d343821ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.299795 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abee18-e495-4ea3-b8d5-ac9d343821ec admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:37.300312 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abee18-e495-4ea3-b8d5-ac9d343821ec admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.303055 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abee18-e495-4ea3-b8d5-ac9d343821ec admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:37.316798 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 302/591] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:37.318343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571dc7e-76d7-4ed4-8a35-b95a0e6bddf0 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.318907 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571dc7e-76d7-4ed4-8a35-b95a0e6bddf0 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.319374 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571dc7e-76d7-4ed4-8a35-b95a0e6bddf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.343940 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-e571dc7e-76d7-4ed4-8a35-b95a0e6bddf0 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:37.345383 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e571dc7e-76d7-4ed4-8a35-b95a0e6bddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:37.361567 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 303/592] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:37.362410 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571dc7e-76d7-4ed4-8a35-b95a0e6bddf0 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.377141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571dc7e-76d7-4ed4-8a35-b95a0e6bddf0 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.381862 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9f23d-0e60-4f7b-9eff-4e3873730b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.382872 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9f23d-0e60-4f7b-9eff-4e3873730b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.386994 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9f23d-0e60-4f7b-9eff-4e3873730b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.386994 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9f23d-0e60-4f7b-9eff-4e3873730b2a admin admin] PATH_INFO: `/v3/projects/6160f9606d06486b9a11a23ee717af79/users/07ca3e2a770f463a95dfb045ffd51dd6/roles/9209cdab986041f1a45283ada1ae297a` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.397730 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9f23d-0e60-4f7b-9eff-4e3873730b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6160f9606d06486b9a11a23ee717af79, user_id=07ca3e2a770f463a95dfb045ffd51dd6, role_id=9209cdab986041f1a45283ada1ae297a)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.400550 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9f23d-0e60-4f7b-9eff-4e3873730b2a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:37.422169 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 290/593] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:50:37 2022] PUT /identity/v3/projects/6160f9606d06486b9a11a23ee717af79/users/f6db9534cc094e8281b0aa34e2cb4b46/roles/9209cdab986041f1a45283ada1ae297a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:50:37.426752 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544d5e1-7fad-47dc-912e-2b716d82e6f3 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.499288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544d5e1-7fad-47dc-912e-2b716d82e6f3 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.504637 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd845a-f646-4965-b750-54c43122bc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.505512 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd845a-f646-4965-b750-54c43122bc78 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.505799 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd845a-f646-4965-b750-54c43122bc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.506076 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd845a-f646-4965-b750-54c43122bc78 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.518343 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd845a-f646-4965-b750-54c43122bc78 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:37.526030 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-b7fd845a-f646-4965-b750-54c43122bc78 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:50:37.527437 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 291/594] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:37.535049 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 304/595] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:50:37 2022] PUT /identity/v3/projects/6160f9606d06486b9a11a23ee717af79/users/07ca3e2a770f463a95dfb045ffd51dd6/roles/9209cdab986041f1a45283ada1ae297a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:50:37.536024 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd845a-f646-4965-b750-54c43122bc78 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.547771 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd845a-f646-4965-b750-54c43122bc78 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.623100 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cade95-ec76-4a57-9912-d5bd8e4174ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.623789 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cade95-ec76-4a57-9912-d5bd8e4174ec admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.624073 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cade95-ec76-4a57-9912-d5bd8e4174ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.624349 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cade95-ec76-4a57-9912-d5bd8e4174ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.625260 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cade95-ec76-4a57-9912-d5bd8e4174ec admin admin] RBAC: Adding query filter params (name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:37.625574 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cade95-ec76-4a57-9912-d5bd8e4174ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.627381 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cade95-ec76-4a57-9912-d5bd8e4174ec admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:37.638765 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 292/596] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:50:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:37.647862 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9f23d-0e60-4f7b-9eff-4e3873730b2a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.662136 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9f23d-0e60-4f7b-9eff-4e3873730b2a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.668632 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c554537-80ae-4a71-b418-a22093f8c6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.669992 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c554537-80ae-4a71-b418-a22093f8c6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.670373 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c554537-80ae-4a71-b418-a22093f8c6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.670732 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c554537-80ae-4a71-b418-a22093f8c6d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.683915 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c554537-80ae-4a71-b418-a22093f8c6d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.685922 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c554537-80ae-4a71-b418-a22093f8c6d4 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:37.708471 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-5c554537-80ae-4a71-b418-a22093f8c6d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:37.709970 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 305/597] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:37.715757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cade95-ec76-4a57-9912-d5bd8e4174ec admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.727154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cade95-ec76-4a57-9912-d5bd8e4174ec admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.735137 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389ad0e-965e-497c-8887-920ec6d04929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.735879 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389ad0e-965e-497c-8887-920ec6d04929 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.736162 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389ad0e-965e-497c-8887-920ec6d04929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.736442 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389ad0e-965e-497c-8887-920ec6d04929 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.737239 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389ad0e-965e-497c-8887-920ec6d04929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:37.737546 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389ad0e-965e-497c-8887-920ec6d04929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.739260 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389ad0e-965e-497c-8887-920ec6d04929 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:37.758269 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 293/598] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:37.761332 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c554537-80ae-4a71-b418-a22093f8c6d4 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.777588 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c554537-80ae-4a71-b418-a22093f8c6d4 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.783814 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115b24d-e73c-4a41-b7d8-2c37efcb7e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.784675 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115b24d-e73c-4a41-b7d8-2c37efcb7e69 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.784959 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115b24d-e73c-4a41-b7d8-2c37efcb7e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.785237 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115b24d-e73c-4a41-b7d8-2c37efcb7e69 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.794367 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115b24d-e73c-4a41-b7d8-2c37efcb7e69 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.796578 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115b24d-e73c-4a41-b7d8-2c37efcb7e69 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:37.812436 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-e115b24d-e73c-4a41-b7d8-2c37efcb7e69 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 16:50:37.813966 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 306/599] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:50:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:37.819661 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389ad0e-965e-497c-8887-920ec6d04929 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.830188 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389ad0e-965e-497c-8887-920ec6d04929 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.834928 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184eddf-7b69-42d7-ba13-9ddcfed628ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.836258 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184eddf-7b69-42d7-ba13-9ddcfed628ae admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.836595 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184eddf-7b69-42d7-ba13-9ddcfed628ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.836995 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184eddf-7b69-42d7-ba13-9ddcfed628ae admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.837846 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184eddf-7b69-42d7-ba13-9ddcfed628ae admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:37.838160 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184eddf-7b69-42d7-ba13-9ddcfed628ae admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.840224 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184eddf-7b69-42d7-ba13-9ddcfed628ae admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:37.862220 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 294/600] 10.222.0.42 () {56 vars in 1156 bytes} [Wed Feb 16 16:50:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:37.868609 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115b24d-e73c-4a41-b7d8-2c37efcb7e69 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.879069 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115b24d-e73c-4a41-b7d8-2c37efcb7e69 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.884010 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252623e-54e4-4ea0-b24c-6c1d09e1e3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.884796 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252623e-54e4-4ea0-b24c-6c1d09e1e3dc admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.885087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252623e-54e4-4ea0-b24c-6c1d09e1e3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.885365 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252623e-54e4-4ea0-b24c-6c1d09e1e3dc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.894295 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252623e-54e4-4ea0-b24c-6c1d09e1e3dc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.896251 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252623e-54e4-4ea0-b24c-6c1d09e1e3dc admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:37.907257 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 307/601] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:37.912863 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184eddf-7b69-42d7-ba13-9ddcfed628ae admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.923803 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184eddf-7b69-42d7-ba13-9ddcfed628ae admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.928506 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8bf16-0b58-4000-a1a2-feff5c2aaec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.929392 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8bf16-0b58-4000-a1a2-feff5c2aaec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.929672 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8bf16-0b58-4000-a1a2-feff5c2aaec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.929953 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8bf16-0b58-4000-a1a2-feff5c2aaec7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.941172 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8bf16-0b58-4000-a1a2-feff5c2aaec7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.943151 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8bf16-0b58-4000-a1a2-feff5c2aaec7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:37.962535 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-55d8bf16-0b58-4000-a1a2-feff5c2aaec7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:37.964114 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 295/602] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:37.969568 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252623e-54e4-4ea0-b24c-6c1d09e1e3dc admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:37.979492 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252623e-54e4-4ea0-b24c-6c1d09e1e3dc admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:37.984541 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c67daf-430c-4904-8c18-2c24c5d14ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:37.985238 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c67daf-430c-4904-8c18-2c24c5d14ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:37.985624 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c67daf-430c-4904-8c18-2c24c5d14ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:37.985911 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c67daf-430c-4904-8c18-2c24c5d14ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:37.986630 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c67daf-430c-4904-8c18-2c24c5d14ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:37.986959 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c67daf-430c-4904-8c18-2c24c5d14ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:37.988595 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c67daf-430c-4904-8c18-2c24c5d14ed6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:38.001110 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 308/603] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:38.006419 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8bf16-0b58-4000-a1a2-feff5c2aaec7 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:38.017256 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8bf16-0b58-4000-a1a2-feff5c2aaec7 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:38.021874 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69243860-ee20-4ab1-a6fd-f5147342a1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:38.022674 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69243860-ee20-4ab1-a6fd-f5147342a1bb admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:38.023136 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69243860-ee20-4ab1-a6fd-f5147342a1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:38.023417 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69243860-ee20-4ab1-a6fd-f5147342a1bb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:38.030764 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69243860-ee20-4ab1-a6fd-f5147342a1bb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:38.032685 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69243860-ee20-4ab1-a6fd-f5147342a1bb admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:38.046441 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-69243860-ee20-4ab1-a6fd-f5147342a1bb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:38.047944 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 296/604] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:38.061727 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c67daf-430c-4904-8c18-2c24c5d14ed6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:38.072185 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c67daf-430c-4904-8c18-2c24c5d14ed6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:38.081314 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca20db-40ad-4465-9f88-fa4adc5fd98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:38.081966 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca20db-40ad-4465-9f88-fa4adc5fd98a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:38.082301 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca20db-40ad-4465-9f88-fa4adc5fd98a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:38.082579 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca20db-40ad-4465-9f88-fa4adc5fd98a admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:38.083433 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca20db-40ad-4465-9f88-fa4adc5fd98a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:38.083745 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca20db-40ad-4465-9f88-fa4adc5fd98a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:38.085830 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca20db-40ad-4465-9f88-fa4adc5fd98a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:38.103333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 309/605] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:38.109094 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69243860-ee20-4ab1-a6fd-f5147342a1bb admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:38.122482 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69243860-ee20-4ab1-a6fd-f5147342a1bb admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:38.129080 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea616eba-094b-403c-8183-d3436fe7e510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:38.129782 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616eba-094b-403c-8183-d3436fe7e510 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:38.130070 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616eba-094b-403c-8183-d3436fe7e510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:38.130347 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616eba-094b-403c-8183-d3436fe7e510 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:38.131256 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea616eba-094b-403c-8183-d3436fe7e510 admin admin] RBAC: Adding query filter params (role.id=9209cdab986041f1a45283ada1ae297a, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=fc59cb98783b4353a405b8b9a3a9d592) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:38.131570 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea616eba-094b-403c-8183-d3436fe7e510 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:38.133705 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea616eba-094b-403c-8183-d3436fe7e510 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:38.140508 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 297/606] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:38 2022] GET /identity/v3/role_assignments?user.id=fc59cb98783b4353a405b8b9a3a9d592&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=9209cdab986041f1a45283ada1ae297a => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:39.234160 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc01f7-cdef-4b15-a596-b0d75fd82d10 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:39.234939 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc01f7-cdef-4b15-a596-b0d75fd82d10 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:39.234939 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc01f7-cdef-4b15-a596-b0d75fd82d10 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:39.236997 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 310/607] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:39.243835 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded92ad-b631-4a66-a4eb-6c785dbab78a None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:39.246739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded92ad-b631-4a66-a4eb-6c785dbab78a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:39.246739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded92ad-b631-4a66-a4eb-6c785dbab78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:39.266534 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-2ded92ad-b631-4a66-a4eb-6c785dbab78a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:39.267810 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-2ded92ad-b631-4a66-a4eb-6c785dbab78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:39.281261 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 298/608] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:50:39.318726 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc01f7-cdef-4b15-a596-b0d75fd82d10 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:39.335843 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc01f7-cdef-4b15-a596-b0d75fd82d10 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:39.342695 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc0ad8-e3ae-4dd8-aa37-755073c933ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:39.343491 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc0ad8-e3ae-4dd8-aa37-755073c933ad admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:39.343777 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc0ad8-e3ae-4dd8-aa37-755073c933ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:39.344055 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc0ad8-e3ae-4dd8-aa37-755073c933ad admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:39.355936 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc0ad8-e3ae-4dd8-aa37-755073c933ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:39.363434 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-d0bc0ad8-e3ae-4dd8-aa37-755073c933ad admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:50:39.364928 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 311/609] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:39.371082 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded92ad-b631-4a66-a4eb-6c785dbab78a None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:39.380432 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded92ad-b631-4a66-a4eb-6c785dbab78a None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:39.385243 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d59739-6c85-4046-8e68-d29ae7ee9288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:39.385907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d59739-6c85-4046-8e68-d29ae7ee9288 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:39.386185 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d59739-6c85-4046-8e68-d29ae7ee9288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:39.386461 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d59739-6c85-4046-8e68-d29ae7ee9288 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:39.387255 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d59739-6c85-4046-8e68-d29ae7ee9288 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:39.387560 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d59739-6c85-4046-8e68-d29ae7ee9288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:39.389256 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d59739-6c85-4046-8e68-d29ae7ee9288 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:39.401962 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 299/610] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:50:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:39.407805 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc0ad8-e3ae-4dd8-aa37-755073c933ad admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:39.423700 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc0ad8-e3ae-4dd8-aa37-755073c933ad admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:39.435011 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bdf27-6a3b-4363-9dc4-257733945f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:39.436114 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bdf27-6a3b-4363-9dc4-257733945f72 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:39.436607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bdf27-6a3b-4363-9dc4-257733945f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:39.437105 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bdf27-6a3b-4363-9dc4-257733945f72 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:39.458261 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bdf27-6a3b-4363-9dc4-257733945f72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:39.460519 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bdf27-6a3b-4363-9dc4-257733945f72 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:39.484411 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-640bdf27-6a3b-4363-9dc4-257733945f72 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:39.485906 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 312/611] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:39.492199 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d59739-6c85-4046-8e68-d29ae7ee9288 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:39.513935 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d59739-6c85-4046-8e68-d29ae7ee9288 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:39.522962 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dcd19-6431-4897-9b0e-20356b01c7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:39.526368 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dcd19-6431-4897-9b0e-20356b01c7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:39.526368 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dcd19-6431-4897-9b0e-20356b01c7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:39.526368 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dcd19-6431-4897-9b0e-20356b01c7b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:39.526368 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0dcd19-6431-4897-9b0e-20356b01c7b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:39.526368 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0dcd19-6431-4897-9b0e-20356b01c7b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:39.527022 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0dcd19-6431-4897-9b0e-20356b01c7b4 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:39.544870 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 300/612] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:39.550472 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bdf27-6a3b-4363-9dc4-257733945f72 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:39.564145 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bdf27-6a3b-4363-9dc4-257733945f72 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:39.583916 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e7e8c-3674-4a03-b59e-f236ea63d776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:39.585087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e7e8c-3674-4a03-b59e-f236ea63d776 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:39.585801 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e7e8c-3674-4a03-b59e-f236ea63d776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:39.586373 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e7e8c-3674-4a03-b59e-f236ea63d776 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:39.599846 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e7e8c-3674-4a03-b59e-f236ea63d776 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:39.602389 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e7e8c-3674-4a03-b59e-f236ea63d776 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:39.618987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-df5e7e8c-3674-4a03-b59e-f236ea63d776 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 16:50:39.620478 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 313/613] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Feb 16 16:50:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:39.626072 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dcd19-6431-4897-9b0e-20356b01c7b4 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:39.635860 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dcd19-6431-4897-9b0e-20356b01c7b4 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:39.655389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000b3c9-c190-4664-9ead-dc68258d6c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:39.656073 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000b3c9-c190-4664-9ead-dc68258d6c2a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:39.656350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000b3c9-c190-4664-9ead-dc68258d6c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:39.656626 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000b3c9-c190-4664-9ead-dc68258d6c2a admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:39.657469 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000b3c9-c190-4664-9ead-dc68258d6c2a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:39.657774 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000b3c9-c190-4664-9ead-dc68258d6c2a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:39.659645 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000b3c9-c190-4664-9ead-dc68258d6c2a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:39.663173 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee739105-dff6-4708-9334-1c46e55a8a4c None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:39.664253 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee739105-dff6-4708-9334-1c46e55a8a4c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:39.664490 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee739105-dff6-4708-9334-1c46e55a8a4c None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:39.668637 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 314/614] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:39.677187 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34141761-c927-4b17-8b8f-64ffdfd2511f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:39.677784 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34141761-c927-4b17-8b8f-64ffdfd2511f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:39.678312 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34141761-c927-4b17-8b8f-64ffdfd2511f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:39.704694 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 301/615] 10.222.0.42 () {56 vars in 1154 bytes} [Wed Feb 16 16:50:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:39.709621 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000b3c9-c190-4664-9ead-dc68258d6c2a admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:39.725730 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000b3c9-c190-4664-9ead-dc68258d6c2a admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:39.727577 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-34141761-c927-4b17-8b8f-64ffdfd2511f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:39.729080 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-34141761-c927-4b17-8b8f-64ffdfd2511f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:39.740036 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d11c1-a8d1-4266-a73c-f744e60c894f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:39.742441 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d11c1-a8d1-4266-a73c-f744e60c894f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:39.743033 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d11c1-a8d1-4266-a73c-f744e60c894f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:39.743526 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d11c1-a8d1-4266-a73c-f744e60c894f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:39.747571 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 315/616] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:50:39.759133 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d11c1-a8d1-4266-a73c-f744e60c894f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:39.761259 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d11c1-a8d1-4266-a73c-f744e60c894f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:39.776607 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 302/617] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:39.781859 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34141761-c927-4b17-8b8f-64ffdfd2511f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:39.794420 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34141761-c927-4b17-8b8f-64ffdfd2511f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:39.795600 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d11c1-a8d1-4266-a73c-f744e60c894f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:39.799908 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a051e19-fefe-40e7-a899-f78ad3659f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:39.801215 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a051e19-fefe-40e7-a899-f78ad3659f17 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:39.801711 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a051e19-fefe-40e7-a899-f78ad3659f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:39.802188 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a051e19-fefe-40e7-a899-f78ad3659f17 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:39.808333 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d11c1-a8d1-4266-a73c-f744e60c894f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:39.815777 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a051e19-fefe-40e7-a899-f78ad3659f17 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:39.818130 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a051e19-fefe-40e7-a899-f78ad3659f17 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:39.824783 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114656f-a5f4-432d-8142-e8d8641ea7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:39.825635 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114656f-a5f4-432d-8142-e8d8641ea7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:39.825924 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114656f-a5f4-432d-8142-e8d8641ea7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:39.826197 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114656f-a5f4-432d-8142-e8d8641ea7c6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:39.838537 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-2a051e19-fefe-40e7-a899-f78ad3659f17 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:39.840510 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 316/618] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:39.845585 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a051e19-fefe-40e7-a899-f78ad3659f17 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:39.857359 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a051e19-fefe-40e7-a899-f78ad3659f17 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:39.859640 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114656f-a5f4-432d-8142-e8d8641ea7c6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:39.862951 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffc0f3-84b7-4bcf-a4e0-4b4260116a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:39.864012 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffc0f3-84b7-4bcf-a4e0-4b4260116a9a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:39.864490 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffc0f3-84b7-4bcf-a4e0-4b4260116a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:39.865014 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffc0f3-84b7-4bcf-a4e0-4b4260116a9a admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:39.865928 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffc0f3-84b7-4bcf-a4e0-4b4260116a9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:39.866459 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffc0f3-84b7-4bcf-a4e0-4b4260116a9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:39.867319 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-4114656f-a5f4-432d-8142-e8d8641ea7c6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:50:39.869522 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffc0f3-84b7-4bcf-a4e0-4b4260116a9a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:39.870824 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 303/619] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:39.887731 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114656f-a5f4-432d-8142-e8d8641ea7c6 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:39.890182 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 317/620] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:39.895311 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffc0f3-84b7-4bcf-a4e0-4b4260116a9a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:39.906544 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffc0f3-84b7-4bcf-a4e0-4b4260116a9a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:39.909126 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114656f-a5f4-432d-8142-e8d8641ea7c6 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:39.912192 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fa1db-66ba-4948-86f1-6c1c79307f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:39.913250 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fa1db-66ba-4948-86f1-6c1c79307f90 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:39.913785 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fa1db-66ba-4948-86f1-6c1c79307f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:39.914299 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fa1db-66ba-4948-86f1-6c1c79307f90 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:39.922528 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fa1db-66ba-4948-86f1-6c1c79307f90 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:39.924926 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fa1db-66ba-4948-86f1-6c1c79307f90 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:39.931340 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2709b2-a829-4204-b849-4a7363c6e70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:39.932018 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2709b2-a829-4204-b849-4a7363c6e70d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:39.932296 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2709b2-a829-4204-b849-4a7363c6e70d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:39.932575 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2709b2-a829-4204-b849-4a7363c6e70d admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:39.933309 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2709b2-a829-4204-b849-4a7363c6e70d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:39.933614 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2709b2-a829-4204-b849-4a7363c6e70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:39.935345 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2709b2-a829-4204-b849-4a7363c6e70d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:39.943940 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-d97fa1db-66ba-4948-86f1-6c1c79307f90 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:39.946252 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 318/621] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:39.951852 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 304/622] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:50:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:39.952884 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fa1db-66ba-4948-86f1-6c1c79307f90 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:39.957392 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2709b2-a829-4204-b849-4a7363c6e70d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:39.973893 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fa1db-66ba-4948-86f1-6c1c79307f90 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:39.974630 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2709b2-a829-4204-b849-4a7363c6e70d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:39.983079 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d8e15-fad1-40cc-8097-5d045f780de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:39.983810 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6afd8-3117-4a55-9587-fa543dafa08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:39.984987 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d8e15-fad1-40cc-8097-5d045f780de7 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:39.985259 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d8e15-fad1-40cc-8097-5d045f780de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:39.985706 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6afd8-3117-4a55-9587-fa543dafa08f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:39.985977 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6afd8-3117-4a55-9587-fa543dafa08f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:39.986240 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6afd8-3117-4a55-9587-fa543dafa08f admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:39.986924 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d8e15-fad1-40cc-8097-5d045f780de7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:39.987766 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6afd8-3117-4a55-9587-fa543dafa08f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:39.988070 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6afd8-3117-4a55-9587-fa543dafa08f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:39.992888 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6afd8-3117-4a55-9587-fa543dafa08f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.007329 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d8e15-fad1-40cc-8097-5d045f780de7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.011020 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d8e15-fad1-40cc-8097-5d045f780de7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.014822 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 319/623] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:40.024010 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6afd8-3117-4a55-9587-fa543dafa08f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.045057 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6afd8-3117-4a55-9587-fa543dafa08f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.046101 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-269d8e15-fad1-40cc-8097-5d045f780de7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:40.048470 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 305/624] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:40.054547 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d8e15-fad1-40cc-8097-5d045f780de7 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.061842 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326133c-f1bb-4267-b4b8-e81573fe0ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.062496 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326133c-f1bb-4267-b4b8-e81573fe0ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.062827 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326133c-f1bb-4267-b4b8-e81573fe0ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.063068 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326133c-f1bb-4267-b4b8-e81573fe0ce7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.063887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326133c-f1bb-4267-b4b8-e81573fe0ce7 admin admin] RBAC: Adding query filter params (role.id=9209cdab986041f1a45283ada1ae297a, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=9a30603a236e4681a7702eec7029e9db) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:40.064188 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326133c-f1bb-4267-b4b8-e81573fe0ce7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.066014 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326133c-f1bb-4267-b4b8-e81573fe0ce7 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.074658 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d8e15-fad1-40cc-8097-5d045f780de7 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.077783 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 320/625] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/role_assignments?user.id=9a30603a236e4681a7702eec7029e9db&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=9209cdab986041f1a45283ada1ae297a => generated 608 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:40.081419 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657d7bd-872d-49bd-8b1c-9464a14a1dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.082086 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657d7bd-872d-49bd-8b1c-9464a14a1dda admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.082362 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657d7bd-872d-49bd-8b1c-9464a14a1dda admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.082656 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657d7bd-872d-49bd-8b1c-9464a14a1dda admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.083389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657d7bd-872d-49bd-8b1c-9464a14a1dda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:40.083690 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657d7bd-872d-49bd-8b1c-9464a14a1dda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.085875 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657d7bd-872d-49bd-8b1c-9464a14a1dda admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.098316 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 306/626] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:40.104696 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326133c-f1bb-4267-b4b8-e81573fe0ce7 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.128332 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326133c-f1bb-4267-b4b8-e81573fe0ce7 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.144138 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978256d-7dbb-44ac-a2bc-7e721d39e865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.145012 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978256d-7dbb-44ac-a2bc-7e721d39e865 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.145292 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978256d-7dbb-44ac-a2bc-7e721d39e865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.145563 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978256d-7dbb-44ac-a2bc-7e721d39e865 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.160040 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978256d-7dbb-44ac-a2bc-7e721d39e865 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.162100 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978256d-7dbb-44ac-a2bc-7e721d39e865 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.187143 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-3978256d-7dbb-44ac-a2bc-7e721d39e865 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 16 16:50:40.188713 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 321/627] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:40.194218 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657d7bd-872d-49bd-8b1c-9464a14a1dda admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.217268 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657d7bd-872d-49bd-8b1c-9464a14a1dda admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.232556 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e372e-ef70-4406-919e-0cbce9eb3db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.233239 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e372e-ef70-4406-919e-0cbce9eb3db8 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.233516 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e372e-ef70-4406-919e-0cbce9eb3db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.233787 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e372e-ef70-4406-919e-0cbce9eb3db8 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.234633 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e372e-ef70-4406-919e-0cbce9eb3db8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:40.234963 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e372e-ef70-4406-919e-0cbce9eb3db8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.236803 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e372e-ef70-4406-919e-0cbce9eb3db8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.270721 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 307/628] 10.222.0.42 () {56 vars in 1158 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:40.276800 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978256d-7dbb-44ac-a2bc-7e721d39e865 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.296105 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978256d-7dbb-44ac-a2bc-7e721d39e865 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.308903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4af39-6a46-45a0-a19a-236bfd532766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.309575 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4af39-6a46-45a0-a19a-236bfd532766 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.309855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4af39-6a46-45a0-a19a-236bfd532766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.310127 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4af39-6a46-45a0-a19a-236bfd532766 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.326394 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4af39-6a46-45a0-a19a-236bfd532766 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.328173 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4af39-6a46-45a0-a19a-236bfd532766 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.343178 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 322/629] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:40.351835 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e372e-ef70-4406-919e-0cbce9eb3db8 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.368467 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e372e-ef70-4406-919e-0cbce9eb3db8 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.375590 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df913c1d-8fd9-4d0e-a963-494cd002c11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.376386 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df913c1d-8fd9-4d0e-a963-494cd002c11c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.376665 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df913c1d-8fd9-4d0e-a963-494cd002c11c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.376939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df913c1d-8fd9-4d0e-a963-494cd002c11c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.392726 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df913c1d-8fd9-4d0e-a963-494cd002c11c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.394549 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df913c1d-8fd9-4d0e-a963-494cd002c11c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.419893 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-df913c1d-8fd9-4d0e-a963-494cd002c11c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:40.421851 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 308/630] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:40.425492 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2e1c-32d3-48a4-ae04-af8892101b49 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.425849 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2e1c-32d3-48a4-ae04-af8892101b49 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.426182 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2e1c-32d3-48a4-ae04-af8892101b49 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.428233 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 323/631] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:50:40.429781 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df913c1d-8fd9-4d0e-a963-494cd002c11c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.435835 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f66cfb-9d59-4ab2-a51a-5047107ddc49 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.436258 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f66cfb-9d59-4ab2-a51a-5047107ddc49 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.436629 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f66cfb-9d59-4ab2-a51a-5047107ddc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.443345 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df913c1d-8fd9-4d0e-a963-494cd002c11c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.449988 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52a955-aed8-4561-af63-f9a4c13538d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.450793 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52a955-aed8-4561-af63-f9a4c13538d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.451168 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52a955-aed8-4561-af63-f9a4c13538d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.451534 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52a955-aed8-4561-af63-f9a4c13538d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.452352 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52a955-aed8-4561-af63-f9a4c13538d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:40.452750 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52a955-aed8-4561-af63-f9a4c13538d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.454446 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52a955-aed8-4561-af63-f9a4c13538d1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.460520 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-e0f66cfb-9d59-4ab2-a51a-5047107ddc49 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:40.461923 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e0f66cfb-9d59-4ab2-a51a-5047107ddc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:40.468146 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 309/632] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:40.475005 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 324/633] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:50:40.476678 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52a955-aed8-4561-af63-f9a4c13538d1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.487599 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52a955-aed8-4561-af63-f9a4c13538d1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.493757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bca46-7c8d-4fea-adcc-d624006de687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.494766 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bca46-7c8d-4fea-adcc-d624006de687 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.495192 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bca46-7c8d-4fea-adcc-d624006de687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.495558 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bca46-7c8d-4fea-adcc-d624006de687 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.499510 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f66cfb-9d59-4ab2-a51a-5047107ddc49 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.505268 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bca46-7c8d-4fea-adcc-d624006de687 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.507963 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bca46-7c8d-4fea-adcc-d624006de687 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.511237 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f66cfb-9d59-4ab2-a51a-5047107ddc49 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.516087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07247481-0753-4420-91d2-79f4ccfc88d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.517053 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07247481-0753-4420-91d2-79f4ccfc88d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.517568 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07247481-0753-4420-91d2-79f4ccfc88d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.518016 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07247481-0753-4420-91d2-79f4ccfc88d2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.523751 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-963bca46-7c8d-4fea-adcc-d624006de687 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:40.527156 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 310/634] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:40.534060 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bca46-7c8d-4fea-adcc-d624006de687 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.537012 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07247481-0753-4420-91d2-79f4ccfc88d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:40.544461 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-07247481-0753-4420-91d2-79f4ccfc88d2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:50:40.544637 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bca46-7c8d-4fea-adcc-d624006de687 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.546059 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 325/635] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:40.547894 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ceec40-492d-4c05-adea-3583e1f699ab None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.548173 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ceec40-492d-4c05-adea-3583e1f699ab None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.548440 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ceec40-492d-4c05-adea-3583e1f699ab None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.550103 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 326/636] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:40.554871 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca45df-0afc-4334-a0b3-839377be7914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.555169 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ceec40-492d-4c05-adea-3583e1f699ab None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.555867 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca45df-0afc-4334-a0b3-839377be7914 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.556500 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca45df-0afc-4334-a0b3-839377be7914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.556929 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca45df-0afc-4334-a0b3-839377be7914 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.557895 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca45df-0afc-4334-a0b3-839377be7914 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:40.558460 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca45df-0afc-4334-a0b3-839377be7914 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.560705 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca45df-0afc-4334-a0b3-839377be7914 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.567624 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ceec40-492d-4c05-adea-3583e1f699ab None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.573075 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091bb72-a85a-4834-8675-6ec052a7621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.576226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091bb72-a85a-4834-8675-6ec052a7621d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.576226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091bb72-a85a-4834-8675-6ec052a7621d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.576226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091bb72-a85a-4834-8675-6ec052a7621d admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.576226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091bb72-a85a-4834-8675-6ec052a7621d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:40.576226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091bb72-a85a-4834-8675-6ec052a7621d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.579091 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 311/637] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:40.579218 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091bb72-a85a-4834-8675-6ec052a7621d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.580844 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a162a-268d-4aa9-90fa-62d44228ee5b None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.581314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a162a-268d-4aa9-90fa-62d44228ee5b None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.581780 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a162a-268d-4aa9-90fa-62d44228ee5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.589907 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 327/638] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:40.590774 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091bb72-a85a-4834-8675-6ec052a7621d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.600174 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091bb72-a85a-4834-8675-6ec052a7621d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.602337 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-bb2a162a-268d-4aa9-90fa-62d44228ee5b None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:40.604143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-bb2a162a-268d-4aa9-90fa-62d44228ee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:40.605009 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ba119-7579-4826-a6f3-6a0250e68311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.605631 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ba119-7579-4826-a6f3-6a0250e68311 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.605910 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ba119-7579-4826-a6f3-6a0250e68311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.606176 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ba119-7579-4826-a6f3-6a0250e68311 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.607279 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ba119-7579-4826-a6f3-6a0250e68311 admin admin] RBAC: Adding query filter params (role.id=9209cdab986041f1a45283ada1ae297a, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=c7b2c52a60aa499e82129ef29f8907ca) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:40.607583 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ba119-7579-4826-a6f3-6a0250e68311 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.609388 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ba119-7579-4826-a6f3-6a0250e68311 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.614832 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 312/639] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:40.615767 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 328/640] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/role_assignments?user.id=c7b2c52a60aa499e82129ef29f8907ca&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=9209cdab986041f1a45283ada1ae297a => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:40.617077 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a162a-268d-4aa9-90fa-62d44228ee5b None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.627489 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a162a-268d-4aa9-90fa-62d44228ee5b None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.633472 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7f887-37b0-419e-a20c-df77a7b8671c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.635128 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7f887-37b0-419e-a20c-df77a7b8671c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.635848 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7f887-37b0-419e-a20c-df77a7b8671c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.636324 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7f887-37b0-419e-a20c-df77a7b8671c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.640706 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ba119-7579-4826-a6f3-6a0250e68311 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.650367 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7f887-37b0-419e-a20c-df77a7b8671c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.652963 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ba119-7579-4826-a6f3-6a0250e68311 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.655316 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7f887-37b0-419e-a20c-df77a7b8671c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.668354 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33451022-c93a-4f17-a302-ac14217c38b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.669535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33451022-c93a-4f17-a302-ac14217c38b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.670022 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33451022-c93a-4f17-a302-ac14217c38b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.670519 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33451022-c93a-4f17-a302-ac14217c38b6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.686468 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-e2a7f887-37b0-419e-a20c-df77a7b8671c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:40.693897 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 313/641] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:40.695828 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33451022-c93a-4f17-a302-ac14217c38b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:40.703453 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-33451022-c93a-4f17-a302-ac14217c38b6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:50:40.704779 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7f887-37b0-419e-a20c-df77a7b8671c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.712264 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 329/642] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:40.716307 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7f887-37b0-419e-a20c-df77a7b8671c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.721431 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93081f-d376-4f08-bcf0-a61a906b9408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.721641 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33451022-c93a-4f17-a302-ac14217c38b6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.722586 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93081f-d376-4f08-bcf0-a61a906b9408 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.723102 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93081f-d376-4f08-bcf0-a61a906b9408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.723696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93081f-d376-4f08-bcf0-a61a906b9408 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.724640 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93081f-d376-4f08-bcf0-a61a906b9408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:40.725154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93081f-d376-4f08-bcf0-a61a906b9408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.727372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93081f-d376-4f08-bcf0-a61a906b9408 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.742316 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 314/643] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:40.743096 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33451022-c93a-4f17-a302-ac14217c38b6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.747746 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93081f-d376-4f08-bcf0-a61a906b9408 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.759831 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed72459-45a4-447d-8192-f52b47c3b0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.762352 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed72459-45a4-447d-8192-f52b47c3b0da admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.762920 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed72459-45a4-447d-8192-f52b47c3b0da admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.763414 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed72459-45a4-447d-8192-f52b47c3b0da admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.764354 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed72459-45a4-447d-8192-f52b47c3b0da admin admin] RBAC: Adding query filter params (name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:40.764662 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93081f-d376-4f08-bcf0-a61a906b9408 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.766471 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed72459-45a4-447d-8192-f52b47c3b0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.768796 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed72459-45a4-447d-8192-f52b47c3b0da admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.775229 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81c667-7b3a-4483-ae5d-291ac2f10baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.776141 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81c667-7b3a-4483-ae5d-291ac2f10baf admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.776474 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81c667-7b3a-4483-ae5d-291ac2f10baf admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.776881 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81c667-7b3a-4483-ae5d-291ac2f10baf admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.786140 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81c667-7b3a-4483-ae5d-291ac2f10baf admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.788315 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81c667-7b3a-4483-ae5d-291ac2f10baf admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.788686 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 330/644] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:40.794080 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed72459-45a4-447d-8192-f52b47c3b0da admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.804968 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-3f81c667-7b3a-4483-ae5d-291ac2f10baf admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 16 16:50:40.806534 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 315/645] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:40.812135 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81c667-7b3a-4483-ae5d-291ac2f10baf admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.815061 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed72459-45a4-447d-8192-f52b47c3b0da admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.824213 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81c667-7b3a-4483-ae5d-291ac2f10baf admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.829188 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4de8f-aa94-415f-a5cc-c1ff95634924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.829965 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4de8f-aa94-415f-a5cc-c1ff95634924 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.830247 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4de8f-aa94-415f-a5cc-c1ff95634924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.830519 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4de8f-aa94-415f-a5cc-c1ff95634924 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.831595 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4de8f-aa94-415f-a5cc-c1ff95634924 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:40.832022 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4de8f-aa94-415f-a5cc-c1ff95634924 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.834125 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4de8f-aa94-415f-a5cc-c1ff95634924 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.835342 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e159891-b73a-428e-b736-62858d32bade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.836148 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e159891-b73a-428e-b736-62858d32bade admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.836420 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e159891-b73a-428e-b736-62858d32bade admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.836684 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e159891-b73a-428e-b736-62858d32bade admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.860140 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e159891-b73a-428e-b736-62858d32bade admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.860753 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 316/646] 10.222.0.42 () {56 vars in 1160 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:40.862448 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e159891-b73a-428e-b736-62858d32bade admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.864207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4de8f-aa94-415f-a5cc-c1ff95634924 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.881847 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4de8f-aa94-415f-a5cc-c1ff95634924 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.886491 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-8e159891-b73a-428e-b736-62858d32bade admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:40.888354 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 331/647] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:40.895242 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e159891-b73a-428e-b736-62858d32bade admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.895472 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa072dda-3f1b-4018-a4c1-25a548ad19aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.896102 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072dda-3f1b-4018-a4c1-25a548ad19aa admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.896377 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072dda-3f1b-4018-a4c1-25a548ad19aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.896646 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072dda-3f1b-4018-a4c1-25a548ad19aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.906380 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa072dda-3f1b-4018-a4c1-25a548ad19aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.908196 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa072dda-3f1b-4018-a4c1-25a548ad19aa admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.909112 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e159891-b73a-428e-b736-62858d32bade admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.918236 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd5f21-c191-4c0c-a4cf-229101ed9dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.919262 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd5f21-c191-4c0c-a4cf-229101ed9dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.919749 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd5f21-c191-4c0c-a4cf-229101ed9dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.920252 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd5f21-c191-4c0c-a4cf-229101ed9dc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.922092 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd5f21-c191-4c0c-a4cf-229101ed9dc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:40.923643 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 317/648] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:40.924291 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd5f21-c191-4c0c-a4cf-229101ed9dc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.925905 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd5f21-c191-4c0c-a4cf-229101ed9dc5 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.933441 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa072dda-3f1b-4018-a4c1-25a548ad19aa admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.942419 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 332/649] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:40.944070 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa072dda-3f1b-4018-a4c1-25a548ad19aa admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.948356 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd5f21-c191-4c0c-a4cf-229101ed9dc5 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.949920 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e3129-1fba-4dd3-aca9-e257b58f19c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.951004 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e3129-1fba-4dd3-aca9-e257b58f19c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.951517 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e3129-1fba-4dd3-aca9-e257b58f19c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.951988 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e3129-1fba-4dd3-aca9-e257b58f19c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.960001 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd5f21-c191-4c0c-a4cf-229101ed9dc5 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:40.966663 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e3129-1fba-4dd3-aca9-e257b58f19c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.968487 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e3129-1fba-4dd3-aca9-e257b58f19c2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.970254 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00f70b-0142-4bb8-abd4-e50224f0d518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:40.970381 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00f70b-0142-4bb8-abd4-e50224f0d518 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:40.971213 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00f70b-0142-4bb8-abd4-e50224f0d518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:40.971213 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00f70b-0142-4bb8-abd4-e50224f0d518 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:40.982159 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00f70b-0142-4bb8-abd4-e50224f0d518 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:40.984267 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00f70b-0142-4bb8-abd4-e50224f0d518 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:40.991467 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-2e5e3129-1fba-4dd3-aca9-e257b58f19c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:40.993028 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 318/650] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:40.998228 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-7b00f70b-0142-4bb8-abd4-e50224f0d518 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 16 16:50:40.998408 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e3129-1fba-4dd3-aca9-e257b58f19c2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:40.999784 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 333/651] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:41.011078 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00f70b-0142-4bb8-abd4-e50224f0d518 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.013475 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e3129-1fba-4dd3-aca9-e257b58f19c2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.025743 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00f70b-0142-4bb8-abd4-e50224f0d518 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.028936 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458e6b2-1706-4469-86aa-d9916dc04292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.029589 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458e6b2-1706-4469-86aa-d9916dc04292 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.029863 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458e6b2-1706-4469-86aa-d9916dc04292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.030131 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458e6b2-1706-4469-86aa-d9916dc04292 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.030905 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458e6b2-1706-4469-86aa-d9916dc04292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:41.031208 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458e6b2-1706-4469-86aa-d9916dc04292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.032787 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458e6b2-1706-4469-86aa-d9916dc04292 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.034455 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec297628-4cd9-4e7b-85bc-884e2085b938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.035859 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec297628-4cd9-4e7b-85bc-884e2085b938 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.036339 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec297628-4cd9-4e7b-85bc-884e2085b938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.036802 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec297628-4cd9-4e7b-85bc-884e2085b938 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.037852 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec297628-4cd9-4e7b-85bc-884e2085b938 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:41.038349 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec297628-4cd9-4e7b-85bc-884e2085b938 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.041052 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec297628-4cd9-4e7b-85bc-884e2085b938 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.045202 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 319/652] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:41.051857 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458e6b2-1706-4469-86aa-d9916dc04292 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.068438 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458e6b2-1706-4469-86aa-d9916dc04292 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.072267 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 334/653] 10.222.0.42 () {56 vars in 1158 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:41.078506 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec297628-4cd9-4e7b-85bc-884e2085b938 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.079549 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14a1b5-a23a-4731-9b18-26df478b55db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.080386 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14a1b5-a23a-4731-9b18-26df478b55db admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.080663 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14a1b5-a23a-4731-9b18-26df478b55db admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.080935 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14a1b5-a23a-4731-9b18-26df478b55db admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.090562 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14a1b5-a23a-4731-9b18-26df478b55db admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.091158 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec297628-4cd9-4e7b-85bc-884e2085b938 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.092625 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14a1b5-a23a-4731-9b18-26df478b55db admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.096136 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac46f45-fc23-4d30-8f58-b71e2e3fa471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.096944 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac46f45-fc23-4d30-8f58-b71e2e3fa471 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.097386 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac46f45-fc23-4d30-8f58-b71e2e3fa471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.097840 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac46f45-fc23-4d30-8f58-b71e2e3fa471 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.107105 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac46f45-fc23-4d30-8f58-b71e2e3fa471 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.108528 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-bc14a1b5-a23a-4731-9b18-26df478b55db admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:41.109228 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac46f45-fc23-4d30-8f58-b71e2e3fa471 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.110088 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 320/654] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:41.120130 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14a1b5-a23a-4731-9b18-26df478b55db admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.121704 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 335/655] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 16:50:41.127375 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac46f45-fc23-4d30-8f58-b71e2e3fa471 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.130829 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14a1b5-a23a-4731-9b18-26df478b55db admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.137821 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d03dc4-488b-407a-bcba-84fe3935b029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.138595 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d03dc4-488b-407a-bcba-84fe3935b029 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.138965 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d03dc4-488b-407a-bcba-84fe3935b029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.139313 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d03dc4-488b-407a-bcba-84fe3935b029 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.139423 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac46f45-fc23-4d30-8f58-b71e2e3fa471 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.140266 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d03dc4-488b-407a-bcba-84fe3935b029 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:41.140658 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d03dc4-488b-407a-bcba-84fe3935b029 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.142707 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d03dc4-488b-407a-bcba-84fe3935b029 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.144478 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecaa5f-68ad-4755-99e3-a7140a39ba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.145448 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecaa5f-68ad-4755-99e3-a7140a39ba8d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.145965 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecaa5f-68ad-4755-99e3-a7140a39ba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.146407 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecaa5f-68ad-4755-99e3-a7140a39ba8d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.165031 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 321/656] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:41.166675 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d03dc4-488b-407a-bcba-84fe3935b029 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.166802 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecaa5f-68ad-4755-99e3-a7140a39ba8d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.168839 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecaa5f-68ad-4755-99e3-a7140a39ba8d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.179731 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d03dc4-488b-407a-bcba-84fe3935b029 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.185062 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d37101-3bdf-40cf-b720-a46e912f3264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.185933 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d37101-3bdf-40cf-b720-a46e912f3264 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.186434 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d37101-3bdf-40cf-b720-a46e912f3264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.186984 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d37101-3bdf-40cf-b720-a46e912f3264 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.187968 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d37101-3bdf-40cf-b720-a46e912f3264 admin admin] RBAC: Adding query filter params (role.id=9209cdab986041f1a45283ada1ae297a, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=f6db9534cc094e8281b0aa34e2cb4b46) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:41.188493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d37101-3bdf-40cf-b720-a46e912f3264 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.189486 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-d6ecaa5f-68ad-4755-99e3-a7140a39ba8d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:41.190793 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d37101-3bdf-40cf-b720-a46e912f3264 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.192058 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 336/657] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:41.198489 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecaa5f-68ad-4755-99e3-a7140a39ba8d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.199242 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 322/658] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/role_assignments?user.id=f6db9534cc094e8281b0aa34e2cb4b46&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=9209cdab986041f1a45283ada1ae297a => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:41.212627 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecaa5f-68ad-4755-99e3-a7140a39ba8d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.229071 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2ace1-8640-4574-a9e5-572f750874d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.229890 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2ace1-8640-4574-a9e5-572f750874d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.230240 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2ace1-8640-4574-a9e5-572f750874d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.230581 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2ace1-8640-4574-a9e5-572f750874d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.231426 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2ace1-8640-4574-a9e5-572f750874d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:41.232058 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2ace1-8640-4574-a9e5-572f750874d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.233782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2ace1-8640-4574-a9e5-572f750874d2 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.247410 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 337/659] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:41.252795 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d37101-3bdf-40cf-b720-a46e912f3264 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.266966 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d37101-3bdf-40cf-b720-a46e912f3264 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.268213 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b524f4f-6a6b-4a43-be90-2ad5cfcff741 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.268504 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b524f4f-6a6b-4a43-be90-2ad5cfcff741 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.268776 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b524f4f-6a6b-4a43-be90-2ad5cfcff741 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.270825 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 338/660] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:50:41.277279 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d2667-cca9-4052-adbe-ca7cf4f47554 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.277886 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d2667-cca9-4052-adbe-ca7cf4f47554 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.277886 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d2667-cca9-4052-adbe-ca7cf4f47554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.281544 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1880e6-8a30-4ca2-884e-a9d257602113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.282350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1880e6-8a30-4ca2-884e-a9d257602113 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.282632 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1880e6-8a30-4ca2-884e-a9d257602113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.282936 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1880e6-8a30-4ca2-884e-a9d257602113 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.300590 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1880e6-8a30-4ca2-884e-a9d257602113 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.304116 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1880e6-8a30-4ca2-884e-a9d257602113 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.310198 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-b11d2667-cca9-4052-adbe-ca7cf4f47554 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:41.311438 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-b11d2667-cca9-4052-adbe-ca7cf4f47554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:41.325705 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-6d1880e6-8a30-4ca2-884e-a9d257602113 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:41.327859 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 323/661] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:41.333888 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1880e6-8a30-4ca2-884e-a9d257602113 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.337288 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 339/662] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:50:41.346394 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1880e6-8a30-4ca2-884e-a9d257602113 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.352222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbca4bd-2a95-4299-bacd-ba463706dafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.353306 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbca4bd-2a95-4299-bacd-ba463706dafe admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.353803 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbca4bd-2a95-4299-bacd-ba463706dafe admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.354341 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbca4bd-2a95-4299-bacd-ba463706dafe admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.355458 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbca4bd-2a95-4299-bacd-ba463706dafe admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:41.356043 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbca4bd-2a95-4299-bacd-ba463706dafe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.358513 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbca4bd-2a95-4299-bacd-ba463706dafe admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.361652 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d2667-cca9-4052-adbe-ca7cf4f47554 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.373433 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 324/663] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:41.376921 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d2667-cca9-4052-adbe-ca7cf4f47554 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.380004 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbca4bd-2a95-4299-bacd-ba463706dafe admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.391966 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbca4bd-2a95-4299-bacd-ba463706dafe admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.392820 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee6c60-7df6-442c-bb28-018a16e747de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.393670 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee6c60-7df6-442c-bb28-018a16e747de admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.393896 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee6c60-7df6-442c-bb28-018a16e747de admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.394170 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee6c60-7df6-442c-bb28-018a16e747de admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.399352 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca9c39-3877-432d-a4dc-f3205dc91af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.400398 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca9c39-3877-432d-a4dc-f3205dc91af2 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.400931 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca9c39-3877-432d-a4dc-f3205dc91af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.401439 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca9c39-3877-432d-a4dc-f3205dc91af2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.402520 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca9c39-3877-432d-a4dc-f3205dc91af2 admin admin] RBAC: Adding query filter params (role.id=9209cdab986041f1a45283ada1ae297a, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=07ca3e2a770f463a95dfb045ffd51dd6) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:41.403114 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca9c39-3877-432d-a4dc-f3205dc91af2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.405298 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca9c39-3877-432d-a4dc-f3205dc91af2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.412392 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 325/664] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/role_assignments?user.id=07ca3e2a770f463a95dfb045ffd51dd6&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=9209cdab986041f1a45283ada1ae297a => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:41.422197 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee6c60-7df6-442c-bb28-018a16e747de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:41.429948 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-c9ee6c60-7df6-442c-bb28-018a16e747de admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:50:41.439518 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 340/665] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:41.446986 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca9c39-3877-432d-a4dc-f3205dc91af2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.460295 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca9c39-3877-432d-a4dc-f3205dc91af2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.466345 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36acfcc-e30e-46bd-9c12-3a0deec8ad7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.467505 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36acfcc-e30e-46bd-9c12-3a0deec8ad7f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.467988 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36acfcc-e30e-46bd-9c12-3a0deec8ad7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.468533 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36acfcc-e30e-46bd-9c12-3a0deec8ad7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.469499 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36acfcc-e30e-46bd-9c12-3a0deec8ad7f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:41.470034 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36acfcc-e30e-46bd-9c12-3a0deec8ad7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.472025 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36acfcc-e30e-46bd-9c12-3a0deec8ad7f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.483297 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 326/666] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:41.488655 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee6c60-7df6-442c-bb28-018a16e747de admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.507803 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee6c60-7df6-442c-bb28-018a16e747de admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.517310 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e80eb7-e774-4347-b90b-9bde5b30422d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.518125 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e80eb7-e774-4347-b90b-9bde5b30422d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.518403 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e80eb7-e774-4347-b90b-9bde5b30422d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.518691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e80eb7-e774-4347-b90b-9bde5b30422d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.537112 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e80eb7-e774-4347-b90b-9bde5b30422d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.539127 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e80eb7-e774-4347-b90b-9bde5b30422d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.563910 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-32e80eb7-e774-4347-b90b-9bde5b30422d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:41.565155 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 341/667] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:41.572464 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36acfcc-e30e-46bd-9c12-3a0deec8ad7f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.589725 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36acfcc-e30e-46bd-9c12-3a0deec8ad7f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.600636 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927342c1-bd30-4e6e-9e1a-6ce1ce1df2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.601631 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927342c1-bd30-4e6e-9e1a-6ce1ce1df2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.602108 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927342c1-bd30-4e6e-9e1a-6ce1ce1df2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.602394 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927342c1-bd30-4e6e-9e1a-6ce1ce1df2e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.603196 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927342c1-bd30-4e6e-9e1a-6ce1ce1df2e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:41.603509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927342c1-bd30-4e6e-9e1a-6ce1ce1df2e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.605126 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927342c1-bd30-4e6e-9e1a-6ce1ce1df2e2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.619501 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 327/668] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:41.624985 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e80eb7-e774-4347-b90b-9bde5b30422d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.636283 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e80eb7-e774-4347-b90b-9bde5b30422d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.643610 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608ce64-6858-4305-9710-7fbdc1fe9640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.644666 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608ce64-6858-4305-9710-7fbdc1fe9640 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.644945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608ce64-6858-4305-9710-7fbdc1fe9640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.645214 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608ce64-6858-4305-9710-7fbdc1fe9640 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.662270 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608ce64-6858-4305-9710-7fbdc1fe9640 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.664343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608ce64-6858-4305-9710-7fbdc1fe9640 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.683738 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-6608ce64-6858-4305-9710-7fbdc1fe9640 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 16:50:41.685299 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 342/669] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:41.690960 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927342c1-bd30-4e6e-9e1a-6ce1ce1df2e2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.702421 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927342c1-bd30-4e6e-9e1a-6ce1ce1df2e2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.709840 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261ee63-a0cd-4f6f-a2a0-7a197a5af31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.710568 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261ee63-a0cd-4f6f-a2a0-7a197a5af31a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.710889 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261ee63-a0cd-4f6f-a2a0-7a197a5af31a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.711168 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261ee63-a0cd-4f6f-a2a0-7a197a5af31a admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.712024 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261ee63-a0cd-4f6f-a2a0-7a197a5af31a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:41.712335 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261ee63-a0cd-4f6f-a2a0-7a197a5af31a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.714224 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261ee63-a0cd-4f6f-a2a0-7a197a5af31a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.748451 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 328/670] 10.222.0.42 () {56 vars in 1156 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:41.753822 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608ce64-6858-4305-9710-7fbdc1fe9640 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.764907 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608ce64-6858-4305-9710-7fbdc1fe9640 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.769532 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35c9f1-192f-4e44-be40-b40d10f3c14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.770310 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35c9f1-192f-4e44-be40-b40d10f3c14d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.770588 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35c9f1-192f-4e44-be40-b40d10f3c14d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.770889 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35c9f1-192f-4e44-be40-b40d10f3c14d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.782772 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35c9f1-192f-4e44-be40-b40d10f3c14d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.784510 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35c9f1-192f-4e44-be40-b40d10f3c14d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.802694 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-2b35c9f1-192f-4e44-be40-b40d10f3c14d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:41.804828 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 343/671] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:41.810639 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261ee63-a0cd-4f6f-a2a0-7a197a5af31a admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.821319 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261ee63-a0cd-4f6f-a2a0-7a197a5af31a admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.826090 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1acaf-80b5-432a-85b4-bde14972c648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.826829 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1acaf-80b5-432a-85b4-bde14972c648 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.827163 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1acaf-80b5-432a-85b4-bde14972c648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.827442 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1acaf-80b5-432a-85b4-bde14972c648 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.828168 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1acaf-80b5-432a-85b4-bde14972c648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:41.828473 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1acaf-80b5-432a-85b4-bde14972c648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.830120 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1acaf-80b5-432a-85b4-bde14972c648 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.843275 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 329/672] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:41.848552 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35c9f1-192f-4e44-be40-b40d10f3c14d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.860085 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35c9f1-192f-4e44-be40-b40d10f3c14d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.864795 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3d5be-a9d0-4f1d-80c0-e19a4bb7dc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.865569 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3d5be-a9d0-4f1d-80c0-e19a4bb7dc49 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.865920 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3d5be-a9d0-4f1d-80c0-e19a4bb7dc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.866193 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3d5be-a9d0-4f1d-80c0-e19a4bb7dc49 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.874551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3d5be-a9d0-4f1d-80c0-e19a4bb7dc49 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.876646 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3d5be-a9d0-4f1d-80c0-e19a4bb7dc49 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.891763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-9fb3d5be-a9d0-4f1d-80c0-e19a4bb7dc49 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:41.893243 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 344/673] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:41.899333 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1acaf-80b5-432a-85b4-bde14972c648 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.909179 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1acaf-80b5-432a-85b4-bde14972c648 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.914276 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5fa93-2e1f-498d-8b1b-9ba5b9912149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.915157 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5fa93-2e1f-498d-8b1b-9ba5b9912149 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.915438 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5fa93-2e1f-498d-8b1b-9ba5b9912149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.915788 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5fa93-2e1f-498d-8b1b-9ba5b9912149 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.916577 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5fa93-2e1f-498d-8b1b-9ba5b9912149 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:41.916883 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5fa93-2e1f-498d-8b1b-9ba5b9912149 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.918873 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5fa93-2e1f-498d-8b1b-9ba5b9912149 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:41.932505 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 330/674] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:41.938093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3d5be-a9d0-4f1d-80c0-e19a4bb7dc49 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:41.948379 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3d5be-a9d0-4f1d-80c0-e19a4bb7dc49 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:41.952986 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e83bc9-91af-4a2a-bc67-001fa656902a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:41.953963 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e83bc9-91af-4a2a-bc67-001fa656902a admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:41.954242 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e83bc9-91af-4a2a-bc67-001fa656902a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:41.954513 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e83bc9-91af-4a2a-bc67-001fa656902a admin admin] PATH_INFO: `/v3/projects/6160f9606d06486b9a11a23ee717af79/users/fc59cb98783b4353a405b8b9a3a9d592/roles/9209cdab986041f1a45283ada1ae297a` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:41.971633 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e83bc9-91af-4a2a-bc67-001fa656902a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6160f9606d06486b9a11a23ee717af79, user_id=fc59cb98783b4353a405b8b9a3a9d592, role_id=9209cdab986041f1a45283ada1ae297a)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:41.974316 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e83bc9-91af-4a2a-bc67-001fa656902a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:42.079601 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 345/675] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:50:41 2022] PUT /identity/v3/projects/6160f9606d06486b9a11a23ee717af79/users/fc59cb98783b4353a405b8b9a3a9d592/roles/9209cdab986041f1a45283ada1ae297a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:50:43.154456 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056d83c-6ad5-43ed-baa8-418c39dd9fd6 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:43.155168 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056d83c-6ad5-43ed-baa8-418c39dd9fd6 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:43.155168 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056d83c-6ad5-43ed-baa8-418c39dd9fd6 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:43.157027 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 331/676] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:43.162456 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6dd02-b223-4562-b16d-22bc835ad43f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:43.162950 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6dd02-b223-4562-b16d-22bc835ad43f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:43.163100 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6dd02-b223-4562-b16d-22bc835ad43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:43.189284 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-37a6dd02-b223-4562-b16d-22bc835ad43f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:43.190464 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-37a6dd02-b223-4562-b16d-22bc835ad43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:43.284073 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 346/677] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:50:43.315899 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056d83c-6ad5-43ed-baa8-418c39dd9fd6 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:43.338627 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056d83c-6ad5-43ed-baa8-418c39dd9fd6 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:43.343109 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e36ce-6d64-46b1-9318-4db27c769a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:43.343920 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e36ce-6d64-46b1-9318-4db27c769a30 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:43.344228 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e36ce-6d64-46b1-9318-4db27c769a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:43.344505 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e36ce-6d64-46b1-9318-4db27c769a30 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:43.363494 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e36ce-6d64-46b1-9318-4db27c769a30 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:43.371216 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-a07e36ce-6d64-46b1-9318-4db27c769a30 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:50:43.372714 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 332/678] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:50:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:43.378401 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6dd02-b223-4562-b16d-22bc835ad43f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:43.387743 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6dd02-b223-4562-b16d-22bc835ad43f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:43.397182 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51130e25-2795-41f8-a555-a1fc63d0a887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:43.398090 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51130e25-2795-41f8-a555-a1fc63d0a887 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:43.398410 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51130e25-2795-41f8-a555-a1fc63d0a887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:43.398715 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51130e25-2795-41f8-a555-a1fc63d0a887 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:43.399480 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51130e25-2795-41f8-a555-a1fc63d0a887 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:43.399788 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51130e25-2795-41f8-a555-a1fc63d0a887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:43.401446 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51130e25-2795-41f8-a555-a1fc63d0a887 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:43.414888 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 347/679] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:43.420462 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e36ce-6d64-46b1-9318-4db27c769a30 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:43.434142 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e36ce-6d64-46b1-9318-4db27c769a30 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:43.439725 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471d992-888c-4d8e-a6e1-acabc0d734f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:43.440507 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471d992-888c-4d8e-a6e1-acabc0d734f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:43.440786 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471d992-888c-4d8e-a6e1-acabc0d734f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:43.441058 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471d992-888c-4d8e-a6e1-acabc0d734f9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:43.455870 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471d992-888c-4d8e-a6e1-acabc0d734f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:43.457687 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471d992-888c-4d8e-a6e1-acabc0d734f9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:43.478045 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-9471d992-888c-4d8e-a6e1-acabc0d734f9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:43.483340 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 333/680] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:43.488873 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51130e25-2795-41f8-a555-a1fc63d0a887 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:43.499297 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51130e25-2795-41f8-a555-a1fc63d0a887 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:43.503893 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212ce77-b255-4e2f-9e14-81160b6b812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:43.504545 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212ce77-b255-4e2f-9e14-81160b6b812e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:43.504827 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212ce77-b255-4e2f-9e14-81160b6b812e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:43.505103 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212ce77-b255-4e2f-9e14-81160b6b812e admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:43.505938 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212ce77-b255-4e2f-9e14-81160b6b812e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:43.506243 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212ce77-b255-4e2f-9e14-81160b6b812e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:43.508401 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212ce77-b255-4e2f-9e14-81160b6b812e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:43.520924 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 348/681] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:43.527558 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471d992-888c-4d8e-a6e1-acabc0d734f9 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:43.537975 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471d992-888c-4d8e-a6e1-acabc0d734f9 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:43.543130 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cafa5a-3399-405d-b1b1-3b2095d901f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:43.543973 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cafa5a-3399-405d-b1b1-3b2095d901f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:43.544256 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cafa5a-3399-405d-b1b1-3b2095d901f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:43.544587 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cafa5a-3399-405d-b1b1-3b2095d901f2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:43.559040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cafa5a-3399-405d-b1b1-3b2095d901f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:43.561271 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cafa5a-3399-405d-b1b1-3b2095d901f2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:43.578681 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-f2cafa5a-3399-405d-b1b1-3b2095d901f2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 16:50:43.579913 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 334/682] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Feb 16 16:50:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:43.585637 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212ce77-b255-4e2f-9e14-81160b6b812e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:43.599753 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212ce77-b255-4e2f-9e14-81160b6b812e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:43.604860 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476264de-1c91-484f-a9e1-1a1a99398276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:43.605546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476264de-1c91-484f-a9e1-1a1a99398276 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:43.605828 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476264de-1c91-484f-a9e1-1a1a99398276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:43.606153 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476264de-1c91-484f-a9e1-1a1a99398276 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:43.607324 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476264de-1c91-484f-a9e1-1a1a99398276 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:43.607633 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476264de-1c91-484f-a9e1-1a1a99398276 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:43.609567 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476264de-1c91-484f-a9e1-1a1a99398276 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:43.628810 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 349/683] 10.222.0.42 () {56 vars in 1154 bytes} [Wed Feb 16 16:50:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:43.635038 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cafa5a-3399-405d-b1b1-3b2095d901f2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:43.645639 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13867a39-de2d-44bf-b91e-55b158746371 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:43.645943 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cafa5a-3399-405d-b1b1-3b2095d901f2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:43.646116 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13867a39-de2d-44bf-b91e-55b158746371 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:43.646295 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13867a39-de2d-44bf-b91e-55b158746371 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:43.648918 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 350/684] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:43.655159 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10851a-c188-4f46-b5f9-a3c5822c2383 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:43.655441 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10851a-c188-4f46-b5f9-a3c5822c2383 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:43.655715 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10851a-c188-4f46-b5f9-a3c5822c2383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:43.657652 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00836d-3e20-48a1-8422-56833a7af12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:43.658293 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00836d-3e20-48a1-8422-56833a7af12d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:43.658569 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00836d-3e20-48a1-8422-56833a7af12d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:43.658873 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00836d-3e20-48a1-8422-56833a7af12d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:43.671994 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00836d-3e20-48a1-8422-56833a7af12d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:43.673657 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00836d-3e20-48a1-8422-56833a7af12d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:43.690066 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-fe10851a-c188-4f46-b5f9-a3c5822c2383 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:43.691268 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-fe10851a-c188-4f46-b5f9-a3c5822c2383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:43.695336 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 335/685] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:43.703818 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00836d-3e20-48a1-8422-56833a7af12d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:43.709284 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 351/686] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:43.722191 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00836d-3e20-48a1-8422-56833a7af12d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:43.735485 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4828425-da1a-494f-9ee8-29f3ac91bdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:43.736278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4828425-da1a-494f-9ee8-29f3ac91bdbb admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:43.736556 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4828425-da1a-494f-9ee8-29f3ac91bdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:43.736828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4828425-da1a-494f-9ee8-29f3ac91bdbb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:43.754306 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4828425-da1a-494f-9ee8-29f3ac91bdbb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:43.756146 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4828425-da1a-494f-9ee8-29f3ac91bdbb admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:43.762734 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10851a-c188-4f46-b5f9-a3c5822c2383 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:43.772456 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10851a-c188-4f46-b5f9-a3c5822c2383 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:43.778027 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c3a60-b9be-44d2-aec7-21e020b3314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:43.778982 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c3a60-b9be-44d2-aec7-21e020b3314e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:43.779363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c3a60-b9be-44d2-aec7-21e020b3314e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:43.779834 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c3a60-b9be-44d2-aec7-21e020b3314e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:43.780160 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-e4828425-da1a-494f-9ee8-29f3ac91bdbb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:43.786714 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 336/687] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:43.795361 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4828425-da1a-494f-9ee8-29f3ac91bdbb admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:43.796458 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c3a60-b9be-44d2-aec7-21e020b3314e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:43.798592 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c3a60-b9be-44d2-aec7-21e020b3314e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:43.811360 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4828425-da1a-494f-9ee8-29f3ac91bdbb admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:43.817497 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-988c3a60-b9be-44d2-aec7-21e020b3314e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:43.819190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 352/688] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:43.825036 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c3a60-b9be-44d2-aec7-21e020b3314e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:43.830952 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d790a84-7ac8-4ace-87ca-6ced0a011ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:43.832934 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d790a84-7ac8-4ace-87ca-6ced0a011ddf admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:43.833372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d790a84-7ac8-4ace-87ca-6ced0a011ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:43.834230 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d790a84-7ac8-4ace-87ca-6ced0a011ddf admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:43.836816 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d790a84-7ac8-4ace-87ca-6ced0a011ddf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:43.837331 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d790a84-7ac8-4ace-87ca-6ced0a011ddf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:43.839597 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d790a84-7ac8-4ace-87ca-6ced0a011ddf admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:43.843368 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c3a60-b9be-44d2-aec7-21e020b3314e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:43.853349 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bf12b-c999-4095-bf63-bcd575297a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:43.854276 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bf12b-c999-4095-bf63-bcd575297a76 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:43.854670 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bf12b-c999-4095-bf63-bcd575297a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:43.855054 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bf12b-c999-4095-bf63-bcd575297a76 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:43.855936 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bf12b-c999-4095-bf63-bcd575297a76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:43.856343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bf12b-c999-4095-bf63-bcd575297a76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:43.858422 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bf12b-c999-4095-bf63-bcd575297a76 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:43.861643 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 337/689] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:43.868309 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d790a84-7ac8-4ace-87ca-6ced0a011ddf admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:43.886013 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 353/690] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:43.887724 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d790a84-7ac8-4ace-87ca-6ced0a011ddf admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:43.890339 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bf12b-c999-4095-bf63-bcd575297a76 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:43.901387 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b787e-628a-4d77-8b55-44f51c9b988f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:43.902367 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b787e-628a-4d77-8b55-44f51c9b988f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:43.902774 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b787e-628a-4d77-8b55-44f51c9b988f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:43.903231 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b787e-628a-4d77-8b55-44f51c9b988f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:43.908899 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bf12b-c999-4095-bf63-bcd575297a76 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:43.915890 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b787e-628a-4d77-8b55-44f51c9b988f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:43.919716 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b787e-628a-4d77-8b55-44f51c9b988f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:43.921747 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c94ac-c01e-45e6-a2c1-4e1317cab2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:43.922592 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c94ac-c01e-45e6-a2c1-4e1317cab2ee admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:43.922965 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c94ac-c01e-45e6-a2c1-4e1317cab2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:43.923595 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c94ac-c01e-45e6-a2c1-4e1317cab2ee admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:43.925235 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c94ac-c01e-45e6-a2c1-4e1317cab2ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:43.930418 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c94ac-c01e-45e6-a2c1-4e1317cab2ee admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:43.949382 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-558b787e-628a-4d77-8b55-44f51c9b988f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:43.952210 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 338/691] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:43.958258 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b787e-628a-4d77-8b55-44f51c9b988f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:43.970311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b787e-628a-4d77-8b55-44f51c9b988f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:43.975453 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbd904-486f-4e0d-9f6d-21961c846609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:43.976566 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbd904-486f-4e0d-9f6d-21961c846609 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:43.976955 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbd904-486f-4e0d-9f6d-21961c846609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:43.977397 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbd904-486f-4e0d-9f6d-21961c846609 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:43.978352 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbd904-486f-4e0d-9f6d-21961c846609 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:43.978801 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbd904-486f-4e0d-9f6d-21961c846609 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:43.981075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbd904-486f-4e0d-9f6d-21961c846609 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:43.995037 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 339/692] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:44.001440 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbd904-486f-4e0d-9f6d-21961c846609 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:44.013071 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbd904-486f-4e0d-9f6d-21961c846609 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:44.018309 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def09e4a-cbd7-435e-98f3-21aa0acbaa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:44.019069 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def09e4a-cbd7-435e-98f3-21aa0acbaa88 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:44.019354 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def09e4a-cbd7-435e-98f3-21aa0acbaa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:44.019670 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def09e4a-cbd7-435e-98f3-21aa0acbaa88 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:44.020628 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def09e4a-cbd7-435e-98f3-21aa0acbaa88 admin admin] RBAC: Adding query filter params (role.id=8263a29ceeed4576b3b6959c99964ed7, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=9a30603a236e4681a7702eec7029e9db) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:44.020964 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def09e4a-cbd7-435e-98f3-21aa0acbaa88 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:44.023550 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def09e4a-cbd7-435e-98f3-21aa0acbaa88 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:44.033605 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 354/693] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Feb 16 16:50:43 2022] POST /identity/v3/users => generated 254 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 16:50:44.036842 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 340/694] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:44 2022] GET /identity/v3/role_assignments?user.id=9a30603a236e4681a7702eec7029e9db&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:44.436501 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e81e1b-79c9-4c41-8b93-cdaef7017a6c None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:44.437096 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e81e1b-79c9-4c41-8b93-cdaef7017a6c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:44.437096 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e81e1b-79c9-4c41-8b93-cdaef7017a6c None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:44.439140 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 355/695] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:44.446405 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a1ac0-9b21-428f-9a2e-4a66882ed925 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:44.446989 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a1ac0-9b21-428f-9a2e-4a66882ed925 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:44.446989 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a1ac0-9b21-428f-9a2e-4a66882ed925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:44.466283 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-0a5a1ac0-9b21-428f-9a2e-4a66882ed925 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:44.467549 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-0a5a1ac0-9b21-428f-9a2e-4a66882ed925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:44.476531 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 341/696] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:50:44.500847 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e81e1b-79c9-4c41-8b93-cdaef7017a6c None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:44.514384 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e81e1b-79c9-4c41-8b93-cdaef7017a6c None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:44.518993 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afe74d-1a7b-4837-a19b-67573bd6716a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:44.519804 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afe74d-1a7b-4837-a19b-67573bd6716a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:44.520087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afe74d-1a7b-4837-a19b-67573bd6716a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:44.520364 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afe74d-1a7b-4837-a19b-67573bd6716a admin admin] PATH_INFO: `/v3/services/network` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:44.521086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afe74d-1a7b-4837-a19b-67573bd6716a admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:44.522171 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-95afe74d-1a7b-4837-a19b-67573bd6716a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:50:44.522171 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 16:50:44.522171 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 16:50:44.523962 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afe74d-1a7b-4837-a19b-67573bd6716a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:44.539987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-95afe74d-1a7b-4837-a19b-67573bd6716a admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 16 16:50:44.541681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 356/697] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:44 2022] GET /identity/v3/services/network => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:44.547528 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a1ac0-9b21-428f-9a2e-4a66882ed925 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:44.555892 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446039c-8979-4002-93b1-ae85687e56e8 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:44.556248 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446039c-8979-4002-93b1-ae85687e56e8 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:44.556547 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446039c-8979-4002-93b1-ae85687e56e8 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:44.558546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 357/698] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:44.559333 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a1ac0-9b21-428f-9a2e-4a66882ed925 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:44.564854 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965b9f2-690c-4652-921c-61727a04a82e None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:44.565404 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965b9f2-690c-4652-921c-61727a04a82e None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:44.565966 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965b9f2-690c-4652-921c-61727a04a82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:44.567801 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5012b-34e3-4e51-b709-469c6908f353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:44.568486 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5012b-34e3-4e51-b709-469c6908f353 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:44.568781 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5012b-34e3-4e51-b709-469c6908f353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:44.569039 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5012b-34e3-4e51-b709-469c6908f353 admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:44.570739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5012b-34e3-4e51-b709-469c6908f353 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:44.571283 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5012b-34e3-4e51-b709-469c6908f353 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:44.572927 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING py.warnings [None req-c5c5012b-34e3-4e51-b709-469c6908f353 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:50:44.572927 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: warnings.warn(msg) Feb 16 16:50:44.572927 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: Feb 16 16:50:44.580290 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5012b-34e3-4e51-b709-469c6908f353 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:44.586787 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 342/699] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Feb 16 16:50:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:44.592014 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-a965b9f2-690c-4652-921c-61727a04a82e None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:44.593079 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5012b-34e3-4e51-b709-469c6908f353 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:44.593813 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a965b9f2-690c-4652-921c-61727a04a82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:44.602790 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 358/700] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:44.610762 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5012b-34e3-4e51-b709-469c6908f353 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:44.625229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965b9f2-690c-4652-921c-61727a04a82e None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:44.625971 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3709a84-e1b0-4b05-8518-3fc2be9c0d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:44.626850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3709a84-e1b0-4b05-8518-3fc2be9c0d99 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:44.627299 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3709a84-e1b0-4b05-8518-3fc2be9c0d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:44.627726 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3709a84-e1b0-4b05-8518-3fc2be9c0d99 admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:44.628577 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3709a84-e1b0-4b05-8518-3fc2be9c0d99 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:44.629037 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3709a84-e1b0-4b05-8518-3fc2be9c0d99 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:44.630792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3709a84-e1b0-4b05-8518-3fc2be9c0d99 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:44.640045 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965b9f2-690c-4652-921c-61727a04a82e None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:44.641828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 343/701] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Feb 16 16:50:44 2022] GET /identity/v3/services?type=network => generated 124 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:44.651465 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163edf7a-c5b7-41c1-9937-4bda6c2c7269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:44.652499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163edf7a-c5b7-41c1-9937-4bda6c2c7269 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:44.652949 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163edf7a-c5b7-41c1-9937-4bda6c2c7269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:44.653378 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163edf7a-c5b7-41c1-9937-4bda6c2c7269 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:44.654180 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163edf7a-c5b7-41c1-9937-4bda6c2c7269 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:44.655944 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163edf7a-c5b7-41c1-9937-4bda6c2c7269 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:44.675440 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-163edf7a-c5b7-41c1-9937-4bda6c2c7269 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 16 16:50:44.677173 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 359/702] 10.222.0.42 () {56 vars in 1150 bytes} [Wed Feb 16 16:50:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:44.683825 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3709a84-e1b0-4b05-8518-3fc2be9c0d99 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:44.693984 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3709a84-e1b0-4b05-8518-3fc2be9c0d99 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:44.703118 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac54f6b-8eb2-4fd9-ab25-6b2ce270702d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:44.704028 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac54f6b-8eb2-4fd9-ab25-6b2ce270702d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:44.704457 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac54f6b-8eb2-4fd9-ab25-6b2ce270702d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:44.704899 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac54f6b-8eb2-4fd9-ab25-6b2ce270702d admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:44.705753 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac54f6b-8eb2-4fd9-ab25-6b2ce270702d admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:44.706212 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac54f6b-8eb2-4fd9-ab25-6b2ce270702d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:44.707959 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac54f6b-8eb2-4fd9-ab25-6b2ce270702d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:44.718923 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 344/703] 10.222.0.42 () {56 vars in 1145 bytes} [Wed Feb 16 16:50:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:44.724928 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163edf7a-c5b7-41c1-9937-4bda6c2c7269 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:44.735902 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163edf7a-c5b7-41c1-9937-4bda6c2c7269 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:44.747957 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf099e-644b-4cbb-936b-c9ff2327af99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:44.748875 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf099e-644b-4cbb-936b-c9ff2327af99 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:44.749299 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf099e-644b-4cbb-936b-c9ff2327af99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:44.749747 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf099e-644b-4cbb-936b-c9ff2327af99 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:44.750601 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf099e-644b-4cbb-936b-c9ff2327af99 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:44.751069 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf099e-644b-4cbb-936b-c9ff2327af99 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:44.752301 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-dddf099e-644b-4cbb-936b-c9ff2327af99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:50:44.752301 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 16:50:44.752301 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 16:50:44.753496 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf099e-644b-4cbb-936b-c9ff2327af99 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:44.764970 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 360/704] 10.222.0.42 () {56 vars in 1145 bytes} [Wed Feb 16 16:50:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:44.962386 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3faa1-d7a6-4f4e-8aeb-220401ac6176 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:44.962921 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3faa1-d7a6-4f4e-8aeb-220401ac6176 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:44.963344 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3faa1-d7a6-4f4e-8aeb-220401ac6176 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:44.965626 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 345/705] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:44.971180 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bc977-3743-49c4-a6ad-d91d176525d2 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:44.971672 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bc977-3743-49c4-a6ad-d91d176525d2 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:44.972092 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bc977-3743-49c4-a6ad-d91d176525d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:44.995987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-e65bc977-3743-49c4-a6ad-d91d176525d2 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:44.997453 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e65bc977-3743-49c4-a6ad-d91d176525d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:45.006516 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 361/706] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:45.030076 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3faa1-d7a6-4f4e-8aeb-220401ac6176 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:45.044616 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3faa1-d7a6-4f4e-8aeb-220401ac6176 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:45.049655 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b3e20-1fab-472e-9006-9c00498659e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:45.050599 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b3e20-1fab-472e-9006-9c00498659e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:45.051000 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b3e20-1fab-472e-9006-9c00498659e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:45.051400 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b3e20-1fab-472e-9006-9c00498659e0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:45.068867 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b3e20-1fab-472e-9006-9c00498659e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:45.075958 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-943b3e20-1fab-472e-9006-9c00498659e0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:50:45.077334 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 346/707] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:45.083015 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bc977-3743-49c4-a6ad-d91d176525d2 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:45.095802 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bc977-3743-49c4-a6ad-d91d176525d2 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:45.107578 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd22437-8776-410f-834c-b0423d2f9bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:45.108259 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd22437-8776-410f-834c-b0423d2f9bfc admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:45.108578 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd22437-8776-410f-834c-b0423d2f9bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:45.108802 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd22437-8776-410f-834c-b0423d2f9bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:45.109555 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd22437-8776-410f-834c-b0423d2f9bfc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:45.109855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd22437-8776-410f-834c-b0423d2f9bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:45.111538 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd22437-8776-410f-834c-b0423d2f9bfc admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:45.120762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 362/708] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:50:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:45.126209 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b3e20-1fab-472e-9006-9c00498659e0 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:45.138825 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b3e20-1fab-472e-9006-9c00498659e0 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:45.145457 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38908680-c83a-4520-aaf3-dd44e5909c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:45.146284 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38908680-c83a-4520-aaf3-dd44e5909c33 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:45.146572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38908680-c83a-4520-aaf3-dd44e5909c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:45.146871 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38908680-c83a-4520-aaf3-dd44e5909c33 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:45.166137 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38908680-c83a-4520-aaf3-dd44e5909c33 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:45.168041 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38908680-c83a-4520-aaf3-dd44e5909c33 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:45.190221 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-38908680-c83a-4520-aaf3-dd44e5909c33 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:45.191478 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 347/709] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:45.197592 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd22437-8776-410f-834c-b0423d2f9bfc admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:45.212857 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd22437-8776-410f-834c-b0423d2f9bfc admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:45.225628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6681e-9b15-45cd-838e-47a20166ac0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:45.226322 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6681e-9b15-45cd-838e-47a20166ac0e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:45.226629 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6681e-9b15-45cd-838e-47a20166ac0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:45.227006 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6681e-9b15-45cd-838e-47a20166ac0e admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:45.227728 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6681e-9b15-45cd-838e-47a20166ac0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:45.228031 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6681e-9b15-45cd-838e-47a20166ac0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:45.229638 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6681e-9b15-45cd-838e-47a20166ac0e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:45.248716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 363/710] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:45.254232 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38908680-c83a-4520-aaf3-dd44e5909c33 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:45.267951 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38908680-c83a-4520-aaf3-dd44e5909c33 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:45.276283 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571482a4-8475-4c70-af66-1abbe479ea5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:45.277077 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571482a4-8475-4c70-af66-1abbe479ea5f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:45.277377 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571482a4-8475-4c70-af66-1abbe479ea5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:45.277655 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571482a4-8475-4c70-af66-1abbe479ea5f admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:45.290855 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571482a4-8475-4c70-af66-1abbe479ea5f admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:45.292871 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571482a4-8475-4c70-af66-1abbe479ea5f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:45.473202 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-571482a4-8475-4c70-af66-1abbe479ea5f admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 16:50:45.474761 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 348/711] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:50:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:45.480487 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6681e-9b15-45cd-838e-47a20166ac0e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:45.502491 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6681e-9b15-45cd-838e-47a20166ac0e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:45.526201 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07248fb-dc9b-4056-9e99-0cdd33c4058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:45.526201 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07248fb-dc9b-4056-9e99-0cdd33c4058f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:45.526201 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07248fb-dc9b-4056-9e99-0cdd33c4058f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:45.526201 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07248fb-dc9b-4056-9e99-0cdd33c4058f admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:45.527202 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07248fb-dc9b-4056-9e99-0cdd33c4058f admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:45.530696 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07248fb-dc9b-4056-9e99-0cdd33c4058f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:45.531811 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07248fb-dc9b-4056-9e99-0cdd33c4058f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:45.561384 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 364/712] 10.222.0.42 () {56 vars in 1156 bytes} [Wed Feb 16 16:50:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:45.566948 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571482a4-8475-4c70-af66-1abbe479ea5f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:45.582679 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571482a4-8475-4c70-af66-1abbe479ea5f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:45.596721 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44046260-8eb4-4721-b7dd-67d43d546410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:45.597399 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44046260-8eb4-4721-b7dd-67d43d546410 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:45.597683 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44046260-8eb4-4721-b7dd-67d43d546410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:45.597959 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44046260-8eb4-4721-b7dd-67d43d546410 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:45.611112 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44046260-8eb4-4721-b7dd-67d43d546410 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:45.612897 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44046260-8eb4-4721-b7dd-67d43d546410 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:45.622795 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 349/713] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 16:50:45.628012 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07248fb-dc9b-4056-9e99-0cdd33c4058f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:45.643689 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07248fb-dc9b-4056-9e99-0cdd33c4058f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:45.654922 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d1051-ef97-4c97-b01a-cd9c7333b540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:45.655731 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d1051-ef97-4c97-b01a-cd9c7333b540 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:45.656006 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d1051-ef97-4c97-b01a-cd9c7333b540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:45.656332 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d1051-ef97-4c97-b01a-cd9c7333b540 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:45.672055 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d1051-ef97-4c97-b01a-cd9c7333b540 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:45.673893 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d1051-ef97-4c97-b01a-cd9c7333b540 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:45.698277 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-a29d1051-ef97-4c97-b01a-cd9c7333b540 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:45.703679 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 365/714] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:45.705031 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44046260-8eb4-4721-b7dd-67d43d546410 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:45.721202 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44046260-8eb4-4721-b7dd-67d43d546410 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:45.729178 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7ee22-aaec-4d5b-b06c-00d59fb299d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:45.729778 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7ee22-aaec-4d5b-b06c-00d59fb299d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:45.730085 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7ee22-aaec-4d5b-b06c-00d59fb299d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:45.730362 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7ee22-aaec-4d5b-b06c-00d59fb299d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:45.731143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7ee22-aaec-4d5b-b06c-00d59fb299d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:45.731450 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7ee22-aaec-4d5b-b06c-00d59fb299d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:45.733287 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7ee22-aaec-4d5b-b06c-00d59fb299d0 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:45.746401 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 350/715] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:45.752812 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d1051-ef97-4c97-b01a-cd9c7333b540 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:45.766070 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d1051-ef97-4c97-b01a-cd9c7333b540 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:45.770540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411ba47-9aa1-40a6-bd6a-c5123287d33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:45.771393 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411ba47-9aa1-40a6-bd6a-c5123287d33c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:45.771670 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411ba47-9aa1-40a6-bd6a-c5123287d33c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:45.771994 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411ba47-9aa1-40a6-bd6a-c5123287d33c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:45.791915 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411ba47-9aa1-40a6-bd6a-c5123287d33c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:45.794260 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411ba47-9aa1-40a6-bd6a-c5123287d33c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:45.818301 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-0411ba47-9aa1-40a6-bd6a-c5123287d33c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:45.820210 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 366/716] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:45.825939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7ee22-aaec-4d5b-b06c-00d59fb299d0 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:45.841255 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7ee22-aaec-4d5b-b06c-00d59fb299d0 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:45.855225 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6feb8-3d13-4c21-b9ef-da3e9a3f80ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:45.855899 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6feb8-3d13-4c21-b9ef-da3e9a3f80ca admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:45.856187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6feb8-3d13-4c21-b9ef-da3e9a3f80ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:45.856461 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6feb8-3d13-4c21-b9ef-da3e9a3f80ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:45.857525 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6feb8-3d13-4c21-b9ef-da3e9a3f80ca admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:45.857837 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6feb8-3d13-4c21-b9ef-da3e9a3f80ca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:45.859733 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6feb8-3d13-4c21-b9ef-da3e9a3f80ca admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:45.872980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 351/717] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:45.878841 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411ba47-9aa1-40a6-bd6a-c5123287d33c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:45.895985 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411ba47-9aa1-40a6-bd6a-c5123287d33c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:45.907189 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e52190-a356-4cd7-a62b-103ea299c427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:45.908252 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e52190-a356-4cd7-a62b-103ea299c427 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:45.908731 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e52190-a356-4cd7-a62b-103ea299c427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:45.909195 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e52190-a356-4cd7-a62b-103ea299c427 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:45.910213 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e52190-a356-4cd7-a62b-103ea299c427 admin admin] RBAC: Adding query filter params (role.id=9209cdab986041f1a45283ada1ae297a, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=fc59cb98783b4353a405b8b9a3a9d592) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:45.910763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e52190-a356-4cd7-a62b-103ea299c427 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:45.912836 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e52190-a356-4cd7-a62b-103ea299c427 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:45.923330 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 367/718] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:45 2022] GET /identity/v3/role_assignments?user.id=fc59cb98783b4353a405b8b9a3a9d592&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=9209cdab986041f1a45283ada1ae297a => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:46.811446 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07412ad6-1068-401d-838d-08320d0ab89f None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:46.811939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07412ad6-1068-401d-838d-08320d0ab89f None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:46.811939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07412ad6-1068-401d-838d-08320d0ab89f None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:46.813968 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 352/719] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:46.823282 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af3306-bae5-44ea-a26a-74ee3f26130e None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:46.823824 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af3306-bae5-44ea-a26a-74ee3f26130e None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:46.824192 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af3306-bae5-44ea-a26a-74ee3f26130e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:46.855493 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-12af3306-bae5-44ea-a26a-74ee3f26130e None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:46.856684 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-12af3306-bae5-44ea-a26a-74ee3f26130e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:46.868893 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 368/720] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:50:46.902591 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07412ad6-1068-401d-838d-08320d0ab89f None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:46.924227 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07412ad6-1068-401d-838d-08320d0ab89f None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:46.931355 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59a73b-a27b-46d3-904c-10a617cc5cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:46.932327 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59a73b-a27b-46d3-904c-10a617cc5cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:46.932616 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59a73b-a27b-46d3-904c-10a617cc5cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:46.932893 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59a73b-a27b-46d3-904c-10a617cc5cc5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:46.948424 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59a73b-a27b-46d3-904c-10a617cc5cc5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:46.955726 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-6e59a73b-a27b-46d3-904c-10a617cc5cc5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:50:46.957294 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 353/721] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:50:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:46.963647 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af3306-bae5-44ea-a26a-74ee3f26130e None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:46.975882 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af3306-bae5-44ea-a26a-74ee3f26130e None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:46.991919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9aa7a-3443-4853-9f8b-778a5a063e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:46.993217 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9aa7a-3443-4853-9f8b-778a5a063e26 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:46.993707 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9aa7a-3443-4853-9f8b-778a5a063e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:46.994174 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9aa7a-3443-4853-9f8b-778a5a063e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:46.995163 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9aa7a-3443-4853-9f8b-778a5a063e26 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:46.995683 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9aa7a-3443-4853-9f8b-778a5a063e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:46.997548 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9aa7a-3443-4853-9f8b-778a5a063e26 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:47.007127 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 369/722] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:47.017268 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59a73b-a27b-46d3-904c-10a617cc5cc5 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:47.027491 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59a73b-a27b-46d3-904c-10a617cc5cc5 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:47.044247 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1beb9-209b-492f-96db-167aedb848d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:47.045067 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1beb9-209b-492f-96db-167aedb848d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.045347 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1beb9-209b-492f-96db-167aedb848d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.045619 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1beb9-209b-492f-96db-167aedb848d9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.063885 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1beb9-209b-492f-96db-167aedb848d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:47.065641 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1beb9-209b-492f-96db-167aedb848d9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:47.097431 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-dcd1beb9-209b-492f-96db-167aedb848d9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:47.099017 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 354/723] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:47.104489 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9aa7a-3443-4853-9f8b-778a5a063e26 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:47.123814 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9aa7a-3443-4853-9f8b-778a5a063e26 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:47.141192 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b7f6e-8004-4dbc-b7ef-6fbfc62c1599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:47.142093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b7f6e-8004-4dbc-b7ef-6fbfc62c1599 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.142521 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b7f6e-8004-4dbc-b7ef-6fbfc62c1599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.142958 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b7f6e-8004-4dbc-b7ef-6fbfc62c1599 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.143822 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b7f6e-8004-4dbc-b7ef-6fbfc62c1599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:47.144269 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b7f6e-8004-4dbc-b7ef-6fbfc62c1599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:47.146016 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b7f6e-8004-4dbc-b7ef-6fbfc62c1599 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:47.165248 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 370/724] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:47.170687 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1beb9-209b-492f-96db-167aedb848d9 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:47.184183 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1beb9-209b-492f-96db-167aedb848d9 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:47.190737 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d96f6-7140-4303-9918-d398c64cae02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:47.191527 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d96f6-7140-4303-9918-d398c64cae02 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.191807 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d96f6-7140-4303-9918-d398c64cae02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.192079 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d96f6-7140-4303-9918-d398c64cae02 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.201696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d96f6-7140-4303-9918-d398c64cae02 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:47.208177 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d96f6-7140-4303-9918-d398c64cae02 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:47.228810 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-ba0d96f6-7140-4303-9918-d398c64cae02 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 16:50:47.230431 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 355/725] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Feb 16 16:50:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:47.236458 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b7f6e-8004-4dbc-b7ef-6fbfc62c1599 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:47.257804 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b7f6e-8004-4dbc-b7ef-6fbfc62c1599 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:47.272136 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b13ed-3c31-4beb-b3fd-1a6ce470856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:47.272837 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b13ed-3c31-4beb-b3fd-1a6ce470856d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.273159 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b13ed-3c31-4beb-b3fd-1a6ce470856d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.273453 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b13ed-3c31-4beb-b3fd-1a6ce470856d admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.274285 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b13ed-3c31-4beb-b3fd-1a6ce470856d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:47.274589 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b13ed-3c31-4beb-b3fd-1a6ce470856d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:47.276444 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b13ed-3c31-4beb-b3fd-1a6ce470856d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:47.281509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c900ec6-fca7-4274-a6e8-773e71cef12f None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.282032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c900ec6-fca7-4274-a6e8-773e71cef12f None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.282508 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c900ec6-fca7-4274-a6e8-773e71cef12f None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.284723 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 356/726] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:47.294827 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5f56-00ef-46d2-840e-fb0ab64dd682 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.295387 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5f56-00ef-46d2-840e-fb0ab64dd682 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.295881 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5f56-00ef-46d2-840e-fb0ab64dd682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.305727 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 371/727] 10.222.0.42 () {56 vars in 1154 bytes} [Wed Feb 16 16:50:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:47.312416 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b13ed-3c31-4beb-b3fd-1a6ce470856d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:47.323083 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-735a5f56-00ef-46d2-840e-fb0ab64dd682 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:47.324822 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-735a5f56-00ef-46d2-840e-fb0ab64dd682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:47.326246 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b13ed-3c31-4beb-b3fd-1a6ce470856d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:47.331238 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd264a-b5a2-4422-b44c-e2ceb15668dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:47.332126 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd264a-b5a2-4422-b44c-e2ceb15668dd admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.332400 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd264a-b5a2-4422-b44c-e2ceb15668dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.332676 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd264a-b5a2-4422-b44c-e2ceb15668dd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.334759 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 357/728] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 16:50:47.355053 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd264a-b5a2-4422-b44c-e2ceb15668dd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:47.357141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd264a-b5a2-4422-b44c-e2ceb15668dd admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:47.363485 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a5f56-00ef-46d2-840e-fb0ab64dd682 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:47.374356 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a5f56-00ef-46d2-840e-fb0ab64dd682 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:47.379281 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275dadd-54d8-48fd-a5e2-270d276b9adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:47.380338 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275dadd-54d8-48fd-a5e2-270d276b9adf admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.380839 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275dadd-54d8-48fd-a5e2-270d276b9adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.381357 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275dadd-54d8-48fd-a5e2-270d276b9adf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.381473 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-5ffd264a-b5a2-4422-b44c-e2ceb15668dd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:47.386717 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 372/729] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:47.389530 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd264a-b5a2-4422-b44c-e2ceb15668dd admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:47.408820 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd264a-b5a2-4422-b44c-e2ceb15668dd admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:47.411026 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275dadd-54d8-48fd-a5e2-270d276b9adf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:47.422252 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c6842-b781-41c1-bee1-5ba7cdaac72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:47.423319 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c6842-b781-41c1-bee1-5ba7cdaac72a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.423799 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c6842-b781-41c1-bee1-5ba7cdaac72a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.424332 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c6842-b781-41c1-bee1-5ba7cdaac72a admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.425258 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c6842-b781-41c1-bee1-5ba7cdaac72a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:47.425802 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c6842-b781-41c1-bee1-5ba7cdaac72a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:47.428040 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c6842-b781-41c1-bee1-5ba7cdaac72a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:47.428518 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-0275dadd-54d8-48fd-a5e2-270d276b9adf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:50:47.430372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 358/730] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:47.447925 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 373/731] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:47.449506 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275dadd-54d8-48fd-a5e2-270d276b9adf admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:47.458070 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c6842-b781-41c1-bee1-5ba7cdaac72a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:47.463473 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275dadd-54d8-48fd-a5e2-270d276b9adf admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:47.474825 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564d190-5b90-49e7-a187-827b7e07c93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:47.475876 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564d190-5b90-49e7-a187-827b7e07c93b admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.476647 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564d190-5b90-49e7-a187-827b7e07c93b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.477120 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564d190-5b90-49e7-a187-827b7e07c93b admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.478883 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564d190-5b90-49e7-a187-827b7e07c93b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:47.479697 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564d190-5b90-49e7-a187-827b7e07c93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:47.483768 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564d190-5b90-49e7-a187-827b7e07c93b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:47.484885 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c6842-b781-41c1-bee1-5ba7cdaac72a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:47.495449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff72864-cdb8-492b-a466-0be76893df0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:47.496569 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff72864-cdb8-492b-a466-0be76893df0c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.497087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff72864-cdb8-492b-a466-0be76893df0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.497610 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff72864-cdb8-492b-a466-0be76893df0c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.502378 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 359/732] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:50:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:47.509173 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265162b-d386-4473-83fe-90191bc5709a None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.509514 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff72864-cdb8-492b-a466-0be76893df0c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:47.509955 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265162b-d386-4473-83fe-90191bc5709a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.510459 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265162b-d386-4473-83fe-90191bc5709a None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.511515 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff72864-cdb8-492b-a466-0be76893df0c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:47.513040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 360/733] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:50:47.514224 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265162b-d386-4473-83fe-90191bc5709a None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:47.531927 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-1ff72864-cdb8-492b-a466-0be76893df0c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:47.533755 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 374/734] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:47.534715 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265162b-d386-4473-83fe-90191bc5709a None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:47.535318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34192c8-4470-430a-9907-acf67d88839b None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.535745 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34192c8-4470-430a-9907-acf67d88839b None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.536161 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34192c8-4470-430a-9907-acf67d88839b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.539908 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5df715-5fa0-42ed-984c-153f2e010569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:47.540931 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5df715-5fa0-42ed-984c-153f2e010569 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.541322 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5df715-5fa0-42ed-984c-153f2e010569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.541698 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5df715-5fa0-42ed-984c-153f2e010569 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.553267 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5df715-5fa0-42ed-984c-153f2e010569 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:47.555618 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5df715-5fa0-42ed-984c-153f2e010569 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:47.556268 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-e34192c8-4470-430a-9907-acf67d88839b None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:47.557606 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e34192c8-4470-430a-9907-acf67d88839b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:47.565979 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 375/735] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 16:50:47.567117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34192c8-4470-430a-9907-acf67d88839b None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:47.583485 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34192c8-4470-430a-9907-acf67d88839b None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:47.588037 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-5d5df715-5fa0-42ed-984c-153f2e010569 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:47.589594 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd2bcc-23e4-4090-9025-ab72d9c64f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:47.589729 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 361/736] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:47.590606 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd2bcc-23e4-4090-9025-ab72d9c64f78 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.591050 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd2bcc-23e4-4090-9025-ab72d9c64f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.591511 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd2bcc-23e4-4090-9025-ab72d9c64f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.592498 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd2bcc-23e4-4090-9025-ab72d9c64f78 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:47.592979 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd2bcc-23e4-4090-9025-ab72d9c64f78 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:47.595077 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5df715-5fa0-42ed-984c-153f2e010569 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:47.595533 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd2bcc-23e4-4090-9025-ab72d9c64f78 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:47.608438 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5df715-5fa0-42ed-984c-153f2e010569 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:47.609402 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 376/737] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:47.614390 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd2bcc-23e4-4090-9025-ab72d9c64f78 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:47.616334 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2688d13-ec5b-4719-8e33-8ae95bf58f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:47.617284 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2688d13-ec5b-4719-8e33-8ae95bf58f33 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.617821 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2688d13-ec5b-4719-8e33-8ae95bf58f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.618297 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2688d13-ec5b-4719-8e33-8ae95bf58f33 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.619423 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2688d13-ec5b-4719-8e33-8ae95bf58f33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:47.619995 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2688d13-ec5b-4719-8e33-8ae95bf58f33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:47.621923 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2688d13-ec5b-4719-8e33-8ae95bf58f33 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:47.624489 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd2bcc-23e4-4090-9025-ab72d9c64f78 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:47.629023 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c297c-5e12-4136-8adf-3c2be0076d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:47.629665 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c297c-5e12-4136-8adf-3c2be0076d0a admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.629944 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c297c-5e12-4136-8adf-3c2be0076d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.630215 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c297c-5e12-4136-8adf-3c2be0076d0a admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.630981 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c297c-5e12-4136-8adf-3c2be0076d0a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:47.632489 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-515c297c-5e12-4136-8adf-3c2be0076d0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:50:47.632489 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 16:50:47.632489 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 16:50:47.634103 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c297c-5e12-4136-8adf-3c2be0076d0a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:47.637941 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 362/738] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:47.639087 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2688d13-ec5b-4719-8e33-8ae95bf58f33 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:47.649930 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2688d13-ec5b-4719-8e33-8ae95bf58f33 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:47.655102 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b8e98-35f5-4870-889b-d0e752e4e0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:47.656058 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b8e98-35f5-4870-889b-d0e752e4e0c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.656424 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b8e98-35f5-4870-889b-d0e752e4e0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.656894 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b8e98-35f5-4870-889b-d0e752e4e0c0 admin admin] PATH_INFO: `/v3/projects/6160f9606d06486b9a11a23ee717af79/users/9a30603a236e4681a7702eec7029e9db/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.658962 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b8e98-35f5-4870-889b-d0e752e4e0c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6160f9606d06486b9a11a23ee717af79, user_id=9a30603a236e4681a7702eec7029e9db, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:47.661708 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b8e98-35f5-4870-889b-d0e752e4e0c0 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:47.741853 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 377/739] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Feb 16 16:50:47 2022] POST /identity/v3/services => generated 251 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:50:47.743510 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c297c-5e12-4136-8adf-3c2be0076d0a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:47.766620 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c297c-5e12-4136-8adf-3c2be0076d0a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:47.774464 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7740e5c-7d87-44e6-bba1-70af4d1b4128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:47.775450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7740e5c-7d87-44e6-bba1-70af4d1b4128 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.775735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7740e5c-7d87-44e6-bba1-70af4d1b4128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.776015 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7740e5c-7d87-44e6-bba1-70af4d1b4128 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.785050 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7740e5c-7d87-44e6-bba1-70af4d1b4128 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:47.787273 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7740e5c-7d87-44e6-bba1-70af4d1b4128 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:47.807569 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 363/740] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:50:47 2022] PUT /identity/v3/projects/6160f9606d06486b9a11a23ee717af79/users/9a30603a236e4681a7702eec7029e9db/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:50:47.807797 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-a7740e5c-7d87-44e6-bba1-70af4d1b4128 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 16:50:47.807880 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2af92c-bf50-4558-b480-0e477083c850 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.807949 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 378/741] 10.222.0.42 () {56 vars in 1138 bytes} [Wed Feb 16 16:50:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:47.808015 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2af92c-bf50-4558-b480-0e477083c850 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.808015 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2af92c-bf50-4558-b480-0e477083c850 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.808015 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 364/742] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:47.811992 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7740e5c-7d87-44e6-bba1-70af4d1b4128 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:47.816703 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9577d03-20e2-4c9a-b470-b011dda31c8c None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.817251 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9577d03-20e2-4c9a-b470-b011dda31c8c None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.817509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9577d03-20e2-4c9a-b470-b011dda31c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.830173 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7740e5c-7d87-44e6-bba1-70af4d1b4128 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:47.862224 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-d9577d03-20e2-4c9a-b470-b011dda31c8c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:47.863810 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d9577d03-20e2-4c9a-b470-b011dda31c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:47.963510 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 365/743] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:47 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:50:47.969198 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719951a-a87d-42da-a6f5-6f87c7223387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:47.969198 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719951a-a87d-42da-a6f5-6f87c7223387 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:47.969198 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719951a-a87d-42da-a6f5-6f87c7223387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:47.969198 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719951a-a87d-42da-a6f5-6f87c7223387 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:47.969638 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719951a-a87d-42da-a6f5-6f87c7223387 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:47.969638 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719951a-a87d-42da-a6f5-6f87c7223387 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:47.970432 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719951a-a87d-42da-a6f5-6f87c7223387 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:47.991736 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9577d03-20e2-4c9a-b470-b011dda31c8c None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:48.003188 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 379/744] 10.222.0.42 () {56 vars in 1170 bytes} [Wed Feb 16 16:50:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:48.009008 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9577d03-20e2-4c9a-b470-b011dda31c8c None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:48.010283 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719951a-a87d-42da-a6f5-6f87c7223387 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:48.015418 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a92e6-26d5-454f-9d13-19eb9583a4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:48.016360 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a92e6-26d5-454f-9d13-19eb9583a4e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:48.017095 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a92e6-26d5-454f-9d13-19eb9583a4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:48.017665 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a92e6-26d5-454f-9d13-19eb9583a4e9 admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:48.019226 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a92e6-26d5-454f-9d13-19eb9583a4e9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:48.020828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING py.warnings [None req-ce1a92e6-26d5-454f-9d13-19eb9583a4e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:50:48.020828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: warnings.warn(msg) Feb 16 16:50:48.020828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: Feb 16 16:50:48.022027 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a92e6-26d5-454f-9d13-19eb9583a4e9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:48.023350 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719951a-a87d-42da-a6f5-6f87c7223387 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:48.028870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1819a8-84c2-4939-bd06-c283204e9d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:48.030254 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1819a8-84c2-4939-bd06-c283204e9d53 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:48.030254 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1819a8-84c2-4939-bd06-c283204e9d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:48.030447 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1819a8-84c2-4939-bd06-c283204e9d53 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:48.041055 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1819a8-84c2-4939-bd06-c283204e9d53 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:48.043127 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1819a8-84c2-4939-bd06-c283204e9d53 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:48.052974 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 380/745] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:48 2022] GET /identity/v3/auth/tokens => generated 1018 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:50:48.058534 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1819a8-84c2-4939-bd06-c283204e9d53 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:48.067831 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1819a8-84c2-4939-bd06-c283204e9d53 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:48.072877 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dbe7c-ead1-46c0-9098-ef380727d44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:48.073806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dbe7c-ead1-46c0-9098-ef380727d44e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:48.074229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dbe7c-ead1-46c0-9098-ef380727d44e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:48.074562 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dbe7c-ead1-46c0-9098-ef380727d44e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:48.085864 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dbe7c-ead1-46c0-9098-ef380727d44e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:48.087930 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dbe7c-ead1-46c0-9098-ef380727d44e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:48.105960 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-665dbe7c-ead1-46c0-9098-ef380727d44e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:48.107727 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 381/746] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:48.113000 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dbe7c-ead1-46c0-9098-ef380727d44e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:48.127110 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dbe7c-ead1-46c0-9098-ef380727d44e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:48.129219 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 366/747] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Feb 16 16:50:47 2022] POST /identity/v3/services => generated 240 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 16:50:48.145339 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7f723-02b6-4dc1-b13e-3a2e56a427ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:48.146089 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7f723-02b6-4dc1-b13e-3a2e56a427ff admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:48.146523 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7f723-02b6-4dc1-b13e-3a2e56a427ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:48.146831 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7f723-02b6-4dc1-b13e-3a2e56a427ff admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:48.148281 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7f723-02b6-4dc1-b13e-3a2e56a427ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:48.148640 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7f723-02b6-4dc1-b13e-3a2e56a427ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:48.150389 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7f723-02b6-4dc1-b13e-3a2e56a427ff admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:48.163836 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 382/748] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:48.169794 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a92e6-26d5-454f-9d13-19eb9583a4e9 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:48.181605 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a92e6-26d5-454f-9d13-19eb9583a4e9 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:48.189814 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59468f8e-95d2-48e0-8272-b56364a01856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:48.190682 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59468f8e-95d2-48e0-8272-b56364a01856 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:48.191039 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59468f8e-95d2-48e0-8272-b56364a01856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:48.191323 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59468f8e-95d2-48e0-8272-b56364a01856 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:48.202047 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59468f8e-95d2-48e0-8272-b56364a01856 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:48.204207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59468f8e-95d2-48e0-8272-b56364a01856 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:48.219981 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-59468f8e-95d2-48e0-8272-b56364a01856 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:48.221597 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 367/749] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:48.227981 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7f723-02b6-4dc1-b13e-3a2e56a427ff admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:48.239061 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7f723-02b6-4dc1-b13e-3a2e56a427ff admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:48.244140 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917c20a-380f-42b7-942f-f11ce83b4f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:48.244804 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917c20a-380f-42b7-942f-f11ce83b4f1e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:48.245137 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917c20a-380f-42b7-942f-f11ce83b4f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:48.245463 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917c20a-380f-42b7-942f-f11ce83b4f1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:48.246303 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917c20a-380f-42b7-942f-f11ce83b4f1e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:48.246614 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917c20a-380f-42b7-942f-f11ce83b4f1e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:48.248686 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917c20a-380f-42b7-942f-f11ce83b4f1e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:48.263855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 383/750] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:48.272298 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59468f8e-95d2-48e0-8272-b56364a01856 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:48.287146 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59468f8e-95d2-48e0-8272-b56364a01856 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:48.293718 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88de44-6ada-432b-971a-8b7d92bbdced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:48.294448 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88de44-6ada-432b-971a-8b7d92bbdced admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:48.294759 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88de44-6ada-432b-971a-8b7d92bbdced admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:48.295071 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88de44-6ada-432b-971a-8b7d92bbdced admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:48.295988 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88de44-6ada-432b-971a-8b7d92bbdced admin admin] RBAC: Adding query filter params (role.id=9209cdab986041f1a45283ada1ae297a, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=fa9ea7738c634318a532ebca2e564745) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:48.296329 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88de44-6ada-432b-971a-8b7d92bbdced admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:48.298594 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88de44-6ada-432b-971a-8b7d92bbdced admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:48.307711 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 368/751] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:48 2022] GET /identity/v3/role_assignments?user.id=fa9ea7738c634318a532ebca2e564745&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=9209cdab986041f1a45283ada1ae297a => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:49.260682 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104d05a-fa26-40e7-b1ea-18e3cf43c06f None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:49.261826 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104d05a-fa26-40e7-b1ea-18e3cf43c06f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:49.262346 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104d05a-fa26-40e7-b1ea-18e3cf43c06f None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:49.264764 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 384/752] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:49.270953 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc21cf-5df6-47f3-87d2-d8a294170ffa None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:49.271451 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc21cf-5df6-47f3-87d2-d8a294170ffa None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:49.271561 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc21cf-5df6-47f3-87d2-d8a294170ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:49.298622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-3ddc21cf-5df6-47f3-87d2-d8a294170ffa None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:49.299846 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-3ddc21cf-5df6-47f3-87d2-d8a294170ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:49.308572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 369/753] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:49 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:50:49.346292 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104d05a-fa26-40e7-b1ea-18e3cf43c06f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:49.361341 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104d05a-fa26-40e7-b1ea-18e3cf43c06f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:49.365831 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c929412-c7ff-40d3-86ff-2ef689fa58de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:49.367197 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c929412-c7ff-40d3-86ff-2ef689fa58de admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:49.367480 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c929412-c7ff-40d3-86ff-2ef689fa58de admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:49.367750 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c929412-c7ff-40d3-86ff-2ef689fa58de admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:49.378895 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c929412-c7ff-40d3-86ff-2ef689fa58de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:49.386113 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-2c929412-c7ff-40d3-86ff-2ef689fa58de admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:50:49.387679 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 385/754] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:50:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:49.393254 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc21cf-5df6-47f3-87d2-d8a294170ffa None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:49.406008 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc21cf-5df6-47f3-87d2-d8a294170ffa None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:49.416240 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b5744-09ab-4c9e-a314-ed3c135f7fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:49.417187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b5744-09ab-4c9e-a314-ed3c135f7fbc admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:49.417719 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b5744-09ab-4c9e-a314-ed3c135f7fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:49.418212 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b5744-09ab-4c9e-a314-ed3c135f7fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:49.419194 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b5744-09ab-4c9e-a314-ed3c135f7fbc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:49.419720 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b5744-09ab-4c9e-a314-ed3c135f7fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:49.421504 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b5744-09ab-4c9e-a314-ed3c135f7fbc admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:49.435878 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 370/755] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:49.441643 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c929412-c7ff-40d3-86ff-2ef689fa58de admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:49.455890 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c929412-c7ff-40d3-86ff-2ef689fa58de admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:49.460834 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2740e29-2259-4038-8b9b-bff8b38312cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:49.461634 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2740e29-2259-4038-8b9b-bff8b38312cd admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:49.461936 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2740e29-2259-4038-8b9b-bff8b38312cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:49.462273 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2740e29-2259-4038-8b9b-bff8b38312cd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:49.473764 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2740e29-2259-4038-8b9b-bff8b38312cd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:49.475806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2740e29-2259-4038-8b9b-bff8b38312cd admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:49.493426 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-f2740e29-2259-4038-8b9b-bff8b38312cd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:49.495025 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 386/756] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:49.500406 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b5744-09ab-4c9e-a314-ed3c135f7fbc admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:49.515576 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b5744-09ab-4c9e-a314-ed3c135f7fbc admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:49.529811 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65057c09-f6ba-4b37-bf17-f634ae79e38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:49.530686 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65057c09-f6ba-4b37-bf17-f634ae79e38a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:49.531117 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65057c09-f6ba-4b37-bf17-f634ae79e38a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:49.531540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65057c09-f6ba-4b37-bf17-f634ae79e38a admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:49.532476 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65057c09-f6ba-4b37-bf17-f634ae79e38a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:49.532925 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65057c09-f6ba-4b37-bf17-f634ae79e38a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:49.534664 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65057c09-f6ba-4b37-bf17-f634ae79e38a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:49.551940 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 371/757] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:49.557627 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2740e29-2259-4038-8b9b-bff8b38312cd admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:49.572717 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2740e29-2259-4038-8b9b-bff8b38312cd admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:49.588212 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee62550-701b-4d9e-887b-4e474f996f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:49.589137 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee62550-701b-4d9e-887b-4e474f996f01 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:49.589519 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee62550-701b-4d9e-887b-4e474f996f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:49.589894 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee62550-701b-4d9e-887b-4e474f996f01 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:49.603087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee62550-701b-4d9e-887b-4e474f996f01 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:49.605252 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee62550-701b-4d9e-887b-4e474f996f01 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:49.624231 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-eee62550-701b-4d9e-887b-4e474f996f01 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 16:50:49.625864 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 387/758] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:50:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:49.631387 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65057c09-f6ba-4b37-bf17-f634ae79e38a admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:49.653088 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65057c09-f6ba-4b37-bf17-f634ae79e38a admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:49.662353 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b0ffc-a5e0-44d5-bcd5-326ee72bc342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:49.663587 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b0ffc-a5e0-44d5-bcd5-326ee72bc342 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:49.663974 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b0ffc-a5e0-44d5-bcd5-326ee72bc342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:49.664408 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b0ffc-a5e0-44d5-bcd5-326ee72bc342 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:49.665258 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b0ffc-a5e0-44d5-bcd5-326ee72bc342 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:49.665567 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b0ffc-a5e0-44d5-bcd5-326ee72bc342 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:49.667408 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b0ffc-a5e0-44d5-bcd5-326ee72bc342 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:49.698782 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 372/759] 10.222.0.42 () {56 vars in 1156 bytes} [Wed Feb 16 16:50:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:49.704134 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee62550-701b-4d9e-887b-4e474f996f01 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:49.720853 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee62550-701b-4d9e-887b-4e474f996f01 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:49.732267 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458cad7-63e2-4d71-ae53-6bd0c820729f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:49.733101 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458cad7-63e2-4d71-ae53-6bd0c820729f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:49.733477 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458cad7-63e2-4d71-ae53-6bd0c820729f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:49.733849 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458cad7-63e2-4d71-ae53-6bd0c820729f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:49.747399 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458cad7-63e2-4d71-ae53-6bd0c820729f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:49.749358 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458cad7-63e2-4d71-ae53-6bd0c820729f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:49.759787 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 388/760] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:49 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:50:49.765418 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b0ffc-a5e0-44d5-bcd5-326ee72bc342 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:49.793230 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b0ffc-a5e0-44d5-bcd5-326ee72bc342 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:49.808266 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956393c-b4c8-4b12-942f-3dccf5228957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:49.809066 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956393c-b4c8-4b12-942f-3dccf5228957 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:49.809344 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956393c-b4c8-4b12-942f-3dccf5228957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:49.809612 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956393c-b4c8-4b12-942f-3dccf5228957 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:49.830445 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956393c-b4c8-4b12-942f-3dccf5228957 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:49.832289 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956393c-b4c8-4b12-942f-3dccf5228957 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:49.861122 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-7956393c-b4c8-4b12-942f-3dccf5228957 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:49.862591 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 373/761] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:49.868519 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458cad7-63e2-4d71-ae53-6bd0c820729f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:49.878246 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458cad7-63e2-4d71-ae53-6bd0c820729f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:49.898271 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761146d-00a2-45df-a7b0-3ed502b83c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:49.899213 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761146d-00a2-45df-a7b0-3ed502b83c31 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:49.899612 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761146d-00a2-45df-a7b0-3ed502b83c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:49.900093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761146d-00a2-45df-a7b0-3ed502b83c31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:49.900949 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761146d-00a2-45df-a7b0-3ed502b83c31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:49.901359 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761146d-00a2-45df-a7b0-3ed502b83c31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:49.903155 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761146d-00a2-45df-a7b0-3ed502b83c31 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:49.921089 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 389/762] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:49.926439 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956393c-b4c8-4b12-942f-3dccf5228957 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:49.943505 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956393c-b4c8-4b12-942f-3dccf5228957 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:49.950685 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7aaaf-fb05-40db-b991-5b7eaf3094e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:49.951471 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7aaaf-fb05-40db-b991-5b7eaf3094e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:49.951747 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7aaaf-fb05-40db-b991-5b7eaf3094e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:49.952017 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7aaaf-fb05-40db-b991-5b7eaf3094e8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:49.967726 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7aaaf-fb05-40db-b991-5b7eaf3094e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:49.969749 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7aaaf-fb05-40db-b991-5b7eaf3094e8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:49.986541 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-82e7aaaf-fb05-40db-b991-5b7eaf3094e8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:49.992676 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 374/763] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:49.994136 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761146d-00a2-45df-a7b0-3ed502b83c31 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:50.007111 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761146d-00a2-45df-a7b0-3ed502b83c31 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:50.019543 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cccf7-4b38-454d-9606-1c4f5ae60a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:50.020402 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cccf7-4b38-454d-9606-1c4f5ae60a61 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:50.020784 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cccf7-4b38-454d-9606-1c4f5ae60a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:50.021182 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cccf7-4b38-454d-9606-1c4f5ae60a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:50.022125 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205cccf7-4b38-454d-9606-1c4f5ae60a61 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:50.023101 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205cccf7-4b38-454d-9606-1c4f5ae60a61 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:50.025377 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205cccf7-4b38-454d-9606-1c4f5ae60a61 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:50.044987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 390/764] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:50.050681 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7aaaf-fb05-40db-b991-5b7eaf3094e8 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:50.067528 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7aaaf-fb05-40db-b991-5b7eaf3094e8 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:50.077938 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098db84-b291-474a-832c-2708635b4996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:50.078584 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098db84-b291-474a-832c-2708635b4996 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:50.078889 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098db84-b291-474a-832c-2708635b4996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:50.079165 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098db84-b291-474a-832c-2708635b4996 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:50.079996 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098db84-b291-474a-832c-2708635b4996 admin admin] RBAC: Adding query filter params (role.id=8263a29ceeed4576b3b6959c99964ed7, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=fc59cb98783b4353a405b8b9a3a9d592) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:50.080302 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098db84-b291-474a-832c-2708635b4996 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:50.082115 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098db84-b291-474a-832c-2708635b4996 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:50.091009 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 375/765] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:50 2022] GET /identity/v3/role_assignments?user.id=fc59cb98783b4353a405b8b9a3a9d592&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:50.743455 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061bf19-2375-4111-8dea-49fd3f29c23d None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:50.744135 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061bf19-2375-4111-8dea-49fd3f29c23d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:50.744135 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061bf19-2375-4111-8dea-49fd3f29c23d None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:50.746073 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 391/766] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:50.751388 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d506d57-02e1-4f8e-83ff-74d7a5af696a None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:50.751883 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d506d57-02e1-4f8e-83ff-74d7a5af696a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:50.760622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d506d57-02e1-4f8e-83ff-74d7a5af696a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:50.811750 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-7d506d57-02e1-4f8e-83ff-74d7a5af696a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:50.812926 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-7d506d57-02e1-4f8e-83ff-74d7a5af696a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:50.822278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 376/767] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:50 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:50:50.853260 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061bf19-2375-4111-8dea-49fd3f29c23d None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:50.867244 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daf712-d054-476b-a7f8-548c6bcfc023 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:50.867534 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daf712-d054-476b-a7f8-548c6bcfc023 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:50.867812 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daf712-d054-476b-a7f8-548c6bcfc023 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:50.871619 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061bf19-2375-4111-8dea-49fd3f29c23d None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:50.872321 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 377/768] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:50.878130 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7739a5-4928-42a8-8016-9e1108edca97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:50.878956 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7739a5-4928-42a8-8016-9e1108edca97 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:50.879239 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7739a5-4928-42a8-8016-9e1108edca97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:50.879518 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7739a5-4928-42a8-8016-9e1108edca97 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:50.879941 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485bf03-ef5b-4aa6-93ed-81d47350aabb None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:50.880176 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7739a5-4928-42a8-8016-9e1108edca97 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:50.880275 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485bf03-ef5b-4aa6-93ed-81d47350aabb None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:50.880485 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485bf03-ef5b-4aa6-93ed-81d47350aabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:50.881937 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7739a5-4928-42a8-8016-9e1108edca97 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:50.902564 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-0b7739a5-4928-42a8-8016-9e1108edca97 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 16 16:50:50.903989 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 392/769] 10.222.0.42 () {56 vars in 1150 bytes} [Wed Feb 16 16:50:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:50.909655 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7739a5-4928-42a8-8016-9e1108edca97 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:50.911505 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-d485bf03-ef5b-4aa6-93ed-81d47350aabb None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:50.912687 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d485bf03-ef5b-4aa6-93ed-81d47350aabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:50.919765 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7739a5-4928-42a8-8016-9e1108edca97 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:50.929519 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 378/770] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:50 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:50:50.936335 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4fc81-2445-4320-a868-3cefa43a2cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:50.936999 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4fc81-2445-4320-a868-3cefa43a2cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:50.937282 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4fc81-2445-4320-a868-3cefa43a2cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:50.937639 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4fc81-2445-4320-a868-3cefa43a2cd3 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:50.938254 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4fc81-2445-4320-a868-3cefa43a2cd3 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:50.938560 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4fc81-2445-4320-a868-3cefa43a2cd3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:50.940177 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4fc81-2445-4320-a868-3cefa43a2cd3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:50.950046 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 393/771] 10.222.0.42 () {56 vars in 1145 bytes} [Wed Feb 16 16:50:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:50.955631 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485bf03-ef5b-4aa6-93ed-81d47350aabb None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:50.968885 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485bf03-ef5b-4aa6-93ed-81d47350aabb None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:50.973773 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f22f4-43b9-4867-a27f-055c0aa86198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:50.974460 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f22f4-43b9-4867-a27f-055c0aa86198 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:50.974804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f22f4-43b9-4867-a27f-055c0aa86198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:50.975081 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f22f4-43b9-4867-a27f-055c0aa86198 admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:50.975886 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f22f4-43b9-4867-a27f-055c0aa86198 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:50.976194 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f22f4-43b9-4867-a27f-055c0aa86198 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:50.978103 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f22f4-43b9-4867-a27f-055c0aa86198 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:50.987663 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 379/772] 10.222.0.42 () {56 vars in 1145 bytes} [Wed Feb 16 16:50:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:50.994173 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4fc81-2445-4320-a868-3cefa43a2cd3 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.005846 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4fc81-2445-4320-a868-3cefa43a2cd3 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.010741 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153d162-d8ce-4f77-b80f-5279af9fc93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.011439 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153d162-d8ce-4f77-b80f-5279af9fc93e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.011722 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153d162-d8ce-4f77-b80f-5279af9fc93e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.012047 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153d162-d8ce-4f77-b80f-5279af9fc93e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.012942 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153d162-d8ce-4f77-b80f-5279af9fc93e admin admin] RBAC: Adding query filter params (interface=public, service_id=286c3445f76b428695545d1080980424, region_id=RegionOne) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:51.013254 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153d162-d8ce-4f77-b80f-5279af9fc93e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.017735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-7153d162-d8ce-4f77-b80f-5279af9fc93e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:50:51.017735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 16:50:51.017735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 16:50:51.018218 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b43bd9-a961-40e5-8c3b-d5dcbf3aa5f8 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.018218 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b43bd9-a961-40e5-8c3b-d5dcbf3aa5f8 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.018450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153d162-d8ce-4f77-b80f-5279af9fc93e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.018544 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b43bd9-a961-40e5-8c3b-d5dcbf3aa5f8 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.018544 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 380/773] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:50:51.030048 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b43bd9-a961-40e5-8c3b-d5dcbf3aa5f8 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.032628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 394/774] 10.222.0.42 () {56 vars in 1272 bytes} [Wed Feb 16 16:50:50 2022] GET /identity/v3/endpoints?service_id=286c3445f76b428695545d1080980424&interface=public®ion_id=RegionOne => generated 194 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:51.034204 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148f637-e0a9-4e63-b144-8ecb5beacddd None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.034492 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148f637-e0a9-4e63-b144-8ecb5beacddd None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.034872 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148f637-e0a9-4e63-b144-8ecb5beacddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.046606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b43bd9-a961-40e5-8c3b-d5dcbf3aa5f8 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.053233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de894f56-49a3-4326-94dd-18b1fb3cbb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.054443 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de894f56-49a3-4326-94dd-18b1fb3cbb6d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.055128 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de894f56-49a3-4326-94dd-18b1fb3cbb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.055516 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de894f56-49a3-4326-94dd-18b1fb3cbb6d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.059437 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-9148f637-e0a9-4e63-b144-8ecb5beacddd None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:51.060781 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-9148f637-e0a9-4e63-b144-8ecb5beacddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:51.068806 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de894f56-49a3-4326-94dd-18b1fb3cbb6d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:51.070008 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 395/775] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:51 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:50:51.071002 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148f637-e0a9-4e63-b144-8ecb5beacddd None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.077486 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-de894f56-49a3-4326-94dd-18b1fb3cbb6d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:50:51.079355 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 381/776] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:51.081003 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148f637-e0a9-4e63-b144-8ecb5beacddd None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.087768 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de894f56-49a3-4326-94dd-18b1fb3cbb6d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.093904 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9600d89-281f-4513-b812-ee224ba50a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.094885 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9600d89-281f-4513-b812-ee224ba50a5c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.095361 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9600d89-281f-4513-b812-ee224ba50a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.095826 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9600d89-281f-4513-b812-ee224ba50a5c admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.096695 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9600d89-281f-4513-b812-ee224ba50a5c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.098749 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9600d89-281f-4513-b812-ee224ba50a5c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.103987 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de894f56-49a3-4326-94dd-18b1fb3cbb6d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.105951 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 396/777] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/services => generated 772 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:51.107309 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9600d89-281f-4513-b812-ee224ba50a5c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.118146 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9600d89-281f-4513-b812-ee224ba50a5c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.123377 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabf3a3-17b7-433e-a05e-f931de00e5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.123937 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f4a4b-52dc-419f-8af6-85ce361cd1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.124056 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabf3a3-17b7-433e-a05e-f931de00e5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.124335 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabf3a3-17b7-433e-a05e-f931de00e5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.124607 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabf3a3-17b7-433e-a05e-f931de00e5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.125369 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabf3a3-17b7-433e-a05e-f931de00e5d5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:51.125677 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabf3a3-17b7-433e-a05e-f931de00e5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.125976 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f4a4b-52dc-419f-8af6-85ce361cd1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.126479 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f4a4b-52dc-419f-8af6-85ce361cd1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.127017 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f4a4b-52dc-419f-8af6-85ce361cd1d9 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.127295 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabf3a3-17b7-433e-a05e-f931de00e5d5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.128149 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f4a4b-52dc-419f-8af6-85ce361cd1d9 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.130288 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f4a4b-52dc-419f-8af6-85ce361cd1d9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.144768 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-131f4a4b-52dc-419f-8af6-85ce361cd1d9 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 16 16:50:51.146535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 397/778] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/services/network => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:51.148846 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 382/779] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:51.154418 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f4a4b-52dc-419f-8af6-85ce361cd1d9 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.156126 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabf3a3-17b7-433e-a05e-f931de00e5d5 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.166777 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f4a4b-52dc-419f-8af6-85ce361cd1d9 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.175058 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b67ac-f26e-427e-a20f-cc87c52680ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.176221 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b67ac-f26e-427e-a20f-cc87c52680ea admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.176772 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b67ac-f26e-427e-a20f-cc87c52680ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.177241 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b67ac-f26e-427e-a20f-cc87c52680ea admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.178217 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b67ac-f26e-427e-a20f-cc87c52680ea admin admin] RBAC: Adding query filter params (name=network) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:51.179174 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b67ac-f26e-427e-a20f-cc87c52680ea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.181162 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b67ac-f26e-427e-a20f-cc87c52680ea admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.184938 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabf3a3-17b7-433e-a05e-f931de00e5d5 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.187330 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 398/780] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:51.192458 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b67ac-f26e-427e-a20f-cc87c52680ea admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.203456 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca866d27-eaa7-4355-a0f7-00ce091bde5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.204276 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca866d27-eaa7-4355-a0f7-00ce091bde5c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.204554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca866d27-eaa7-4355-a0f7-00ce091bde5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.204825 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca866d27-eaa7-4355-a0f7-00ce091bde5c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.205257 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b67ac-f26e-427e-a20f-cc87c52680ea admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.211045 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0b4c9-1e9b-4981-a75f-ec5e88fbf6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.212614 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0b4c9-1e9b-4981-a75f-ec5e88fbf6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.213116 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0b4c9-1e9b-4981-a75f-ec5e88fbf6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.213580 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0b4c9-1e9b-4981-a75f-ec5e88fbf6d3 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.214584 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0b4c9-1e9b-4981-a75f-ec5e88fbf6d3 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:51.215113 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0b4c9-1e9b-4981-a75f-ec5e88fbf6d3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.217962 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0b4c9-1e9b-4981-a75f-ec5e88fbf6d3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.225056 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca866d27-eaa7-4355-a0f7-00ce091bde5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.229661 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 399/781] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:51.230841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca866d27-eaa7-4355-a0f7-00ce091bde5c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.235549 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0b4c9-1e9b-4981-a75f-ec5e88fbf6d3 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.251991 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0b4c9-1e9b-4981-a75f-ec5e88fbf6d3 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.262920 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d7a41-3f1e-46cb-a8f7-6bcab0fc18a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.265187 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d7a41-3f1e-46cb-a8f7-6bcab0fc18a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.266216 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d7a41-3f1e-46cb-a8f7-6bcab0fc18a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.267406 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d7a41-3f1e-46cb-a8f7-6bcab0fc18a8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.268431 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d7a41-3f1e-46cb-a8f7-6bcab0fc18a8 admin admin] RBAC: Adding query filter params (interface=public, service_id=74966a13d51a41b4b682dcf950ae1be0, region_id=RegionOne) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:51.269551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d7a41-3f1e-46cb-a8f7-6bcab0fc18a8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.272905 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d7a41-3f1e-46cb-a8f7-6bcab0fc18a8 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.277543 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-ca866d27-eaa7-4355-a0f7-00ce091bde5c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:51.279825 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 383/782] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:51.283669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 400/783] 10.222.0.42 () {56 vars in 1272 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/endpoints?service_id=74966a13d51a41b4b682dcf950ae1be0&interface=public®ion_id=RegionOne => generated 194 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:51.289850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca866d27-eaa7-4355-a0f7-00ce091bde5c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.300993 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d7a41-3f1e-46cb-a8f7-6bcab0fc18a8 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.307620 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca866d27-eaa7-4355-a0f7-00ce091bde5c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.313611 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d7a41-3f1e-46cb-a8f7-6bcab0fc18a8 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.322367 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee7607-0ab2-45f1-9ea1-a9df4b83c7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.324659 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b985875-d2dc-415a-b8cb-0755303b6527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.324923 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee7607-0ab2-45f1-9ea1-a9df4b83c7ed admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.325427 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee7607-0ab2-45f1-9ea1-a9df4b83c7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.325891 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee7607-0ab2-45f1-9ea1-a9df4b83c7ed admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.326827 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b985875-d2dc-415a-b8cb-0755303b6527 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.327780 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee7607-0ab2-45f1-9ea1-a9df4b83c7ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.328291 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b985875-d2dc-415a-b8cb-0755303b6527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.330282 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b985875-d2dc-415a-b8cb-0755303b6527 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.331279 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b985875-d2dc-415a-b8cb-0755303b6527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:51.331828 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b985875-d2dc-415a-b8cb-0755303b6527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.333552 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee7607-0ab2-45f1-9ea1-a9df4b83c7ed admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.336457 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b985875-d2dc-415a-b8cb-0755303b6527 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.343199 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 384/784] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/services => generated 772 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:51.354218 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 401/785] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:51.359985 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee7607-0ab2-45f1-9ea1-a9df4b83c7ed admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.378896 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee7607-0ab2-45f1-9ea1-a9df4b83c7ed admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.383763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54e331-4ee4-4181-8a1f-a2286c12af57 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.384130 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54e331-4ee4-4181-8a1f-a2286c12af57 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.384460 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54e331-4ee4-4181-8a1f-a2286c12af57 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.386629 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 402/786] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:50:51.392225 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705736c8-3ca4-46ac-adea-f235ccf8da33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.392421 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e79d8-ea5e-4cde-8741-be3e5e00afdd None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.392573 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e79d8-ea5e-4cde-8741-be3e5e00afdd None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.392859 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e79d8-ea5e-4cde-8741-be3e5e00afdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.393026 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705736c8-3ca4-46ac-adea-f235ccf8da33 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.393309 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705736c8-3ca4-46ac-adea-f235ccf8da33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.393580 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705736c8-3ca4-46ac-adea-f235ccf8da33 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.404194 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705736c8-3ca4-46ac-adea-f235ccf8da33 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.406200 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705736c8-3ca4-46ac-adea-f235ccf8da33 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.412768 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-955e79d8-ea5e-4cde-8741-be3e5e00afdd None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:51.414971 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-955e79d8-ea5e-4cde-8741-be3e5e00afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:51.430933 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-705736c8-3ca4-46ac-adea-f235ccf8da33 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 16:50:51.432484 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 385/787] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:51.434257 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 403/788] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:51 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 16:50:51.443808 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705736c8-3ca4-46ac-adea-f235ccf8da33 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.454072 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705736c8-3ca4-46ac-adea-f235ccf8da33 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.462689 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e79d8-ea5e-4cde-8741-be3e5e00afdd None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.473487 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e79d8-ea5e-4cde-8741-be3e5e00afdd None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.474853 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195cc34-8e30-4305-9c6e-95e4466713a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.476428 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195cc34-8e30-4305-9c6e-95e4466713a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.477545 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195cc34-8e30-4305-9c6e-95e4466713a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.477858 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195cc34-8e30-4305-9c6e-95e4466713a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.480176 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195cc34-8e30-4305-9c6e-95e4466713a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:51.481378 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195cc34-8e30-4305-9c6e-95e4466713a9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.484144 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195cc34-8e30-4305-9c6e-95e4466713a9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.486759 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c6880-3929-46c5-8737-93c191072b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.487723 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c6880-3929-46c5-8737-93c191072b8a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.488106 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c6880-3929-46c5-8737-93c191072b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.488481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c6880-3929-46c5-8737-93c191072b8a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.505281 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 386/789] 10.222.0.42 () {56 vars in 1154 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:51.511621 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c6880-3929-46c5-8737-93c191072b8a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:51.512046 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195cc34-8e30-4305-9c6e-95e4466713a9 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.522035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-958c6880-3929-46c5-8737-93c191072b8a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:50:51.522035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 404/790] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:51.531773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c6880-3929-46c5-8737-93c191072b8a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.542691 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195cc34-8e30-4305-9c6e-95e4466713a9 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.548415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c6880-3929-46c5-8737-93c191072b8a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.551981 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c4244-6357-4325-8b6f-056faeb3d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.552651 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c4244-6357-4325-8b6f-056faeb3d6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.552935 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c4244-6357-4325-8b6f-056faeb3d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.553215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c4244-6357-4325-8b6f-056faeb3d6e8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.563924 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c0b9f-8ad2-4929-9be9-739f5626c490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.564665 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c0b9f-8ad2-4929-9be9-739f5626c490 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.564943 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c0b9f-8ad2-4929-9be9-739f5626c490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.565218 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c0b9f-8ad2-4929-9be9-739f5626c490 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.566034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c0b9f-8ad2-4929-9be9-739f5626c490 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:51.566762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c0b9f-8ad2-4929-9be9-739f5626c490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.569574 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c0b9f-8ad2-4929-9be9-739f5626c490 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.572182 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c4244-6357-4325-8b6f-056faeb3d6e8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.576187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c4244-6357-4325-8b6f-056faeb3d6e8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.587449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 405/791] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:51.589298 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 387/792] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:50:51.595182 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c4244-6357-4325-8b6f-056faeb3d6e8 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.595380 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c0b9f-8ad2-4929-9be9-739f5626c490 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.606503 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c4244-6357-4325-8b6f-056faeb3d6e8 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.610423 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c0b9f-8ad2-4929-9be9-739f5626c490 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.612900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d6639-48b8-4c1b-8b06-e9f85d8a5c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.613816 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d6639-48b8-4c1b-8b06-e9f85d8a5c52 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.614109 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d6639-48b8-4c1b-8b06-e9f85d8a5c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.614515 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d6639-48b8-4c1b-8b06-e9f85d8a5c52 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.615790 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8116a47-6f8b-4820-960d-1878fb0aa20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.617219 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8116a47-6f8b-4820-960d-1878fb0aa20f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.617632 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8116a47-6f8b-4820-960d-1878fb0aa20f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.618017 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8116a47-6f8b-4820-960d-1878fb0aa20f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.629573 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d6639-48b8-4c1b-8b06-e9f85d8a5c52 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.630462 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8116a47-6f8b-4820-960d-1878fb0aa20f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.631646 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d6639-48b8-4c1b-8b06-e9f85d8a5c52 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.632890 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8116a47-6f8b-4820-960d-1878fb0aa20f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.652809 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-190d6639-48b8-4c1b-8b06-e9f85d8a5c52 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:51.654386 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 388/793] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:51.656268 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-d8116a47-6f8b-4820-960d-1878fb0aa20f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:51.657492 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 406/794] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:51.660046 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d6639-48b8-4c1b-8b06-e9f85d8a5c52 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.666737 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8116a47-6f8b-4820-960d-1878fb0aa20f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.679697 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d6639-48b8-4c1b-8b06-e9f85d8a5c52 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.682014 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8116a47-6f8b-4820-960d-1878fb0aa20f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.689918 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c58e7e-e1e7-4404-ad44-6e07e3e96792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.691001 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f6b06-4a94-41d4-be5d-4e0fca6eac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.691639 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f6b06-4a94-41d4-be5d-4e0fca6eac51 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.692006 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c58e7e-e1e7-4404-ad44-6e07e3e96792 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.692281 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c58e7e-e1e7-4404-ad44-6e07e3e96792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.692551 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c58e7e-e1e7-4404-ad44-6e07e3e96792 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.693311 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f6b06-4a94-41d4-be5d-4e0fca6eac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.693577 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f6b06-4a94-41d4-be5d-4e0fca6eac51 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.694372 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f6b06-4a94-41d4-be5d-4e0fca6eac51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:51.694840 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c58e7e-e1e7-4404-ad44-6e07e3e96792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:51.695144 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c58e7e-e1e7-4404-ad44-6e07e3e96792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.696514 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f6b06-4a94-41d4-be5d-4e0fca6eac51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.697616 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c58e7e-e1e7-4404-ad44-6e07e3e96792 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.699030 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f6b06-4a94-41d4-be5d-4e0fca6eac51 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.718125 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 389/795] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:51.721435 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 407/796] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:51.727683 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c58e7e-e1e7-4404-ad44-6e07e3e96792 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.728810 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f6b06-4a94-41d4-be5d-4e0fca6eac51 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.738701 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f6b06-4a94-41d4-be5d-4e0fca6eac51 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.743967 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e736143-a340-4fa1-981f-3ce9218aa5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.744862 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e736143-a340-4fa1-981f-3ce9218aa5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.745208 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e736143-a340-4fa1-981f-3ce9218aa5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.745431 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c58e7e-e1e7-4404-ad44-6e07e3e96792 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.745607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e736143-a340-4fa1-981f-3ce9218aa5a3 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.754568 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e736143-a340-4fa1-981f-3ce9218aa5a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.756241 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968dedfd-97f0-4647-a008-f87d22d28a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.757027 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e736143-a340-4fa1-981f-3ce9218aa5a3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.757999 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dedfd-97f0-4647-a008-f87d22d28a92 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.757999 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dedfd-97f0-4647-a008-f87d22d28a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.758220 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dedfd-97f0-4647-a008-f87d22d28a92 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.773275 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-7e736143-a340-4fa1-981f-3ce9218aa5a3 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 16:50:51.774892 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 408/797] 10.222.0.42 () {56 vars in 1138 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:51.775837 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968dedfd-97f0-4647-a008-f87d22d28a92 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.777851 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968dedfd-97f0-4647-a008-f87d22d28a92 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.780446 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e736143-a340-4fa1-981f-3ce9218aa5a3 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.790723 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e736143-a340-4fa1-981f-3ce9218aa5a3 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.796448 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d62f79-7386-4096-b4a8-81f6aa9a3504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.797383 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d62f79-7386-4096-b4a8-81f6aa9a3504 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.797852 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d62f79-7386-4096-b4a8-81f6aa9a3504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.798307 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d62f79-7386-4096-b4a8-81f6aa9a3504 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.799382 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d62f79-7386-4096-b4a8-81f6aa9a3504 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:51.799850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d62f79-7386-4096-b4a8-81f6aa9a3504 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.801980 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d62f79-7386-4096-b4a8-81f6aa9a3504 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.802170 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-968dedfd-97f0-4647-a008-f87d22d28a92 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:51.808579 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 390/798] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:51.811563 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968dedfd-97f0-4647-a008-f87d22d28a92 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.828621 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 409/799] 10.222.0.42 () {56 vars in 1170 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:51.831148 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968dedfd-97f0-4647-a008-f87d22d28a92 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.834543 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d62f79-7386-4096-b4a8-81f6aa9a3504 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.841682 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b1af7-91e6-486d-bacb-b45c3ce0c6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.842572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b1af7-91e6-486d-bacb-b45c3ce0c6ae admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.843325 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b1af7-91e6-486d-bacb-b45c3ce0c6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.844336 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b1af7-91e6-486d-bacb-b45c3ce0c6ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.845359 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b1af7-91e6-486d-bacb-b45c3ce0c6ae admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:51.846854 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b1af7-91e6-486d-bacb-b45c3ce0c6ae admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.849879 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b1af7-91e6-486d-bacb-b45c3ce0c6ae admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.854158 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d62f79-7386-4096-b4a8-81f6aa9a3504 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.859361 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124612e-624f-4e9f-81b8-203687d5c434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.860377 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124612e-624f-4e9f-81b8-203687d5c434 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.860827 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124612e-624f-4e9f-81b8-203687d5c434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.861337 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124612e-624f-4e9f-81b8-203687d5c434 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.874946 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124612e-624f-4e9f-81b8-203687d5c434 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.875202 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 391/800] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:51.877235 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124612e-624f-4e9f-81b8-203687d5c434 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.879950 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b1af7-91e6-486d-bacb-b45c3ce0c6ae admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.897126 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b1af7-91e6-486d-bacb-b45c3ce0c6ae admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.907725 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940679a-f9a7-4c67-8d47-3e78dde7d7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.908649 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940679a-f9a7-4c67-8d47-3e78dde7d7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.909101 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940679a-f9a7-4c67-8d47-3e78dde7d7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.909586 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940679a-f9a7-4c67-8d47-3e78dde7d7b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.911814 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940679a-f9a7-4c67-8d47-3e78dde7d7b4 admin admin] RBAC: Adding query filter params (role.id=8263a29ceeed4576b3b6959c99964ed7, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=9a30603a236e4681a7702eec7029e9db) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:51.912349 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940679a-f9a7-4c67-8d47-3e78dde7d7b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.914546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-4124612e-624f-4e9f-81b8-203687d5c434 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:51.916368 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 410/801] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:51.920097 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940679a-f9a7-4c67-8d47-3e78dde7d7b4 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.921357 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124612e-624f-4e9f-81b8-203687d5c434 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.931560 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124612e-624f-4e9f-81b8-203687d5c434 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.936090 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 392/802] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/role_assignments?user.id=9a30603a236e4681a7702eec7029e9db&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 608 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:51.936875 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cbe8d-a179-4f87-ba3e-120466f29454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.937992 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cbe8d-a179-4f87-ba3e-120466f29454 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.938465 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cbe8d-a179-4f87-ba3e-120466f29454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.939066 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cbe8d-a179-4f87-ba3e-120466f29454 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:51.940029 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cbe8d-a179-4f87-ba3e-120466f29454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:51.940528 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cbe8d-a179-4f87-ba3e-120466f29454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:51.942440 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cbe8d-a179-4f87-ba3e-120466f29454 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:51.956409 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 411/803] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:51.962046 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940679a-f9a7-4c67-8d47-3e78dde7d7b4 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:51.977219 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940679a-f9a7-4c67-8d47-3e78dde7d7b4 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:51.986786 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84812cc2-1219-4a6c-86bd-984bb6205547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:51.987599 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84812cc2-1219-4a6c-86bd-984bb6205547 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:51.987969 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84812cc2-1219-4a6c-86bd-984bb6205547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:51.988274 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84812cc2-1219-4a6c-86bd-984bb6205547 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:52.003069 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84812cc2-1219-4a6c-86bd-984bb6205547 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:52.005061 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84812cc2-1219-4a6c-86bd-984bb6205547 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:52.030621 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-84812cc2-1219-4a6c-86bd-984bb6205547 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:52.031909 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 393/804] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:52.037785 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cbe8d-a179-4f87-ba3e-120466f29454 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:52.051566 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cbe8d-a179-4f87-ba3e-120466f29454 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:52.061979 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc2e76-9620-4ccb-ad8b-1649837d9fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:52.063055 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc2e76-9620-4ccb-ad8b-1649837d9fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:52.063635 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc2e76-9620-4ccb-ad8b-1649837d9fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:52.064118 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc2e76-9620-4ccb-ad8b-1649837d9fb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:52.065141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc2e76-9620-4ccb-ad8b-1649837d9fb0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:52.065649 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc2e76-9620-4ccb-ad8b-1649837d9fb0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:52.067753 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc2e76-9620-4ccb-ad8b-1649837d9fb0 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:52.092314 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 412/805] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:52.098244 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84812cc2-1219-4a6c-86bd-984bb6205547 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:52.112410 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84812cc2-1219-4a6c-86bd-984bb6205547 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:52.117452 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda4e01-1a0e-4192-b5f9-f43f873542b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:52.118402 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda4e01-1a0e-4192-b5f9-f43f873542b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:52.118722 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda4e01-1a0e-4192-b5f9-f43f873542b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:52.119065 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda4e01-1a0e-4192-b5f9-f43f873542b2 admin admin] PATH_INFO: `/v3/projects/6160f9606d06486b9a11a23ee717af79/users/fa9ea7738c634318a532ebca2e564745/roles/9209cdab986041f1a45283ada1ae297a` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:52.136954 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda4e01-1a0e-4192-b5f9-f43f873542b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6160f9606d06486b9a11a23ee717af79, user_id=fa9ea7738c634318a532ebca2e564745, role_id=9209cdab986041f1a45283ada1ae297a)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:52.139708 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda4e01-1a0e-4192-b5f9-f43f873542b2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:52.290935 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 394/806] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:50:52 2022] PUT /identity/v3/projects/6160f9606d06486b9a11a23ee717af79/users/fa9ea7738c634318a532ebca2e564745/roles/9209cdab986041f1a45283ada1ae297a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:50:53.063828 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279a229-8a31-46a6-83b5-500612fa298d None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:53.064346 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279a229-8a31-46a6-83b5-500612fa298d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:53.064346 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279a229-8a31-46a6-83b5-500612fa298d None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:53.066450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 413/807] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:53.071784 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f8f7c-8a62-405e-9e53-e5832155d0e6 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:53.072278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f8f7c-8a62-405e-9e53-e5832155d0e6 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:53.072363 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f8f7c-8a62-405e-9e53-e5832155d0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:53.099670 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-922f8f7c-8a62-405e-9e53-e5832155d0e6 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:53.100969 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-922f8f7c-8a62-405e-9e53-e5832155d0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:53.172888 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 395/808] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:53 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:50:53.213245 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279a229-8a31-46a6-83b5-500612fa298d None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:53.229646 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279a229-8a31-46a6-83b5-500612fa298d None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:53.241659 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff40df5-3b0d-4670-9842-01f96f962d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:53.242462 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff40df5-3b0d-4670-9842-01f96f962d1a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:53.242765 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff40df5-3b0d-4670-9842-01f96f962d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:53.243041 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff40df5-3b0d-4670-9842-01f96f962d1a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:53.256871 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff40df5-3b0d-4670-9842-01f96f962d1a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:53.263722 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-6ff40df5-3b0d-4670-9842-01f96f962d1a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:50:53.265308 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 414/809] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:50:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:53.271061 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f8f7c-8a62-405e-9e53-e5832155d0e6 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:53.283665 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f8f7c-8a62-405e-9e53-e5832155d0e6 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:53.288448 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c23a78-5b5c-4dc0-885a-c9dbdf8b9145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:53.289106 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c23a78-5b5c-4dc0-885a-c9dbdf8b9145 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:53.289377 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c23a78-5b5c-4dc0-885a-c9dbdf8b9145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:53.289649 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c23a78-5b5c-4dc0-885a-c9dbdf8b9145 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:53.290406 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c23a78-5b5c-4dc0-885a-c9dbdf8b9145 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:53.290739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c23a78-5b5c-4dc0-885a-c9dbdf8b9145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:53.292324 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c23a78-5b5c-4dc0-885a-c9dbdf8b9145 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:53.302763 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 396/810] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:53.308898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff40df5-3b0d-4670-9842-01f96f962d1a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:53.324008 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff40df5-3b0d-4670-9842-01f96f962d1a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:53.335641 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f68e71-266d-4303-9476-1a98f85b5068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:53.336443 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f68e71-266d-4303-9476-1a98f85b5068 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:53.336723 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f68e71-266d-4303-9476-1a98f85b5068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:53.336995 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f68e71-266d-4303-9476-1a98f85b5068 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:53.359002 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f68e71-266d-4303-9476-1a98f85b5068 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:53.360853 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f68e71-266d-4303-9476-1a98f85b5068 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:53.386788 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-c8f68e71-266d-4303-9476-1a98f85b5068 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:53.388545 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 415/811] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:53.393710 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c23a78-5b5c-4dc0-885a-c9dbdf8b9145 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:53.407850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c23a78-5b5c-4dc0-885a-c9dbdf8b9145 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:53.421758 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087f1b9-2e78-4887-81c5-37c6a76e0d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:53.422500 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087f1b9-2e78-4887-81c5-37c6a76e0d03 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:53.422873 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087f1b9-2e78-4887-81c5-37c6a76e0d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:53.423157 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087f1b9-2e78-4887-81c5-37c6a76e0d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:53.423900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087f1b9-2e78-4887-81c5-37c6a76e0d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:53.424212 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087f1b9-2e78-4887-81c5-37c6a76e0d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:53.425882 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087f1b9-2e78-4887-81c5-37c6a76e0d03 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:53.444831 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 397/812] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:53.450255 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f68e71-266d-4303-9476-1a98f85b5068 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:53.464459 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f68e71-266d-4303-9476-1a98f85b5068 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:53.475302 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b330aec-3b0b-4555-92b9-cac5ccb5bde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:53.476673 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b330aec-3b0b-4555-92b9-cac5ccb5bde4 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:53.476956 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b330aec-3b0b-4555-92b9-cac5ccb5bde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:53.477265 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b330aec-3b0b-4555-92b9-cac5ccb5bde4 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:53.496093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b330aec-3b0b-4555-92b9-cac5ccb5bde4 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:53.498164 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b330aec-3b0b-4555-92b9-cac5ccb5bde4 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:53.528541 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-6b330aec-3b0b-4555-92b9-cac5ccb5bde4 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 16:50:53.529505 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 416/813] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:50:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:53.534804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087f1b9-2e78-4887-81c5-37c6a76e0d03 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:53.552983 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087f1b9-2e78-4887-81c5-37c6a76e0d03 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:53.559525 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9381f9-e2a9-4a19-aca4-1f9261f09d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:53.560201 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9381f9-e2a9-4a19-aca4-1f9261f09d3d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:53.560540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9381f9-e2a9-4a19-aca4-1f9261f09d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:53.560817 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9381f9-e2a9-4a19-aca4-1f9261f09d3d admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:53.561698 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9381f9-e2a9-4a19-aca4-1f9261f09d3d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:53.562069 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9381f9-e2a9-4a19-aca4-1f9261f09d3d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:53.563990 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9381f9-e2a9-4a19-aca4-1f9261f09d3d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:53.591144 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 398/814] 10.222.0.42 () {56 vars in 1156 bytes} [Wed Feb 16 16:50:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:53.602064 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b330aec-3b0b-4555-92b9-cac5ccb5bde4 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:53.612558 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b330aec-3b0b-4555-92b9-cac5ccb5bde4 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:53.619736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44007ff5-2ef3-44ac-a2a6-c379f453e847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:53.620543 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44007ff5-2ef3-44ac-a2a6-c379f453e847 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:53.620820 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44007ff5-2ef3-44ac-a2a6-c379f453e847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:53.621095 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44007ff5-2ef3-44ac-a2a6-c379f453e847 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:53.633994 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44007ff5-2ef3-44ac-a2a6-c379f453e847 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:53.637193 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44007ff5-2ef3-44ac-a2a6-c379f453e847 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:53.658380 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-44007ff5-2ef3-44ac-a2a6-c379f453e847 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:53.660045 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 417/815] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:53.665755 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9381f9-e2a9-4a19-aca4-1f9261f09d3d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:53.683871 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9381f9-e2a9-4a19-aca4-1f9261f09d3d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:53.699824 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89f9f7-5583-410f-a75e-16a72a0d4f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:53.700112 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89f9f7-5583-410f-a75e-16a72a0d4f36 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:53.700391 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89f9f7-5583-410f-a75e-16a72a0d4f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:53.705512 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89f9f7-5583-410f-a75e-16a72a0d4f36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:53.705512 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89f9f7-5583-410f-a75e-16a72a0d4f36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:53.705512 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89f9f7-5583-410f-a75e-16a72a0d4f36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:53.705512 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89f9f7-5583-410f-a75e-16a72a0d4f36 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:53.720274 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 399/816] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:53.725901 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44007ff5-2ef3-44ac-a2a6-c379f453e847 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:53.740326 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44007ff5-2ef3-44ac-a2a6-c379f453e847 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:53.748295 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d355c-054c-4bca-9310-35971984a19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:53.749902 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d355c-054c-4bca-9310-35971984a19f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:53.750248 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d355c-054c-4bca-9310-35971984a19f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:53.750829 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d355c-054c-4bca-9310-35971984a19f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:53.767163 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d355c-054c-4bca-9310-35971984a19f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:53.769512 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d355c-054c-4bca-9310-35971984a19f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:53.788240 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-e83d355c-054c-4bca-9310-35971984a19f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:53.789569 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 418/817] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:53.795465 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89f9f7-5583-410f-a75e-16a72a0d4f36 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:53.811774 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89f9f7-5583-410f-a75e-16a72a0d4f36 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:53.825911 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c763f2f-56e6-433f-9749-fa4b9c343e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:53.826584 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c763f2f-56e6-433f-9749-fa4b9c343e0a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:53.826896 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c763f2f-56e6-433f-9749-fa4b9c343e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:53.827177 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c763f2f-56e6-433f-9749-fa4b9c343e0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:53.827969 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c763f2f-56e6-433f-9749-fa4b9c343e0a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:53.828289 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c763f2f-56e6-433f-9749-fa4b9c343e0a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:53.830167 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c763f2f-56e6-433f-9749-fa4b9c343e0a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:53.856572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 400/818] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:53.862537 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d355c-054c-4bca-9310-35971984a19f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:53.879074 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d355c-054c-4bca-9310-35971984a19f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:53.885248 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66249e-dbc9-4146-a1c6-087062d784e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:53.886230 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66249e-dbc9-4146-a1c6-087062d784e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:53.886561 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66249e-dbc9-4146-a1c6-087062d784e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:53.886869 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66249e-dbc9-4146-a1c6-087062d784e2 admin admin] PATH_INFO: `/v3/projects/6160f9606d06486b9a11a23ee717af79/users/fc59cb98783b4353a405b8b9a3a9d592/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:53.889643 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66249e-dbc9-4146-a1c6-087062d784e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6160f9606d06486b9a11a23ee717af79, user_id=fc59cb98783b4353a405b8b9a3a9d592, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:53.892400 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66249e-dbc9-4146-a1c6-087062d784e2 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:53.970973 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 419/819] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:50:53 2022] PUT /identity/v3/projects/6160f9606d06486b9a11a23ee717af79/users/fc59cb98783b4353a405b8b9a3a9d592/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:50:54.008219 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d09962-faa5-4480-a287-7efaf73a3e15 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:54.008550 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d09962-faa5-4480-a287-7efaf73a3e15 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:54.008810 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d09962-faa5-4480-a287-7efaf73a3e15 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:54.011103 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 401/820] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:54.021050 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8c49f-351a-445b-b381-64a7f8f995b0 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:54.021401 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8c49f-351a-445b-b381-64a7f8f995b0 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:54.021613 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8c49f-351a-445b-b381-64a7f8f995b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:54.048381 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-9ee8c49f-351a-445b-b381-64a7f8f995b0 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:54.049678 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-9ee8c49f-351a-445b-b381-64a7f8f995b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:54.137538 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 420/821] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:54 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 16:50:54.176812 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d09962-faa5-4480-a287-7efaf73a3e15 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:54.192419 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d09962-faa5-4480-a287-7efaf73a3e15 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:54.199152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e19d57-6508-4afa-b650-acdbaa8226d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:54.199976 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e19d57-6508-4afa-b650-acdbaa8226d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:54.200311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e19d57-6508-4afa-b650-acdbaa8226d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:54.200643 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e19d57-6508-4afa-b650-acdbaa8226d0 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:54.201300 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e19d57-6508-4afa-b650-acdbaa8226d0 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:54.202393 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING py.warnings [None req-68e19d57-6508-4afa-b650-acdbaa8226d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:50:54.202393 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: warnings.warn(msg) Feb 16 16:50:54.202393 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: Feb 16 16:50:54.203606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e19d57-6508-4afa-b650-acdbaa8226d0 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:54.218515 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-68e19d57-6508-4afa-b650-acdbaa8226d0 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 16 16:50:54.220162 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 402/822] 10.222.0.42 () {56 vars in 1150 bytes} [Wed Feb 16 16:50:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:54.225913 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8c49f-351a-445b-b381-64a7f8f995b0 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:54.235588 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8c49f-351a-445b-b381-64a7f8f995b0 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:54.246381 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ccdf1-4ded-4c71-8b23-2fd6a3e8fe7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:54.247095 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ccdf1-4ded-4c71-8b23-2fd6a3e8fe7c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:54.247524 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ccdf1-4ded-4c71-8b23-2fd6a3e8fe7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:54.247802 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ccdf1-4ded-4c71-8b23-2fd6a3e8fe7c admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:54.248570 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ccdf1-4ded-4c71-8b23-2fd6a3e8fe7c admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:54.248882 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ccdf1-4ded-4c71-8b23-2fd6a3e8fe7c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:54.250550 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ccdf1-4ded-4c71-8b23-2fd6a3e8fe7c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:54.256149 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 421/823] 10.222.0.42 () {56 vars in 1145 bytes} [Wed Feb 16 16:50:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:54.262094 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e19d57-6508-4afa-b650-acdbaa8226d0 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:54.273037 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e19d57-6508-4afa-b650-acdbaa8226d0 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:54.279003 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a809a-bf0b-4220-a2ff-1b59199d873a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:54.279723 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a809a-bf0b-4220-a2ff-1b59199d873a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:54.280004 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a809a-bf0b-4220-a2ff-1b59199d873a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:54.280283 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a809a-bf0b-4220-a2ff-1b59199d873a admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:54.281041 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a809a-bf0b-4220-a2ff-1b59199d873a admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:54.281351 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a809a-bf0b-4220-a2ff-1b59199d873a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:54.284661 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a809a-bf0b-4220-a2ff-1b59199d873a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:54.290622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 403/824] 10.222.0.42 () {56 vars in 1145 bytes} [Wed Feb 16 16:50:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:54.295995 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ccdf1-4ded-4c71-8b23-2fd6a3e8fe7c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:54.311861 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ccdf1-4ded-4c71-8b23-2fd6a3e8fe7c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:54.313860 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d1099-3f4c-4a1c-b31a-b1a69a7e0bd0 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:54.314150 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d1099-3f4c-4a1c-b31a-b1a69a7e0bd0 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:54.314436 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d1099-3f4c-4a1c-b31a-b1a69a7e0bd0 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:54.316483 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 404/825] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:50:54.320002 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ebcea-0b1c-4d69-96f0-71f634da1057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:54.320887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ebcea-0b1c-4d69-96f0-71f634da1057 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:54.321425 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ebcea-0b1c-4d69-96f0-71f634da1057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:54.321891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ebcea-0b1c-4d69-96f0-71f634da1057 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:54.322925 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ebcea-0b1c-4d69-96f0-71f634da1057 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:54.324184 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-033ebcea-0b1c-4d69-96f0-71f634da1057 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:50:54.324184 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 16:50:54.324184 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 16:50:54.325467 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ebcea-0b1c-4d69-96f0-71f634da1057 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:54.333253 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1575d-d6f7-43c2-b730-6b4fe2e68bf9 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:54.333542 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1575d-d6f7-43c2-b730-6b4fe2e68bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:54.333842 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1575d-d6f7-43c2-b730-6b4fe2e68bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:54.359219 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-6de1575d-d6f7-43c2-b730-6b4fe2e68bf9 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:54.360503 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6de1575d-d6f7-43c2-b730-6b4fe2e68bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:54.368702 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 405/826] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:54 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 16:50:54.392041 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1575d-d6f7-43c2-b730-6b4fe2e68bf9 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:54.402100 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1575d-d6f7-43c2-b730-6b4fe2e68bf9 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:54.407068 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e913a3-bc62-4799-92ad-66b5f59fcfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:54.407919 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e913a3-bc62-4799-92ad-66b5f59fcfee admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:54.408265 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e913a3-bc62-4799-92ad-66b5f59fcfee admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:54.408599 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e913a3-bc62-4799-92ad-66b5f59fcfee admin admin] PATH_INFO: `/v3/services/network` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:54.409325 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e913a3-bc62-4799-92ad-66b5f59fcfee admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:54.411040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e913a3-bc62-4799-92ad-66b5f59fcfee admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:54.423116 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-b1e913a3-bc62-4799-92ad-66b5f59fcfee admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 16 16:50:54.424604 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 406/827] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:54 2022] GET /identity/v3/services/network => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:54.431803 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e913a3-bc62-4799-92ad-66b5f59fcfee admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:54.442186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e913a3-bc62-4799-92ad-66b5f59fcfee admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:54.447385 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94095474-b636-4f03-8e2a-668401bcca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:54.448302 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94095474-b636-4f03-8e2a-668401bcca47 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:54.448810 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94095474-b636-4f03-8e2a-668401bcca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:54.449224 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94095474-b636-4f03-8e2a-668401bcca47 admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:54.450166 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94095474-b636-4f03-8e2a-668401bcca47 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:54.450609 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94095474-b636-4f03-8e2a-668401bcca47 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:54.452464 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94095474-b636-4f03-8e2a-668401bcca47 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:54.463522 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 422/828] 10.222.0.42 () {60 vars in 1165 bytes} [Wed Feb 16 16:50:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 16:50:54.470839 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 407/829] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Feb 16 16:50:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:54.473038 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ebcea-0b1c-4d69-96f0-71f634da1057 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:54.499764 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ebcea-0b1c-4d69-96f0-71f634da1057 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:54.505703 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c630fb7-af10-4bb6-b294-664552e30452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:54.506572 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c630fb7-af10-4bb6-b294-664552e30452 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:54.507131 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c630fb7-af10-4bb6-b294-664552e30452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:54.507544 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c630fb7-af10-4bb6-b294-664552e30452 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:54.508460 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c630fb7-af10-4bb6-b294-664552e30452 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:54.508919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c630fb7-af10-4bb6-b294-664552e30452 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:54.510742 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c630fb7-af10-4bb6-b294-664552e30452 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:54.518289 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 423/830] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Feb 16 16:50:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:54.524759 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94095474-b636-4f03-8e2a-668401bcca47 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:54.536286 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94095474-b636-4f03-8e2a-668401bcca47 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:54.543132 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce6319-6f4d-4e4a-8f6f-efc9d7cdfc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:54.544059 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce6319-6f4d-4e4a-8f6f-efc9d7cdfc9c admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:54.544481 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce6319-6f4d-4e4a-8f6f-efc9d7cdfc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:54.544942 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce6319-6f4d-4e4a-8f6f-efc9d7cdfc9c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:54.545863 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce6319-6f4d-4e4a-8f6f-efc9d7cdfc9c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:54.547076 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING py.warnings [None req-57ce6319-6f4d-4e4a-8f6f-efc9d7cdfc9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:50:54.547076 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: warnings.warn(msg) Feb 16 16:50:54.547076 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: Feb 16 16:50:54.548314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce6319-6f4d-4e4a-8f6f-efc9d7cdfc9c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:54.634924 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 408/831] 10.222.0.42 () {60 vars in 1165 bytes} [Wed Feb 16 16:50:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 16:50:55.035524 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94865675-ec05-4906-9744-44f0bf4aece2 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:55.036206 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94865675-ec05-4906-9744-44f0bf4aece2 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:55.036687 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94865675-ec05-4906-9744-44f0bf4aece2 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:55.039585 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 424/832] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:55.044687 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671aa75c-1b71-4a3a-b7b3-b94dc4a945ce None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:55.044964 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671aa75c-1b71-4a3a-b7b3-b94dc4a945ce None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:55.045244 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671aa75c-1b71-4a3a-b7b3-b94dc4a945ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:55.065760 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-671aa75c-1b71-4a3a-b7b3-b94dc4a945ce None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:55.066980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-671aa75c-1b71-4a3a-b7b3-b94dc4a945ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:55.094256 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 409/833] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:55 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:50:55.118679 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94865675-ec05-4906-9744-44f0bf4aece2 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:55.131057 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94865675-ec05-4906-9744-44f0bf4aece2 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:55.135946 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937e9c4-9320-4754-bdd0-f29a6466897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:55.136742 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937e9c4-9320-4754-bdd0-f29a6466897b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:55.137022 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937e9c4-9320-4754-bdd0-f29a6466897b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:55.137296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937e9c4-9320-4754-bdd0-f29a6466897b admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:55.137948 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937e9c4-9320-4754-bdd0-f29a6466897b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:55.139551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937e9c4-9320-4754-bdd0-f29a6466897b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:55.151594 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-1937e9c4-9320-4754-bdd0-f29a6466897b admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 16 16:50:55.153090 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 425/834] 10.222.0.42 () {56 vars in 1153 bytes} [Wed Feb 16 16:50:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:55.158861 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671aa75c-1b71-4a3a-b7b3-b94dc4a945ce None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:55.167911 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671aa75c-1b71-4a3a-b7b3-b94dc4a945ce None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:55.172452 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f2852-1999-4d6a-b9f0-d9702bf6b640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:55.173113 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f2852-1999-4d6a-b9f0-d9702bf6b640 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:55.173392 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f2852-1999-4d6a-b9f0-d9702bf6b640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:55.173668 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f2852-1999-4d6a-b9f0-d9702bf6b640 admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:55.174377 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f2852-1999-4d6a-b9f0-d9702bf6b640 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:55.174710 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f2852-1999-4d6a-b9f0-d9702bf6b640 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:55.176298 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f2852-1999-4d6a-b9f0-d9702bf6b640 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:55.181383 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 410/835] 10.222.0.42 () {56 vars in 1147 bytes} [Wed Feb 16 16:50:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:55.186860 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937e9c4-9320-4754-bdd0-f29a6466897b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:55.197121 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937e9c4-9320-4754-bdd0-f29a6466897b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:55.201652 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53afddd-5ca6-4d52-9177-9e591d8dbe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:55.202343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53afddd-5ca6-4d52-9177-9e591d8dbe38 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:55.202626 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53afddd-5ca6-4d52-9177-9e591d8dbe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:55.202916 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53afddd-5ca6-4d52-9177-9e591d8dbe38 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:55.203700 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53afddd-5ca6-4d52-9177-9e591d8dbe38 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:55.204055 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53afddd-5ca6-4d52-9177-9e591d8dbe38 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:55.205681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53afddd-5ca6-4d52-9177-9e591d8dbe38 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:55.211046 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 426/836] 10.222.0.42 () {56 vars in 1147 bytes} [Wed Feb 16 16:50:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:55.376323 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc9aa4-2c25-4b65-8166-efd3bae1d9d0 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:55.376657 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc9aa4-2c25-4b65-8166-efd3bae1d9d0 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:55.376833 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc9aa4-2c25-4b65-8166-efd3bae1d9d0 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:55.378702 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 411/837] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:55.384318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da859dca-1d95-4288-a6a1-8d7d6ee641d5 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:55.384923 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da859dca-1d95-4288-a6a1-8d7d6ee641d5 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:55.385400 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da859dca-1d95-4288-a6a1-8d7d6ee641d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:55.406843 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-da859dca-1d95-4288-a6a1-8d7d6ee641d5 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:55.408357 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-da859dca-1d95-4288-a6a1-8d7d6ee641d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:55.418820 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 427/838] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:55 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:50:55.443274 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc9aa4-2c25-4b65-8166-efd3bae1d9d0 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:55.455668 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc9aa4-2c25-4b65-8166-efd3bae1d9d0 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:55.461151 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5ab55-2a6e-4f63-9a13-2235aa3c5086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:55.461988 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5ab55-2a6e-4f63-9a13-2235aa3c5086 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:55.462267 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5ab55-2a6e-4f63-9a13-2235aa3c5086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:55.462539 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5ab55-2a6e-4f63-9a13-2235aa3c5086 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:55.473639 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5ab55-2a6e-4f63-9a13-2235aa3c5086 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:55.480795 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-95e5ab55-2a6e-4f63-9a13-2235aa3c5086 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:50:55.482225 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 412/839] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:50:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:55.488201 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da859dca-1d95-4288-a6a1-8d7d6ee641d5 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:55.497862 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da859dca-1d95-4288-a6a1-8d7d6ee641d5 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:55.502536 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e63cb6-76b6-4205-84e4-27e8a8b132ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:55.503216 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e63cb6-76b6-4205-84e4-27e8a8b132ed admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:55.503492 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e63cb6-76b6-4205-84e4-27e8a8b132ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:55.503762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e63cb6-76b6-4205-84e4-27e8a8b132ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:55.504500 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e63cb6-76b6-4205-84e4-27e8a8b132ed admin admin] RBAC: Adding query filter params (name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:55.504852 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e63cb6-76b6-4205-84e4-27e8a8b132ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:55.506430 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e63cb6-76b6-4205-84e4-27e8a8b132ed admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:55.520586 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 428/840] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:50:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:55.521904 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5ab55-2a6e-4f63-9a13-2235aa3c5086 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:55.533288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5ab55-2a6e-4f63-9a13-2235aa3c5086 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:55.538220 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39030d4e-d3a3-46a9-962a-5860666dda08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:55.539066 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39030d4e-d3a3-46a9-962a-5860666dda08 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:55.539344 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39030d4e-d3a3-46a9-962a-5860666dda08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:55.539663 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39030d4e-d3a3-46a9-962a-5860666dda08 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:55.550388 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39030d4e-d3a3-46a9-962a-5860666dda08 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:55.552294 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39030d4e-d3a3-46a9-962a-5860666dda08 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:55.570018 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-39030d4e-d3a3-46a9-962a-5860666dda08 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:55.571654 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 413/841] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:55.579673 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e63cb6-76b6-4205-84e4-27e8a8b132ed admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:55.592030 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e63cb6-76b6-4205-84e4-27e8a8b132ed admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:55.596541 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4813e2-5352-4a2d-a42f-8e8fb4ac778f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:55.597241 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4813e2-5352-4a2d-a42f-8e8fb4ac778f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:55.597513 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4813e2-5352-4a2d-a42f-8e8fb4ac778f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:55.597828 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4813e2-5352-4a2d-a42f-8e8fb4ac778f admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:55.598549 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4813e2-5352-4a2d-a42f-8e8fb4ac778f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:55.598928 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4813e2-5352-4a2d-a42f-8e8fb4ac778f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:55.600777 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4813e2-5352-4a2d-a42f-8e8fb4ac778f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:55.613661 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 429/842] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:55.622591 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39030d4e-d3a3-46a9-962a-5860666dda08 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:55.633357 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39030d4e-d3a3-46a9-962a-5860666dda08 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:55.637989 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fa1d6-c154-44ad-a57c-08c77cdf1957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:55.638850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fa1d6-c154-44ad-a57c-08c77cdf1957 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:55.639132 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fa1d6-c154-44ad-a57c-08c77cdf1957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:55.639407 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fa1d6-c154-44ad-a57c-08c77cdf1957 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:55.647039 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fa1d6-c154-44ad-a57c-08c77cdf1957 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:55.649952 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fa1d6-c154-44ad-a57c-08c77cdf1957 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:55.666303 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-691fa1d6-c154-44ad-a57c-08c77cdf1957 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 16:50:55.667855 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 414/843] 10.222.0.42 () {56 vars in 1138 bytes} [Wed Feb 16 16:50:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:55.673341 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4813e2-5352-4a2d-a42f-8e8fb4ac778f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:55.684355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4813e2-5352-4a2d-a42f-8e8fb4ac778f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:55.689141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e767a-0c3e-4bae-a417-5ad18f8a12df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:55.690036 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e767a-0c3e-4bae-a417-5ad18f8a12df admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:55.690505 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e767a-0c3e-4bae-a417-5ad18f8a12df admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:55.690990 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e767a-0c3e-4bae-a417-5ad18f8a12df admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:55.691987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e767a-0c3e-4bae-a417-5ad18f8a12df admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:55.692491 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e767a-0c3e-4bae-a417-5ad18f8a12df admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:55.695060 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e767a-0c3e-4bae-a417-5ad18f8a12df admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:55.715449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 430/844] 10.222.0.42 () {56 vars in 1170 bytes} [Wed Feb 16 16:50:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:55.720808 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fa1d6-c154-44ad-a57c-08c77cdf1957 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:55.731641 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fa1d6-c154-44ad-a57c-08c77cdf1957 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:55.736643 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc44627-965c-4832-a8a7-da6f4025910f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:55.737383 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc44627-965c-4832-a8a7-da6f4025910f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:55.737767 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc44627-965c-4832-a8a7-da6f4025910f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:55.738143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc44627-965c-4832-a8a7-da6f4025910f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:55.747262 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc44627-965c-4832-a8a7-da6f4025910f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:55.749111 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc44627-965c-4832-a8a7-da6f4025910f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:55.763059 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 415/845] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:55 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:50:55.764804 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e767a-0c3e-4bae-a417-5ad18f8a12df admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:55.775142 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e767a-0c3e-4bae-a417-5ad18f8a12df admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:55.779773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552499c3-995e-4aef-baa3-b0a8f0a2f522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:55.780594 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552499c3-995e-4aef-baa3-b0a8f0a2f522 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:55.780887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552499c3-995e-4aef-baa3-b0a8f0a2f522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:55.781161 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552499c3-995e-4aef-baa3-b0a8f0a2f522 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:55.792867 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552499c3-995e-4aef-baa3-b0a8f0a2f522 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:55.794818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552499c3-995e-4aef-baa3-b0a8f0a2f522 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:55.812599 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-552499c3-995e-4aef-baa3-b0a8f0a2f522 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:55.814107 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 431/846] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:55.819805 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc44627-965c-4832-a8a7-da6f4025910f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:55.829168 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc44627-965c-4832-a8a7-da6f4025910f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:55.835879 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bc9fa-b00f-4f0c-8d0e-006215aa01f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:55.836595 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bc9fa-b00f-4f0c-8d0e-006215aa01f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:55.836880 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bc9fa-b00f-4f0c-8d0e-006215aa01f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:55.837269 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bc9fa-b00f-4f0c-8d0e-006215aa01f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:55.838174 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bc9fa-b00f-4f0c-8d0e-006215aa01f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:55.838722 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bc9fa-b00f-4f0c-8d0e-006215aa01f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:55.840306 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bc9fa-b00f-4f0c-8d0e-006215aa01f1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:55.853326 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 416/847] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:55.859011 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552499c3-995e-4aef-baa3-b0a8f0a2f522 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:55.870114 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552499c3-995e-4aef-baa3-b0a8f0a2f522 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:55.874928 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239b427-d817-4aad-a8a0-0fdb2c0887d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:55.875701 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239b427-d817-4aad-a8a0-0fdb2c0887d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:55.875982 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239b427-d817-4aad-a8a0-0fdb2c0887d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:55.876254 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239b427-d817-4aad-a8a0-0fdb2c0887d9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:55.883921 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239b427-d817-4aad-a8a0-0fdb2c0887d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:55.885914 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239b427-d817-4aad-a8a0-0fdb2c0887d9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:55.899518 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-e239b427-d817-4aad-a8a0-0fdb2c0887d9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:55.901027 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 432/848] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:55.906659 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bc9fa-b00f-4f0c-8d0e-006215aa01f1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:55.917670 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bc9fa-b00f-4f0c-8d0e-006215aa01f1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:55.922750 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b92d6-9daf-4176-8d33-84091756983b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:55.923438 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b92d6-9daf-4176-8d33-84091756983b admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:55.923804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b92d6-9daf-4176-8d33-84091756983b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:55.924094 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b92d6-9daf-4176-8d33-84091756983b admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:55.924901 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b92d6-9daf-4176-8d33-84091756983b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:55.925268 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b92d6-9daf-4176-8d33-84091756983b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:55.927398 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b92d6-9daf-4176-8d33-84091756983b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:55.941698 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 417/849] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:55.948096 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239b427-d817-4aad-a8a0-0fdb2c0887d9 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:55.959024 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239b427-d817-4aad-a8a0-0fdb2c0887d9 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:55.964547 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51c346-0cc3-46a4-8c97-b1cd58bc81f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:55.965195 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51c346-0cc3-46a4-8c97-b1cd58bc81f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:55.965531 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51c346-0cc3-46a4-8c97-b1cd58bc81f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:55.965810 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51c346-0cc3-46a4-8c97-b1cd58bc81f3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:55.966718 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51c346-0cc3-46a4-8c97-b1cd58bc81f3 admin admin] RBAC: Adding query filter params (role.id=9209cdab986041f1a45283ada1ae297a, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=fa9ea7738c634318a532ebca2e564745) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:55.967033 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51c346-0cc3-46a4-8c97-b1cd58bc81f3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:55.968924 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51c346-0cc3-46a4-8c97-b1cd58bc81f3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:55.976432 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 433/850] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:55 2022] GET /identity/v3/role_assignments?user.id=fa9ea7738c634318a532ebca2e564745&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=9209cdab986041f1a45283ada1ae297a => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:56.518859 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c700e9e-4b2d-4f2c-94d9-b5015dee903b None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:56.519548 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c700e9e-4b2d-4f2c-94d9-b5015dee903b None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:56.519548 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c700e9e-4b2d-4f2c-94d9-b5015dee903b None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:56.521393 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 418/851] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:56.527493 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73415499-12d0-4907-b688-0b4fa961748d None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:56.528033 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73415499-12d0-4907-b688-0b4fa961748d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:56.528033 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73415499-12d0-4907-b688-0b4fa961748d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:56.545762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-73415499-12d0-4907-b688-0b4fa961748d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:56.547073 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-73415499-12d0-4907-b688-0b4fa961748d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:56.555059 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 434/852] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:56 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:50:56.578801 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c700e9e-4b2d-4f2c-94d9-b5015dee903b None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:56.591767 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c700e9e-4b2d-4f2c-94d9-b5015dee903b None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:56.596077 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c716b65-bd1e-4811-b0af-488ee4f0971c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:56.596839 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c716b65-bd1e-4811-b0af-488ee4f0971c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:56.597114 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c716b65-bd1e-4811-b0af-488ee4f0971c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:56.597384 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c716b65-bd1e-4811-b0af-488ee4f0971c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:56.608100 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c716b65-bd1e-4811-b0af-488ee4f0971c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:56.614926 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-1c716b65-bd1e-4811-b0af-488ee4f0971c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:50:56.616570 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 419/853] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:50:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:56.622261 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73415499-12d0-4907-b688-0b4fa961748d None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:56.631205 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73415499-12d0-4907-b688-0b4fa961748d None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:56.636237 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4837d-050c-401a-a134-587c01762555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:56.636884 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4837d-050c-401a-a134-587c01762555 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:56.637160 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4837d-050c-401a-a134-587c01762555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:56.637431 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4837d-050c-401a-a134-587c01762555 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:56.638169 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4837d-050c-401a-a134-587c01762555 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:56.638472 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4837d-050c-401a-a134-587c01762555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:56.640087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4837d-050c-401a-a134-587c01762555 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:56.652891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 435/854] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:50:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:56.658107 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c716b65-bd1e-4811-b0af-488ee4f0971c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:56.669453 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c716b65-bd1e-4811-b0af-488ee4f0971c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:56.674265 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbddb1-896c-4591-bd0b-c4754b1c44d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:56.675063 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbddb1-896c-4591-bd0b-c4754b1c44d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:56.675393 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbddb1-896c-4591-bd0b-c4754b1c44d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:56.675667 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbddb1-896c-4591-bd0b-c4754b1c44d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:56.686823 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbddb1-896c-4591-bd0b-c4754b1c44d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:56.688687 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbddb1-896c-4591-bd0b-c4754b1c44d7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:56.705361 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-66fbddb1-896c-4591-bd0b-c4754b1c44d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:56.707040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 420/855] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:56.713452 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4837d-050c-401a-a134-587c01762555 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:56.723394 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4837d-050c-401a-a134-587c01762555 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:56.728292 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a07b0-6fd1-4c95-831c-7a922cb29fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:56.728993 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a07b0-6fd1-4c95-831c-7a922cb29fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:56.729311 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a07b0-6fd1-4c95-831c-7a922cb29fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:56.729591 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a07b0-6fd1-4c95-831c-7a922cb29fc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:56.730350 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a07b0-6fd1-4c95-831c-7a922cb29fc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:56.730678 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a07b0-6fd1-4c95-831c-7a922cb29fc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:56.732628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a07b0-6fd1-4c95-831c-7a922cb29fc6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:56.746186 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 436/856] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:56.751904 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbddb1-896c-4591-bd0b-c4754b1c44d7 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:56.762975 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbddb1-896c-4591-bd0b-c4754b1c44d7 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:56.767955 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2813de-718f-4962-8db2-3c52c969f31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:56.768939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2813de-718f-4962-8db2-3c52c969f31a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:56.769152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2813de-718f-4962-8db2-3c52c969f31a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:56.769505 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2813de-718f-4962-8db2-3c52c969f31a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:56.779387 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2813de-718f-4962-8db2-3c52c969f31a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:56.781490 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2813de-718f-4962-8db2-3c52c969f31a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:56.797126 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-fc2813de-718f-4962-8db2-3c52c969f31a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 16:50:56.798476 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 421/857] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:50:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:56.804713 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a07b0-6fd1-4c95-831c-7a922cb29fc6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:56.814899 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a07b0-6fd1-4c95-831c-7a922cb29fc6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:56.819747 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72354a-12e9-49a4-bbee-50a7fdc59948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:56.820400 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72354a-12e9-49a4-bbee-50a7fdc59948 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:56.820724 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72354a-12e9-49a4-bbee-50a7fdc59948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:56.820990 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72354a-12e9-49a4-bbee-50a7fdc59948 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:56.821947 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72354a-12e9-49a4-bbee-50a7fdc59948 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:56.822255 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72354a-12e9-49a4-bbee-50a7fdc59948 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:56.824190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72354a-12e9-49a4-bbee-50a7fdc59948 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:56.844339 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 437/858] 10.222.0.42 () {56 vars in 1156 bytes} [Wed Feb 16 16:50:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:56.849832 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2813de-718f-4962-8db2-3c52c969f31a admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:56.860863 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2813de-718f-4962-8db2-3c52c969f31a admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:56.865516 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a4a4f-e8b1-4ea1-bc64-4593ecc135d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:56.866807 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a4a4f-e8b1-4ea1-bc64-4593ecc135d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:56.867142 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a4a4f-e8b1-4ea1-bc64-4593ecc135d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:56.867421 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a4a4f-e8b1-4ea1-bc64-4593ecc135d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:56.876017 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a4a4f-e8b1-4ea1-bc64-4593ecc135d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:56.877876 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a4a4f-e8b1-4ea1-bc64-4593ecc135d4 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:56.889999 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 422/859] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:56 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:50:56.895524 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72354a-12e9-49a4-bbee-50a7fdc59948 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:56.905754 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72354a-12e9-49a4-bbee-50a7fdc59948 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:56.910304 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174066e-6020-4dc9-a563-988a76b613cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:56.911323 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174066e-6020-4dc9-a563-988a76b613cc admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:56.911604 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174066e-6020-4dc9-a563-988a76b613cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:56.911872 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174066e-6020-4dc9-a563-988a76b613cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:56.922671 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174066e-6020-4dc9-a563-988a76b613cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:56.924501 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174066e-6020-4dc9-a563-988a76b613cc admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:56.942426 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-a174066e-6020-4dc9-a563-988a76b613cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:56.944007 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 438/860] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:56.949526 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a4a4f-e8b1-4ea1-bc64-4593ecc135d4 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:56.958743 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a4a4f-e8b1-4ea1-bc64-4593ecc135d4 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:56.964253 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052caf7-264d-4b89-9e03-5498994e8804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:56.964896 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052caf7-264d-4b89-9e03-5498994e8804 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:56.965174 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052caf7-264d-4b89-9e03-5498994e8804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:56.965444 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052caf7-264d-4b89-9e03-5498994e8804 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:56.966153 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052caf7-264d-4b89-9e03-5498994e8804 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:56.966458 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052caf7-264d-4b89-9e03-5498994e8804 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:56.968058 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052caf7-264d-4b89-9e03-5498994e8804 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:56.981166 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 423/861] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:56.988224 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174066e-6020-4dc9-a563-988a76b613cc admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:56.999043 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174066e-6020-4dc9-a563-988a76b613cc admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:57.003984 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadaa96-a700-4cbb-a6b0-bde0a3dde207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:57.004992 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadaa96-a700-4cbb-a6b0-bde0a3dde207 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:57.005412 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadaa96-a700-4cbb-a6b0-bde0a3dde207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:57.005823 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadaa96-a700-4cbb-a6b0-bde0a3dde207 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:57.014278 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadaa96-a700-4cbb-a6b0-bde0a3dde207 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:57.016436 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadaa96-a700-4cbb-a6b0-bde0a3dde207 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:57.029838 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-dcadaa96-a700-4cbb-a6b0-bde0a3dde207 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:57.031499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 439/862] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:57.037214 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052caf7-264d-4b89-9e03-5498994e8804 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:57.047424 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052caf7-264d-4b89-9e03-5498994e8804 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:57.052374 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a8920-6476-441a-af9e-c642298ccf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:57.053229 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a8920-6476-441a-af9e-c642298ccf61 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:57.054291 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a8920-6476-441a-af9e-c642298ccf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:57.054753 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a8920-6476-441a-af9e-c642298ccf61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:57.055719 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a8920-6476-441a-af9e-c642298ccf61 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:57.056166 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a8920-6476-441a-af9e-c642298ccf61 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:57.058215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a8920-6476-441a-af9e-c642298ccf61 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:57.071611 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 424/863] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:57.077599 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadaa96-a700-4cbb-a6b0-bde0a3dde207 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:57.089015 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadaa96-a700-4cbb-a6b0-bde0a3dde207 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:57.093883 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4b134-3945-42f9-b062-73f03f9ea58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:57.094763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4b134-3945-42f9-b062-73f03f9ea58c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:57.095181 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4b134-3945-42f9-b062-73f03f9ea58c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:57.095610 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4b134-3945-42f9-b062-73f03f9ea58c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:57.096607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4b134-3945-42f9-b062-73f03f9ea58c admin admin] RBAC: Adding query filter params (role.id=8263a29ceeed4576b3b6959c99964ed7, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=fc59cb98783b4353a405b8b9a3a9d592) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:57.097052 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4b134-3945-42f9-b062-73f03f9ea58c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:57.099179 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4b134-3945-42f9-b062-73f03f9ea58c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:57.106596 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 440/864] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:57 2022] GET /identity/v3/role_assignments?user.id=fc59cb98783b4353a405b8b9a3a9d592&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:57.162293 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806969b-f25d-4476-b991-b43fe736e363 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:57.163386 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806969b-f25d-4476-b991-b43fe736e363 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:57.163862 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806969b-f25d-4476-b991-b43fe736e363 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:57.166159 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 425/865] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:57.171859 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be183807-265e-41f0-8009-1a16398a0d20 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:57.172152 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be183807-265e-41f0-8009-1a16398a0d20 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:57.172477 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be183807-265e-41f0-8009-1a16398a0d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:57.192381 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-be183807-265e-41f0-8009-1a16398a0d20 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:57.193590 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-be183807-265e-41f0-8009-1a16398a0d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:57.206806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 441/866] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:57 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:50:57.227073 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806969b-f25d-4476-b991-b43fe736e363 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:57.240487 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806969b-f25d-4476-b991-b43fe736e363 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:57.246122 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25695738-90d7-4f38-9587-4209b41c8a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:57.247105 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25695738-90d7-4f38-9587-4209b41c8a8c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:57.247484 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25695738-90d7-4f38-9587-4209b41c8a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:57.247859 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25695738-90d7-4f38-9587-4209b41c8a8c admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:57.248642 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25695738-90d7-4f38-9587-4209b41c8a8c admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:57.250369 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25695738-90d7-4f38-9587-4209b41c8a8c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:57.262846 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-25695738-90d7-4f38-9587-4209b41c8a8c admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 16 16:50:57.264617 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 426/867] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:50:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:57.270279 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be183807-265e-41f0-8009-1a16398a0d20 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:57.280381 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be183807-265e-41f0-8009-1a16398a0d20 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:57.285009 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564a108-0c50-4555-ad3c-bb6e6f3f5bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:57.285680 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564a108-0c50-4555-ad3c-bb6e6f3f5bed admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:57.285955 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564a108-0c50-4555-ad3c-bb6e6f3f5bed admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:57.286226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564a108-0c50-4555-ad3c-bb6e6f3f5bed admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:57.286967 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564a108-0c50-4555-ad3c-bb6e6f3f5bed admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:57.287270 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564a108-0c50-4555-ad3c-bb6e6f3f5bed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:57.290899 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564a108-0c50-4555-ad3c-bb6e6f3f5bed admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:57.298776 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 442/868] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:50:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:57.300916 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25695738-90d7-4f38-9587-4209b41c8a8c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:57.316008 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25695738-90d7-4f38-9587-4209b41c8a8c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:57.321178 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc708a1-3b68-4b6c-bb20-1fd0e1acb77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:57.321918 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc708a1-3b68-4b6c-bb20-1fd0e1acb77d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:57.322197 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc708a1-3b68-4b6c-bb20-1fd0e1acb77d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:57.322468 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc708a1-3b68-4b6c-bb20-1fd0e1acb77d admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:57.323259 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc708a1-3b68-4b6c-bb20-1fd0e1acb77d admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:57.323590 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc708a1-3b68-4b6c-bb20-1fd0e1acb77d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:57.325203 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc708a1-3b68-4b6c-bb20-1fd0e1acb77d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:57.334796 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 427/869] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:50:57 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:57.721675 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ed42e-baf4-4cbf-9f8a-2ad2294ff209 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:57.722366 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ed42e-baf4-4cbf-9f8a-2ad2294ff209 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:57.722366 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ed42e-baf4-4cbf-9f8a-2ad2294ff209 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:57.724178 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 443/870] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:57.732375 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9c2ec-14d6-44e1-a0b0-b4ed51b858d0 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:57.732375 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9c2ec-14d6-44e1-a0b0-b4ed51b858d0 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:57.732375 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9c2ec-14d6-44e1-a0b0-b4ed51b858d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:57.748824 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-4fb9c2ec-14d6-44e1-a0b0-b4ed51b858d0 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:57.750174 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-4fb9c2ec-14d6-44e1-a0b0-b4ed51b858d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:57.758311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 428/871] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:57 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 16:50:57.781431 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ed42e-baf4-4cbf-9f8a-2ad2294ff209 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:57.794415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ed42e-baf4-4cbf-9f8a-2ad2294ff209 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:57.798962 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52554205-3d52-4ffd-abd9-137e78dc1757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:57.799599 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52554205-3d52-4ffd-abd9-137e78dc1757 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:57.799876 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52554205-3d52-4ffd-abd9-137e78dc1757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:57.800150 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52554205-3d52-4ffd-abd9-137e78dc1757 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:57.800870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52554205-3d52-4ffd-abd9-137e78dc1757 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:57.802488 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52554205-3d52-4ffd-abd9-137e78dc1757 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:57.920334 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 444/872] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Feb 16 16:50:57 2022] POST /identity/v3/services => generated 269 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:50:58.448466 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f74f73-ac47-4b1d-9091-762fea57365b None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:58.449181 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f74f73-ac47-4b1d-9091-762fea57365b None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:58.449674 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f74f73-ac47-4b1d-9091-762fea57365b None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:58.451952 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 429/873] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:58.457338 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ca7f8-6b40-49f6-a5dc-edcd9303ca75 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:58.457839 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ca7f8-6b40-49f6-a5dc-edcd9303ca75 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:58.458327 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ca7f8-6b40-49f6-a5dc-edcd9303ca75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:58.477355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-fc3ca7f8-6b40-49f6-a5dc-edcd9303ca75 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:58.478964 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-fc3ca7f8-6b40-49f6-a5dc-edcd9303ca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:58.496830 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 445/874] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:58 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:50:58.521247 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f74f73-ac47-4b1d-9091-762fea57365b None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:58.533889 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f74f73-ac47-4b1d-9091-762fea57365b None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:58.538982 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1450943-f01f-481b-a681-d079269ef19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:58.539772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1450943-f01f-481b-a681-d079269ef19b admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:58.540110 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1450943-f01f-481b-a681-d079269ef19b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:58.540383 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1450943-f01f-481b-a681-d079269ef19b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:58.550801 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1450943-f01f-481b-a681-d079269ef19b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:50:58.559239 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-d1450943-f01f-481b-a681-d079269ef19b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 16:50:58.560681 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 430/875] 10.222.0.42 () {56 vars in 1141 bytes} [Wed Feb 16 16:50:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:58.566383 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ca7f8-6b40-49f6-a5dc-edcd9303ca75 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:58.576640 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ca7f8-6b40-49f6-a5dc-edcd9303ca75 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:58.580746 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab507da5-64a7-4889-b61b-5fd69d9d11d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:58.581396 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab507da5-64a7-4889-b61b-5fd69d9d11d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:58.581671 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab507da5-64a7-4889-b61b-5fd69d9d11d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:58.581939 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab507da5-64a7-4889-b61b-5fd69d9d11d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:58.582703 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab507da5-64a7-4889-b61b-5fd69d9d11d1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:58.583005 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab507da5-64a7-4889-b61b-5fd69d9d11d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:58.584595 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab507da5-64a7-4889-b61b-5fd69d9d11d1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:58.593782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 446/876] 10.222.0.42 () {56 vars in 1136 bytes} [Wed Feb 16 16:50:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:58.599108 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1450943-f01f-481b-a681-d079269ef19b admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:58.609671 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1450943-f01f-481b-a681-d079269ef19b admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:58.614210 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bad4e9-406c-40e0-8e6b-d438e3eeda61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:58.615056 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bad4e9-406c-40e0-8e6b-d438e3eeda61 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:58.615335 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bad4e9-406c-40e0-8e6b-d438e3eeda61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:58.615598 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bad4e9-406c-40e0-8e6b-d438e3eeda61 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:58.626409 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bad4e9-406c-40e0-8e6b-d438e3eeda61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:58.628306 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bad4e9-406c-40e0-8e6b-d438e3eeda61 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:58.645492 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-d2bad4e9-406c-40e0-8e6b-d438e3eeda61 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:58.647023 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 431/877] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:58.652750 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab507da5-64a7-4889-b61b-5fd69d9d11d1 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:58.662460 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab507da5-64a7-4889-b61b-5fd69d9d11d1 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:58.667882 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45976ca4-6f3d-4dc3-995e-f66b469147b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:58.668573 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45976ca4-6f3d-4dc3-995e-f66b469147b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:58.668856 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45976ca4-6f3d-4dc3-995e-f66b469147b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:58.669166 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45976ca4-6f3d-4dc3-995e-f66b469147b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:58.669880 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45976ca4-6f3d-4dc3-995e-f66b469147b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:58.670178 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45976ca4-6f3d-4dc3-995e-f66b469147b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:58.673000 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45976ca4-6f3d-4dc3-995e-f66b469147b3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:58.685461 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 447/878] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:58.690956 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bad4e9-406c-40e0-8e6b-d438e3eeda61 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:58.701789 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bad4e9-406c-40e0-8e6b-d438e3eeda61 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:58.706824 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd6564-5b3a-46f8-9323-f93cc088b774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:58.707607 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd6564-5b3a-46f8-9323-f93cc088b774 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:58.707927 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd6564-5b3a-46f8-9323-f93cc088b774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:58.708198 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd6564-5b3a-46f8-9323-f93cc088b774 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:58.717092 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd6564-5b3a-46f8-9323-f93cc088b774 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:58.719110 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd6564-5b3a-46f8-9323-f93cc088b774 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:58.733914 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-42cd6564-5b3a-46f8-9323-f93cc088b774 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 16:50:58.735379 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 432/879] 10.222.0.42 () {56 vars in 1138 bytes} [Wed Feb 16 16:50:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:58.740871 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45976ca4-6f3d-4dc3-995e-f66b469147b3 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:58.751649 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45976ca4-6f3d-4dc3-995e-f66b469147b3 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:58.756456 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c5bf6-eb1d-41f2-bb32-7003a2133ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:58.757224 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c5bf6-eb1d-41f2-bb32-7003a2133ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:58.757533 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c5bf6-eb1d-41f2-bb32-7003a2133ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:58.757801 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c5bf6-eb1d-41f2-bb32-7003a2133ac7 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:58.758707 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c5bf6-eb1d-41f2-bb32-7003a2133ac7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:58.759012 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c5bf6-eb1d-41f2-bb32-7003a2133ac7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:58.760871 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c5bf6-eb1d-41f2-bb32-7003a2133ac7 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:58.779618 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 448/880] 10.222.0.42 () {56 vars in 1170 bytes} [Wed Feb 16 16:50:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:58.784958 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd6564-5b3a-46f8-9323-f93cc088b774 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:58.796065 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd6564-5b3a-46f8-9323-f93cc088b774 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:58.800988 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa95ac6-fb30-478f-92f0-573942d1b61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:58.801680 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa95ac6-fb30-478f-92f0-573942d1b61f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:58.801956 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa95ac6-fb30-478f-92f0-573942d1b61f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:58.802225 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa95ac6-fb30-478f-92f0-573942d1b61f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:58.811441 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa95ac6-fb30-478f-92f0-573942d1b61f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:58.813215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa95ac6-fb30-478f-92f0-573942d1b61f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:58.823448 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 433/881] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:50:58 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:50:58.829029 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c5bf6-eb1d-41f2-bb32-7003a2133ac7 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:58.841702 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c5bf6-eb1d-41f2-bb32-7003a2133ac7 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:58.846811 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac392a57-f7ed-42e0-911b-c3d34858c07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:58.847829 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac392a57-f7ed-42e0-911b-c3d34858c07c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:58.848285 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac392a57-f7ed-42e0-911b-c3d34858c07c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:58.848729 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac392a57-f7ed-42e0-911b-c3d34858c07c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:58.860096 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac392a57-f7ed-42e0-911b-c3d34858c07c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:58.862158 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac392a57-f7ed-42e0-911b-c3d34858c07c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:58.882443 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-ac392a57-f7ed-42e0-911b-c3d34858c07c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:50:58.884230 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 449/882] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:58.889853 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa95ac6-fb30-478f-92f0-573942d1b61f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:58.899951 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa95ac6-fb30-478f-92f0-573942d1b61f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:58.904783 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244197a-dfe9-4e65-94d5-b5d11f31d852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:58.905622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244197a-dfe9-4e65-94d5-b5d11f31d852 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:58.906073 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244197a-dfe9-4e65-94d5-b5d11f31d852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:58.906517 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244197a-dfe9-4e65-94d5-b5d11f31d852 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:58.907445 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244197a-dfe9-4e65-94d5-b5d11f31d852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:58.907922 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244197a-dfe9-4e65-94d5-b5d11f31d852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:58.909648 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244197a-dfe9-4e65-94d5-b5d11f31d852 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:58.926861 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 434/883] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:58.928519 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac392a57-f7ed-42e0-911b-c3d34858c07c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:58.939108 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac392a57-f7ed-42e0-911b-c3d34858c07c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:58.944575 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfde1d-3790-4af8-94a5-88231a48c463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:58.946013 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfde1d-3790-4af8-94a5-88231a48c463 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:58.946473 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfde1d-3790-4af8-94a5-88231a48c463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:58.946985 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfde1d-3790-4af8-94a5-88231a48c463 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:58.954476 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfde1d-3790-4af8-94a5-88231a48c463 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:58.956705 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfde1d-3790-4af8-94a5-88231a48c463 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:58.970676 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-99bfde1d-3790-4af8-94a5-88231a48c463 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:50:58.972352 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 450/884] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:50:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:50:58.978219 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244197a-dfe9-4e65-94d5-b5d11f31d852 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:58.988899 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244197a-dfe9-4e65-94d5-b5d11f31d852 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:58.994622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d541aa-9e19-4a98-9642-56a4a5318e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:58.995542 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d541aa-9e19-4a98-9642-56a4a5318e1e admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:58.995991 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d541aa-9e19-4a98-9642-56a4a5318e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:58.996432 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d541aa-9e19-4a98-9642-56a4a5318e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:58.997434 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d541aa-9e19-4a98-9642-56a4a5318e1e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:58.997911 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d541aa-9e19-4a98-9642-56a4a5318e1e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:59.000105 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d541aa-9e19-4a98-9642-56a4a5318e1e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:59.013263 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 435/885] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:50:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:59.019373 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfde1d-3790-4af8-94a5-88231a48c463 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:59.030926 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfde1d-3790-4af8-94a5-88231a48c463 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:59.035703 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22047563-8d77-4aea-9c9e-9cf5c5eeccb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:59.036573 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22047563-8d77-4aea-9c9e-9cf5c5eeccb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:59.037111 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22047563-8d77-4aea-9c9e-9cf5c5eeccb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:59.037554 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22047563-8d77-4aea-9c9e-9cf5c5eeccb2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:59.039045 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22047563-8d77-4aea-9c9e-9cf5c5eeccb2 admin admin] RBAC: Adding query filter params (role.id=7a712c9c729e424bab90590b1f232d0b, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=fa9ea7738c634318a532ebca2e564745) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:59.039533 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22047563-8d77-4aea-9c9e-9cf5c5eeccb2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:59.041625 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22047563-8d77-4aea-9c9e-9cf5c5eeccb2 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:59.047994 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 451/886] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:50:59 2022] GET /identity/v3/role_assignments?user.id=fa9ea7738c634318a532ebca2e564745&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=7a712c9c729e424bab90590b1f232d0b => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:50:59.597039 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57b3e7-b72b-464b-83b5-1eaa2c52a270 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:59.597362 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57b3e7-b72b-464b-83b5-1eaa2c52a270 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:59.597576 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57b3e7-b72b-464b-83b5-1eaa2c52a270 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:59.599593 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 436/887] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:59.605387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e77aa-baf6-49fa-ab1f-16ca86758913 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:59.605946 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e77aa-baf6-49fa-ab1f-16ca86758913 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:59.606446 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e77aa-baf6-49fa-ab1f-16ca86758913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:59.625199 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-713e77aa-baf6-49fa-ab1f-16ca86758913 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:59.626729 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-713e77aa-baf6-49fa-ab1f-16ca86758913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:59.642753 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 452/888] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:59 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:50:59.659152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57b3e7-b72b-464b-83b5-1eaa2c52a270 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:59.664831 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158a2a9-5f00-4ad6-b06e-3b8becb01d24 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:59.665113 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158a2a9-5f00-4ad6-b06e-3b8becb01d24 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:59.665381 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158a2a9-5f00-4ad6-b06e-3b8becb01d24 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:59.667417 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 453/889] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:50:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:50:59.672192 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ffce4-fd0d-435c-b0a2-87cee61deb84 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:59.672477 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ffce4-fd0d-435c-b0a2-87cee61deb84 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:59.672749 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ffce4-fd0d-435c-b0a2-87cee61deb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:59.677455 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57b3e7-b72b-464b-83b5-1eaa2c52a270 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:59.682387 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424cb09-4cbb-43dd-b5bf-df26a1afe811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:59.683459 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424cb09-4cbb-43dd-b5bf-df26a1afe811 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:59.683955 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424cb09-4cbb-43dd-b5bf-df26a1afe811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:59.684425 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424cb09-4cbb-43dd-b5bf-df26a1afe811 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:59.685267 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424cb09-4cbb-43dd-b5bf-df26a1afe811 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:59.687078 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424cb09-4cbb-43dd-b5bf-df26a1afe811 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:59.690118 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-2e3ffce4-fd0d-435c-b0a2-87cee61deb84 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:50:59.691305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2e3ffce4-fd0d-435c-b0a2-87cee61deb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:50:59.699914 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 454/890] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:50:59 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 16:50:59.701431 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-5424cb09-4cbb-43dd-b5bf-df26a1afe811 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 16:50:59.707588 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 437/891] 10.222.0.42 () {56 vars in 1147 bytes} [Wed Feb 16 16:50:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:50:59.709025 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ffce4-fd0d-435c-b0a2-87cee61deb84 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:59.719213 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ffce4-fd0d-435c-b0a2-87cee61deb84 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:59.722796 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424cb09-4cbb-43dd-b5bf-df26a1afe811 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:59.725332 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18568a44-2379-42b9-8355-d95fd4ba4415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:59.729256 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18568a44-2379-42b9-8355-d95fd4ba4415 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:59.729256 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18568a44-2379-42b9-8355-d95fd4ba4415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:59.729256 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18568a44-2379-42b9-8355-d95fd4ba4415 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:59.729256 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18568a44-2379-42b9-8355-d95fd4ba4415 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:59.729256 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18568a44-2379-42b9-8355-d95fd4ba4415 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:59.729256 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18568a44-2379-42b9-8355-d95fd4ba4415 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:59.734687 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 455/892] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Feb 16 16:50:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:59.739302 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424cb09-4cbb-43dd-b5bf-df26a1afe811 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:59.742098 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18568a44-2379-42b9-8355-d95fd4ba4415 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:50:59.745400 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3685cc-d829-4c0e-a87e-f5d8ed2f9d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:59.746136 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3685cc-d829-4c0e-a87e-f5d8ed2f9d73 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:59.746486 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3685cc-d829-4c0e-a87e-f5d8ed2f9d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:59.746847 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3685cc-d829-4c0e-a87e-f5d8ed2f9d73 admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:59.747648 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3685cc-d829-4c0e-a87e-f5d8ed2f9d73 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:59.749290 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3685cc-d829-4c0e-a87e-f5d8ed2f9d73 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:59.753723 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18568a44-2379-42b9-8355-d95fd4ba4415 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:50:59.758460 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238ce4a-a5bc-4ff3-8720-9913ce7021d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:50:59.759224 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238ce4a-a5bc-4ff3-8720-9913ce7021d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:50:59.759572 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238ce4a-a5bc-4ff3-8720-9913ce7021d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:50:59.759911 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238ce4a-a5bc-4ff3-8720-9913ce7021d3 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:50:59.760678 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238ce4a-a5bc-4ff3-8720-9913ce7021d3 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:50:59.761049 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238ce4a-a5bc-4ff3-8720-9913ce7021d3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:50:59.762709 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238ce4a-a5bc-4ff3-8720-9913ce7021d3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:50:59.767804 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 456/893] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Feb 16 16:50:59 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:50:59.852780 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 438/894] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Feb 16 16:50:59 2022] POST /identity/v3/services => generated 251 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:51:00.408013 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93e640-bfcf-40e6-a427-8278f805e0c0 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:00.408403 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93e640-bfcf-40e6-a427-8278f805e0c0 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:00.408600 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93e640-bfcf-40e6-a427-8278f805e0c0 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:00.410661 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 457/895] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:00.416021 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af4888-0588-464c-be87-d0ba8dc6954a None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:00.416313 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af4888-0588-464c-be87-d0ba8dc6954a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:00.416592 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af4888-0588-464c-be87-d0ba8dc6954a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:00.434907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-d3af4888-0588-464c-be87-d0ba8dc6954a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:00.436104 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d3af4888-0588-464c-be87-d0ba8dc6954a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:00.453751 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 439/896] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:00 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:00.477925 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93e640-bfcf-40e6-a427-8278f805e0c0 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:00.490623 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93e640-bfcf-40e6-a427-8278f805e0c0 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:00.495855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c272ad-459f-4603-9637-4d43da786188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:00.496663 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c272ad-459f-4603-9637-4d43da786188 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:00.496964 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c272ad-459f-4603-9637-4d43da786188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:00.497235 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c272ad-459f-4603-9637-4d43da786188 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:00.497881 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c272ad-459f-4603-9637-4d43da786188 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:00.499669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c272ad-459f-4603-9637-4d43da786188 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:00.511866 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-a9c272ad-459f-4603-9637-4d43da786188 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 16 16:51:00.513389 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 458/897] 10.222.0.42 () {56 vars in 1153 bytes} [Wed Feb 16 16:51:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:00.519739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af4888-0588-464c-be87-d0ba8dc6954a None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:00.532997 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af4888-0588-464c-be87-d0ba8dc6954a None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:00.537779 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f63e5-58d9-4f76-83f6-525becad899e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:00.538615 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f63e5-58d9-4f76-83f6-525becad899e admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:00.538932 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f63e5-58d9-4f76-83f6-525becad899e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:00.539209 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f63e5-58d9-4f76-83f6-525becad899e admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:00.539925 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f63e5-58d9-4f76-83f6-525becad899e admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:00.540234 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f63e5-58d9-4f76-83f6-525becad899e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:00.541849 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f63e5-58d9-4f76-83f6-525becad899e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:00.547421 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 440/898] 10.222.0.42 () {56 vars in 1147 bytes} [Wed Feb 16 16:51:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:00.553052 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c272ad-459f-4603-9637-4d43da786188 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:00.564247 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c272ad-459f-4603-9637-4d43da786188 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:00.569599 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd937b73-db89-4266-8928-8ba3fe018ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:00.570582 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd937b73-db89-4266-8928-8ba3fe018ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:00.570902 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd937b73-db89-4266-8928-8ba3fe018ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:00.571179 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd937b73-db89-4266-8928-8ba3fe018ae0 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:00.572023 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd937b73-db89-4266-8928-8ba3fe018ae0 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:00.572337 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd937b73-db89-4266-8928-8ba3fe018ae0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:00.573972 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd937b73-db89-4266-8928-8ba3fe018ae0 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:00.580655 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 459/899] 10.222.0.42 () {56 vars in 1147 bytes} [Wed Feb 16 16:51:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:00.585905 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f63e5-58d9-4f76-83f6-525becad899e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:00.596335 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f63e5-58d9-4f76-83f6-525becad899e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:00.601446 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882fcd1-2518-4812-bb9f-e706fd776ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:00.602170 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882fcd1-2518-4812-bb9f-e706fd776ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:00.602451 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882fcd1-2518-4812-bb9f-e706fd776ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:00.602815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882fcd1-2518-4812-bb9f-e706fd776ee9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:00.603661 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882fcd1-2518-4812-bb9f-e706fd776ee9 admin admin] RBAC: Adding query filter params (interface=public, service_id=14ce3cf61d2248b08b1f3a81c2019e67, region_id=RegionOne) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:00.603973 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882fcd1-2518-4812-bb9f-e706fd776ee9 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:00.605025 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING py.warnings [None req-8882fcd1-2518-4812-bb9f-e706fd776ee9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:51:00.605025 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: warnings.warn(msg) Feb 16 16:51:00.605025 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: Feb 16 16:51:00.605936 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882fcd1-2518-4812-bb9f-e706fd776ee9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:00.614310 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 441/900] 10.222.0.42 () {56 vars in 1272 bytes} [Wed Feb 16 16:51:00 2022] GET /identity/v3/endpoints?service_id=14ce3cf61d2248b08b1f3a81c2019e67&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:00.620671 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd937b73-db89-4266-8928-8ba3fe018ae0 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:00.631244 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd937b73-db89-4266-8928-8ba3fe018ae0 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:00.636631 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc7ca2-371d-4051-9449-483c127e099d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:00.637293 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc7ca2-371d-4051-9449-483c127e099d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:00.637572 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc7ca2-371d-4051-9449-483c127e099d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:00.637891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc7ca2-371d-4051-9449-483c127e099d admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:00.638574 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc7ca2-371d-4051-9449-483c127e099d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:00.640385 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc7ca2-371d-4051-9449-483c127e099d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:00.647643 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 460/901] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Feb 16 16:51:00 2022] GET /identity/v3/services => generated 1268 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 16:51:01.401814 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0d6a4-9f57-4f1c-abc4-698e500ccfca None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:01.402314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0d6a4-9f57-4f1c-abc4-698e500ccfca None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:01.402389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0d6a4-9f57-4f1c-abc4-698e500ccfca None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:01.404458 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 442/902] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:01.409396 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d276c-fb25-456e-89c0-6ffdaf466563 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:01.409828 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d276c-fb25-456e-89c0-6ffdaf466563 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:01.409972 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d276c-fb25-456e-89c0-6ffdaf466563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:01.428016 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-f98d276c-fb25-456e-89c0-6ffdaf466563 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:01.429798 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f98d276c-fb25-456e-89c0-6ffdaf466563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:01.438352 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 461/903] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:01 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:01.462873 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0d6a4-9f57-4f1c-abc4-698e500ccfca None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:01.479379 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0d6a4-9f57-4f1c-abc4-698e500ccfca None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:01.484617 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99fbec-5c87-404b-a1a1-f72a6aee2fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:01.485624 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99fbec-5c87-404b-a1a1-f72a6aee2fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:01.486112 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99fbec-5c87-404b-a1a1-f72a6aee2fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:01.486563 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99fbec-5c87-404b-a1a1-f72a6aee2fc8 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:01.499271 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99fbec-5c87-404b-a1a1-f72a6aee2fc8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:51:01.507071 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-9e99fbec-5c87-404b-a1a1-f72a6aee2fc8 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 16:51:01.508600 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 443/904] 10.222.0.42 () {56 vars in 1141 bytes} [Wed Feb 16 16:51:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:01.514044 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d276c-fb25-456e-89c0-6ffdaf466563 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:01.525745 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d276c-fb25-456e-89c0-6ffdaf466563 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:01.532608 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de976dd-5037-444f-96f3-68cf4a15f6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:01.533374 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de976dd-5037-444f-96f3-68cf4a15f6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:01.533747 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de976dd-5037-444f-96f3-68cf4a15f6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:01.534114 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de976dd-5037-444f-96f3-68cf4a15f6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:01.534990 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de976dd-5037-444f-96f3-68cf4a15f6e7 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:01.535393 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de976dd-5037-444f-96f3-68cf4a15f6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:01.537110 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de976dd-5037-444f-96f3-68cf4a15f6e7 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:01.548824 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 462/905] 10.222.0.42 () {56 vars in 1136 bytes} [Wed Feb 16 16:51:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:01.552785 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99fbec-5c87-404b-a1a1-f72a6aee2fc8 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:01.564062 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99fbec-5c87-404b-a1a1-f72a6aee2fc8 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:01.569415 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6121a-4261-41e2-8496-204bcd0d1784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:01.570504 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6121a-4261-41e2-8496-204bcd0d1784 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:01.571053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6121a-4261-41e2-8496-204bcd0d1784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:01.571662 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6121a-4261-41e2-8496-204bcd0d1784 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:01.586343 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6121a-4261-41e2-8496-204bcd0d1784 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:01.588711 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6121a-4261-41e2-8496-204bcd0d1784 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:01.607974 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-e5a6121a-4261-41e2-8496-204bcd0d1784 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:51:01.609735 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 444/906] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:01.615418 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de976dd-5037-444f-96f3-68cf4a15f6e7 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:01.625951 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de976dd-5037-444f-96f3-68cf4a15f6e7 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:01.630877 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5104e7-b203-423d-9909-2b2e74287428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:01.632289 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5104e7-b203-423d-9909-2b2e74287428 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:01.632801 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5104e7-b203-423d-9909-2b2e74287428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:01.633244 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5104e7-b203-423d-9909-2b2e74287428 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:01.634133 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5104e7-b203-423d-9909-2b2e74287428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:01.634607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5104e7-b203-423d-9909-2b2e74287428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:01.636416 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5104e7-b203-423d-9909-2b2e74287428 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:01.650553 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 463/907] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:01.656233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6121a-4261-41e2-8496-204bcd0d1784 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:01.668928 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6121a-4261-41e2-8496-204bcd0d1784 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:01.673929 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906824df-a9d4-44ba-9ada-ef3f84800970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:01.675029 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906824df-a9d4-44ba-9ada-ef3f84800970 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:01.675560 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906824df-a9d4-44ba-9ada-ef3f84800970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:01.676004 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906824df-a9d4-44ba-9ada-ef3f84800970 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:01.685743 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906824df-a9d4-44ba-9ada-ef3f84800970 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:01.688070 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906824df-a9d4-44ba-9ada-ef3f84800970 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:01.708611 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-906824df-a9d4-44ba-9ada-ef3f84800970 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 16:51:01.711083 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 445/908] 10.222.0.42 () {56 vars in 1138 bytes} [Wed Feb 16 16:51:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:01.716958 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5104e7-b203-423d-9909-2b2e74287428 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:01.727752 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5104e7-b203-423d-9909-2b2e74287428 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:01.732962 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882609e0-686f-44fa-8307-f38da63e1ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:01.733842 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882609e0-686f-44fa-8307-f38da63e1ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:01.734404 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882609e0-686f-44fa-8307-f38da63e1ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:01.734875 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882609e0-686f-44fa-8307-f38da63e1ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:01.735868 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882609e0-686f-44fa-8307-f38da63e1ff1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:01.736395 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882609e0-686f-44fa-8307-f38da63e1ff1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:01.738406 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882609e0-686f-44fa-8307-f38da63e1ff1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:01.758880 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 464/909] 10.222.0.42 () {56 vars in 1170 bytes} [Wed Feb 16 16:51:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:01.764709 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906824df-a9d4-44ba-9ada-ef3f84800970 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:01.775915 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906824df-a9d4-44ba-9ada-ef3f84800970 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:01.780923 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab28d9a-952e-47b5-ba3f-8d1262b0f466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:01.781984 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab28d9a-952e-47b5-ba3f-8d1262b0f466 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:01.782474 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab28d9a-952e-47b5-ba3f-8d1262b0f466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:01.783003 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab28d9a-952e-47b5-ba3f-8d1262b0f466 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:01.793949 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab28d9a-952e-47b5-ba3f-8d1262b0f466 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:01.796070 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab28d9a-952e-47b5-ba3f-8d1262b0f466 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:01.814326 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-aab28d9a-952e-47b5-ba3f-8d1262b0f466 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:51:01.816187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 446/910] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:51:01.823633 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882609e0-686f-44fa-8307-f38da63e1ff1 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:01.834725 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882609e0-686f-44fa-8307-f38da63e1ff1 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:01.840303 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944df0c-e796-4f63-bd9a-a359b5677f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:01.841454 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944df0c-e796-4f63-bd9a-a359b5677f91 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:01.842026 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944df0c-e796-4f63-bd9a-a359b5677f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:01.842507 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944df0c-e796-4f63-bd9a-a359b5677f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:01.843599 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944df0c-e796-4f63-bd9a-a359b5677f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:01.844138 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944df0c-e796-4f63-bd9a-a359b5677f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:01.846194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944df0c-e796-4f63-bd9a-a359b5677f91 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:01.861782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 465/911] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:01.868113 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab28d9a-952e-47b5-ba3f-8d1262b0f466 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:01.878804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab28d9a-952e-47b5-ba3f-8d1262b0f466 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:01.884480 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c01973-b3c0-45e4-8ebc-0cdee2b157b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:01.885551 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c01973-b3c0-45e4-8ebc-0cdee2b157b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:01.886050 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c01973-b3c0-45e4-8ebc-0cdee2b157b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:01.886514 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c01973-b3c0-45e4-8ebc-0cdee2b157b2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:01.894999 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c01973-b3c0-45e4-8ebc-0cdee2b157b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:01.898588 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c01973-b3c0-45e4-8ebc-0cdee2b157b2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:01.912371 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-53c01973-b3c0-45e4-8ebc-0cdee2b157b2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:51:01.914242 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 447/912] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:51:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:01.920137 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944df0c-e796-4f63-bd9a-a359b5677f91 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:01.930461 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944df0c-e796-4f63-bd9a-a359b5677f91 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:01.935444 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956a993-0a3b-49b1-85be-4033c4aae4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:01.936408 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956a993-0a3b-49b1-85be-4033c4aae4da admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:01.936921 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956a993-0a3b-49b1-85be-4033c4aae4da admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:01.937388 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956a993-0a3b-49b1-85be-4033c4aae4da admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:01.938534 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956a993-0a3b-49b1-85be-4033c4aae4da admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:01.939058 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956a993-0a3b-49b1-85be-4033c4aae4da admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:01.941177 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956a993-0a3b-49b1-85be-4033c4aae4da admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:01.955666 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 466/913] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:51:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:01.962309 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c01973-b3c0-45e4-8ebc-0cdee2b157b2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:01.973278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c01973-b3c0-45e4-8ebc-0cdee2b157b2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:01.978333 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570370e-cec4-408e-bfa5-5ba4bf9c88f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:01.979529 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570370e-cec4-408e-bfa5-5ba4bf9c88f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:01.980002 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570370e-cec4-408e-bfa5-5ba4bf9c88f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:01.980516 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570370e-cec4-408e-bfa5-5ba4bf9c88f5 admin admin] PATH_INFO: `/v3/projects/6160f9606d06486b9a11a23ee717af79/users/fa9ea7738c634318a532ebca2e564745/roles/7a712c9c729e424bab90590b1f232d0b` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:01.983237 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570370e-cec4-408e-bfa5-5ba4bf9c88f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6160f9606d06486b9a11a23ee717af79, user_id=fa9ea7738c634318a532ebca2e564745, role_id=7a712c9c729e424bab90590b1f232d0b)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:01.986110 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570370e-cec4-408e-bfa5-5ba4bf9c88f5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:02.076934 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 448/914] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:51:01 2022] PUT /identity/v3/projects/6160f9606d06486b9a11a23ee717af79/users/fa9ea7738c634318a532ebca2e564745/roles/7a712c9c729e424bab90590b1f232d0b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 16:51:02.193330 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1fa98-27ab-425a-9352-b80cc3d77c75 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:02.193515 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1fa98-27ab-425a-9352-b80cc3d77c75 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:02.193816 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1fa98-27ab-425a-9352-b80cc3d77c75 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:02.196641 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 467/915] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:02.202311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dbc18-2247-443f-9128-006dcb67280a None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:02.202599 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dbc18-2247-443f-9128-006dcb67280a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:02.202901 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dbc18-2247-443f-9128-006dcb67280a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:02.222267 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-985dbc18-2247-443f-9128-006dcb67280a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:02.223501 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-985dbc18-2247-443f-9128-006dcb67280a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:02.238784 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be7fb4-ca9e-4a8c-9146-d108e004a367 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:02.239092 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be7fb4-ca9e-4a8c-9146-d108e004a367 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:02.239346 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be7fb4-ca9e-4a8c-9146-d108e004a367 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:02.242078 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 468/916] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:02.247909 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4dc13-0d9a-4861-9222-33f99caab20f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:02.249070 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4dc13-0d9a-4861-9222-33f99caab20f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:02.249582 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4dc13-0d9a-4861-9222-33f99caab20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:02.271226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-3dc4dc13-0d9a-4861-9222-33f99caab20f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:02.273320 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-3dc4dc13-0d9a-4861-9222-33f99caab20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:02.295568 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 449/917] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:02 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:02.323405 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dbc18-2247-443f-9128-006dcb67280a None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:02.333389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dbc18-2247-443f-9128-006dcb67280a None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:02.338540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014486f4-5186-4925-b670-94b3feb36ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:02.339412 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014486f4-5186-4925-b670-94b3feb36ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:02.339726 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014486f4-5186-4925-b670-94b3feb36ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:02.340005 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014486f4-5186-4925-b670-94b3feb36ca7 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:02.340665 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014486f4-5186-4925-b670-94b3feb36ca7 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:02.342319 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014486f4-5186-4925-b670-94b3feb36ca7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:02.343841 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 469/918] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:02 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 16:51:02.357472 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-014486f4-5186-4925-b670-94b3feb36ca7 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 16 16:51:02.363724 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 450/919] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:51:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:51:02.365264 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4dc13-0d9a-4861-9222-33f99caab20f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:02.371785 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014486f4-5186-4925-b670-94b3feb36ca7 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:02.376310 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4dc13-0d9a-4861-9222-33f99caab20f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:02.381935 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014486f4-5186-4925-b670-94b3feb36ca7 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:02.382525 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1c1af-c11f-4073-a2dc-0342de066ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:02.383414 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1c1af-c11f-4073-a2dc-0342de066ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:02.383843 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1c1af-c11f-4073-a2dc-0342de066ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:02.384360 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1c1af-c11f-4073-a2dc-0342de066ca1 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:02.385305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1c1af-c11f-4073-a2dc-0342de066ca1 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:02.385826 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1c1af-c11f-4073-a2dc-0342de066ca1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:02.387636 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d495a-a18f-4584-be69-d1048b56f816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:02.387859 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1c1af-c11f-4073-a2dc-0342de066ca1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:02.389024 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d495a-a18f-4584-be69-d1048b56f816 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:02.389024 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d495a-a18f-4584-be69-d1048b56f816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:02.389389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d495a-a18f-4584-be69-d1048b56f816 admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:02.390217 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d495a-a18f-4584-be69-d1048b56f816 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:02.392174 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d495a-a18f-4584-be69-d1048b56f816 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:02.397151 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 470/920] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:51:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:02.403173 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1c1af-c11f-4073-a2dc-0342de066ca1 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:02.414000 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1c1af-c11f-4073-a2dc-0342de066ca1 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:02.418863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f644de-dd47-4167-a90b-ec8b6d8313db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:02.419569 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f644de-dd47-4167-a90b-ec8b6d8313db admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:02.420023 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f644de-dd47-4167-a90b-ec8b6d8313db admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:02.420364 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f644de-dd47-4167-a90b-ec8b6d8313db admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:02.421068 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f644de-dd47-4167-a90b-ec8b6d8313db admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:02.421429 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f644de-dd47-4167-a90b-ec8b6d8313db admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:02.423157 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f644de-dd47-4167-a90b-ec8b6d8313db admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:02.433434 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 471/921] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:51:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:02.434989 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f644de-dd47-4167-a90b-ec8b6d8313db admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:02.449474 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f644de-dd47-4167-a90b-ec8b6d8313db admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:02.450107 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97264be1-e563-48e4-af9a-041b4b98173f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:02.450652 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97264be1-e563-48e4-af9a-041b4b98173f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:02.450940 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97264be1-e563-48e4-af9a-041b4b98173f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:02.451211 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97264be1-e563-48e4-af9a-041b4b98173f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:02.452046 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97264be1-e563-48e4-af9a-041b4b98173f admin admin] RBAC: Adding query filter params (interface=public, service_id=1602e4ee1db648baa86058afed3c4e5e, region_id=RegionOne) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:02.452349 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97264be1-e563-48e4-af9a-041b4b98173f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:02.453927 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97264be1-e563-48e4-af9a-041b4b98173f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:02.461381 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 472/922] 10.222.0.42 () {56 vars in 1272 bytes} [Wed Feb 16 16:51:02 2022] GET /identity/v3/endpoints?service_id=1602e4ee1db648baa86058afed3c4e5e&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:02.467028 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97264be1-e563-48e4-af9a-041b4b98173f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:02.474196 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 451/923] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Feb 16 16:51:02 2022] POST /identity/v3/services => generated 241 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:51:02.479318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97264be1-e563-48e4-af9a-041b4b98173f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:02.495758 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1b2ce-5787-485e-b85c-c23c386ddf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:02.496677 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1b2ce-5787-485e-b85c-c23c386ddf3c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:02.497104 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1b2ce-5787-485e-b85c-c23c386ddf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:02.497554 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1b2ce-5787-485e-b85c-c23c386ddf3c admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:02.498386 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1b2ce-5787-485e-b85c-c23c386ddf3c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:02.500182 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1b2ce-5787-485e-b85c-c23c386ddf3c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:02.514799 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 473/924] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Feb 16 16:51:02 2022] GET /identity/v3/services => generated 1497 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 16:51:03.099946 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d187f31-d535-4f04-ab4c-07326b0d26bc None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:03.100918 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d187f31-d535-4f04-ab4c-07326b0d26bc None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:03.101070 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d187f31-d535-4f04-ab4c-07326b0d26bc None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:03.103084 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 452/925] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:03.108515 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1b3db-f0f7-40ee-881a-f5d26a458176 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:03.108807 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1b3db-f0f7-40ee-881a-f5d26a458176 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:03.109086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1b3db-f0f7-40ee-881a-f5d26a458176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:03.127127 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-f5c1b3db-f0f7-40ee-881a-f5d26a458176 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:03.128299 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f5c1b3db-f0f7-40ee-881a-f5d26a458176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:03.137042 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 474/926] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:03 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 16:51:03.159827 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d187f31-d535-4f04-ab4c-07326b0d26bc None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:03.172836 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d187f31-d535-4f04-ab4c-07326b0d26bc None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:03.177222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75424c26-664b-4f94-9b4b-63c03ccbc7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:03.178006 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75424c26-664b-4f94-9b4b-63c03ccbc7af admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:03.178931 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75424c26-664b-4f94-9b4b-63c03ccbc7af admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:03.179208 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75424c26-664b-4f94-9b4b-63c03ccbc7af admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:03.180044 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75424c26-664b-4f94-9b4b-63c03ccbc7af admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:03.181618 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75424c26-664b-4f94-9b4b-63c03ccbc7af admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:03.193009 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-75424c26-664b-4f94-9b4b-63c03ccbc7af admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 16 16:51:03.194803 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 453/927] 10.222.0.42 () {56 vars in 1153 bytes} [Wed Feb 16 16:51:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:03.200666 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1b3db-f0f7-40ee-881a-f5d26a458176 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:03.209753 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1b3db-f0f7-40ee-881a-f5d26a458176 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:03.214371 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb06833-a94b-45fa-a677-fd53832c92d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:03.215051 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb06833-a94b-45fa-a677-fd53832c92d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:03.215333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb06833-a94b-45fa-a677-fd53832c92d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:03.215609 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb06833-a94b-45fa-a677-fd53832c92d6 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:03.216312 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb06833-a94b-45fa-a677-fd53832c92d6 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:03.216616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb06833-a94b-45fa-a677-fd53832c92d6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:03.218245 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb06833-a94b-45fa-a677-fd53832c92d6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:03.223470 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 475/928] 10.222.0.42 () {56 vars in 1147 bytes} [Wed Feb 16 16:51:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:03.229845 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75424c26-664b-4f94-9b4b-63c03ccbc7af admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:03.240781 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75424c26-664b-4f94-9b4b-63c03ccbc7af admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:03.246167 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855f8ad-b000-48b1-bc5c-ced7d9055fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:03.246873 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855f8ad-b000-48b1-bc5c-ced7d9055fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:03.247153 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855f8ad-b000-48b1-bc5c-ced7d9055fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:03.247425 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855f8ad-b000-48b1-bc5c-ced7d9055fc5 admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:03.248149 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855f8ad-b000-48b1-bc5c-ced7d9055fc5 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:03.248453 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855f8ad-b000-48b1-bc5c-ced7d9055fc5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:03.250080 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855f8ad-b000-48b1-bc5c-ced7d9055fc5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:03.256016 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 454/929] 10.222.0.42 () {56 vars in 1147 bytes} [Wed Feb 16 16:51:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:03.261614 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb06833-a94b-45fa-a677-fd53832c92d6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:03.271451 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb06833-a94b-45fa-a677-fd53832c92d6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:03.276497 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd86707-b732-4c26-aeb6-9736d635a008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:03.277138 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd86707-b732-4c26-aeb6-9736d635a008 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:03.277419 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd86707-b732-4c26-aeb6-9736d635a008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:03.277691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd86707-b732-4c26-aeb6-9736d635a008 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:03.278443 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd86707-b732-4c26-aeb6-9736d635a008 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:03.280062 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd86707-b732-4c26-aeb6-9736d635a008 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:03.372343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 476/930] 10.222.0.42 () {60 vars in 1165 bytes} [Wed Feb 16 16:51:03 2022] POST /identity/v3/endpoints => generated 347 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:51:04.413631 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fabd1-22d4-4564-9b38-3c850e38436e None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:04.414423 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fabd1-22d4-4564-9b38-3c850e38436e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:04.414423 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fabd1-22d4-4564-9b38-3c850e38436e None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:04.416214 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 455/931] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:04.421561 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208fbf7-bf66-422d-a4c0-bde99942993f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:04.422057 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208fbf7-bf66-422d-a4c0-bde99942993f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:04.422250 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208fbf7-bf66-422d-a4c0-bde99942993f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:04.440474 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-e208fbf7-bf66-422d-a4c0-bde99942993f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:04.441649 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e208fbf7-bf66-422d-a4c0-bde99942993f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:04.459801 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 477/932] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:04 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:04.483812 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fabd1-22d4-4564-9b38-3c850e38436e None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:04.497293 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fabd1-22d4-4564-9b38-3c850e38436e None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:04.501908 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8562f-3413-45e1-8457-afc3d8f26985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:04.502840 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8562f-3413-45e1-8457-afc3d8f26985 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:04.503121 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8562f-3413-45e1-8457-afc3d8f26985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:04.503373 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8562f-3413-45e1-8457-afc3d8f26985 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:04.516226 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8562f-3413-45e1-8457-afc3d8f26985 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:51:04.523787 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-83d8562f-3413-45e1-8457-afc3d8f26985 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 16:51:04.525375 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 456/933] 10.222.0.42 () {56 vars in 1141 bytes} [Wed Feb 16 16:51:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:04.531339 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208fbf7-bf66-422d-a4c0-bde99942993f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:04.541635 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208fbf7-bf66-422d-a4c0-bde99942993f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:04.550589 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232610d-a175-4640-8b74-10ef6ed8e899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:04.551274 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232610d-a175-4640-8b74-10ef6ed8e899 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:04.551551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232610d-a175-4640-8b74-10ef6ed8e899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:04.551823 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232610d-a175-4640-8b74-10ef6ed8e899 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:04.552572 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232610d-a175-4640-8b74-10ef6ed8e899 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:04.552874 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232610d-a175-4640-8b74-10ef6ed8e899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:04.555297 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232610d-a175-4640-8b74-10ef6ed8e899 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:04.564299 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 478/934] 10.222.0.42 () {56 vars in 1136 bytes} [Wed Feb 16 16:51:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:04.570334 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8562f-3413-45e1-8457-afc3d8f26985 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:04.582876 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8562f-3413-45e1-8457-afc3d8f26985 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:04.587913 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69c7c7-fb88-4683-b2e3-6cbf058f1329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:04.588719 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69c7c7-fb88-4683-b2e3-6cbf058f1329 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:04.588994 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69c7c7-fb88-4683-b2e3-6cbf058f1329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:04.589262 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69c7c7-fb88-4683-b2e3-6cbf058f1329 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:04.601726 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69c7c7-fb88-4683-b2e3-6cbf058f1329 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:04.603606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69c7c7-fb88-4683-b2e3-6cbf058f1329 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:04.622753 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-2f69c7c7-fb88-4683-b2e3-6cbf058f1329 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:51:04.624332 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 457/935] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:04.630063 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232610d-a175-4640-8b74-10ef6ed8e899 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:04.640107 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232610d-a175-4640-8b74-10ef6ed8e899 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:04.644743 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4897fd-2866-49a7-a979-74ead3f0d140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:04.645390 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4897fd-2866-49a7-a979-74ead3f0d140 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:04.645665 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4897fd-2866-49a7-a979-74ead3f0d140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:04.645934 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4897fd-2866-49a7-a979-74ead3f0d140 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:04.646673 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4897fd-2866-49a7-a979-74ead3f0d140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:04.647010 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4897fd-2866-49a7-a979-74ead3f0d140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:04.648586 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4897fd-2866-49a7-a979-74ead3f0d140 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:04.660722 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 479/936] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:04.667338 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69c7c7-fb88-4683-b2e3-6cbf058f1329 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:04.686890 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69c7c7-fb88-4683-b2e3-6cbf058f1329 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:04.691434 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b781239-d4e1-42bd-b49f-82eeea184a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:04.692230 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b781239-d4e1-42bd-b49f-82eeea184a5d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:04.692510 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b781239-d4e1-42bd-b49f-82eeea184a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:04.692779 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b781239-d4e1-42bd-b49f-82eeea184a5d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:04.702711 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b781239-d4e1-42bd-b49f-82eeea184a5d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:04.704986 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b781239-d4e1-42bd-b49f-82eeea184a5d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:04.720094 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-8b781239-d4e1-42bd-b49f-82eeea184a5d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 16:51:04.721799 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 458/937] 10.222.0.42 () {56 vars in 1138 bytes} [Wed Feb 16 16:51:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:04.727803 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4897fd-2866-49a7-a979-74ead3f0d140 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:04.737975 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4897fd-2866-49a7-a979-74ead3f0d140 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:04.743516 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fff529-e97d-4ed1-a0cf-40f39c1848e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:04.744192 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fff529-e97d-4ed1-a0cf-40f39c1848e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:04.744505 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fff529-e97d-4ed1-a0cf-40f39c1848e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:04.744812 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fff529-e97d-4ed1-a0cf-40f39c1848e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:04.745694 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fff529-e97d-4ed1-a0cf-40f39c1848e9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:04.746019 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fff529-e97d-4ed1-a0cf-40f39c1848e9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:04.747911 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fff529-e97d-4ed1-a0cf-40f39c1848e9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:04.765700 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 480/938] 10.222.0.42 () {56 vars in 1170 bytes} [Wed Feb 16 16:51:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:04.771267 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b781239-d4e1-42bd-b49f-82eeea184a5d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:04.781482 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b781239-d4e1-42bd-b49f-82eeea184a5d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:04.786129 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2ac78-f7be-4634-a9b2-62313691f4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:04.786823 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2ac78-f7be-4634-a9b2-62313691f4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:04.787099 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2ac78-f7be-4634-a9b2-62313691f4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:04.787374 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2ac78-f7be-4634-a9b2-62313691f4c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:04.796200 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2ac78-f7be-4634-a9b2-62313691f4c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:04.797963 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2ac78-f7be-4634-a9b2-62313691f4c9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:04.807975 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 459/939] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:51:04 2022] GET /identity/v3/auth/tokens => generated 1952 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:51:04.813495 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fff529-e97d-4ed1-a0cf-40f39c1848e9 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:04.823753 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fff529-e97d-4ed1-a0cf-40f39c1848e9 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:04.828433 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db903df-a6cf-4e35-aa4a-25c4fc4b42dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:04.829210 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db903df-a6cf-4e35-aa4a-25c4fc4b42dd admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:04.829486 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db903df-a6cf-4e35-aa4a-25c4fc4b42dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:04.829756 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db903df-a6cf-4e35-aa4a-25c4fc4b42dd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:04.840883 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db903df-a6cf-4e35-aa4a-25c4fc4b42dd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:04.842725 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db903df-a6cf-4e35-aa4a-25c4fc4b42dd admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:04.860477 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-7db903df-a6cf-4e35-aa4a-25c4fc4b42dd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:51:04.861957 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 481/940] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:04.868492 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2ac78-f7be-4634-a9b2-62313691f4c9 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:04.875931 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34823a5c-4e49-4820-b1a1-f45a6395ad91 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:04.876216 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34823a5c-4e49-4820-b1a1-f45a6395ad91 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:04.876489 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34823a5c-4e49-4820-b1a1-f45a6395ad91 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:04.877529 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2ac78-f7be-4634-a9b2-62313691f4c9 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:04.878562 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 482/941] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:51:04.882723 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5011a-749f-4c0b-962a-7d70c27a6931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:04.883411 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5011a-749f-4c0b-962a-7d70c27a6931 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:04.883585 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d8595-102a-47c1-b762-1ccaa3070808 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:04.883738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5011a-749f-4c0b-962a-7d70c27a6931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:04.883886 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d8595-102a-47c1-b762-1ccaa3070808 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:04.884045 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5011a-749f-4c0b-962a-7d70c27a6931 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:04.884199 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d8595-102a-47c1-b762-1ccaa3070808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:04.884640 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5011a-749f-4c0b-962a-7d70c27a6931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:04.884938 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5011a-749f-4c0b-962a-7d70c27a6931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:04.886613 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5011a-749f-4c0b-962a-7d70c27a6931 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:04.899301 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 460/942] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:04.901496 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-0c6d8595-102a-47c1-b762-1ccaa3070808 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:04.902672 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0c6d8595-102a-47c1-b762-1ccaa3070808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:04.904637 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5011a-749f-4c0b-962a-7d70c27a6931 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:04.911956 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 483/943] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:04 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 16:51:04.915944 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5011a-749f-4c0b-962a-7d70c27a6931 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:04.920785 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62b55b-53cf-4b67-b5a8-1268ab497afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:04.921799 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62b55b-53cf-4b67-b5a8-1268ab497afa admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:04.922291 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62b55b-53cf-4b67-b5a8-1268ab497afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:04.922787 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62b55b-53cf-4b67-b5a8-1268ab497afa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:04.931213 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62b55b-53cf-4b67-b5a8-1268ab497afa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:04.933398 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62b55b-53cf-4b67-b5a8-1268ab497afa admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:04.938067 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d8595-102a-47c1-b762-1ccaa3070808 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:04.948796 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-7a62b55b-53cf-4b67-b5a8-1268ab497afa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:51:04.948952 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d8595-102a-47c1-b762-1ccaa3070808 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:04.951000 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 461/944] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:51:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:51:04.956170 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62b55b-53cf-4b67-b5a8-1268ab497afa admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:04.960975 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8032d2e-729e-46ea-984c-3a3205296894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:04.962053 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8032d2e-729e-46ea-984c-3a3205296894 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:04.962574 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8032d2e-729e-46ea-984c-3a3205296894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:04.963041 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8032d2e-729e-46ea-984c-3a3205296894 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:04.963837 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8032d2e-729e-46ea-984c-3a3205296894 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:04.965380 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8032d2e-729e-46ea-984c-3a3205296894 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:04.967760 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62b55b-53cf-4b67-b5a8-1268ab497afa admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:04.973057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728959f-97c4-491c-8ef5-51e7b8e4dd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:04.973952 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728959f-97c4-491c-8ef5-51e7b8e4dd1d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:04.974425 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728959f-97c4-491c-8ef5-51e7b8e4dd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:04.974960 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728959f-97c4-491c-8ef5-51e7b8e4dd1d admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:04.976124 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728959f-97c4-491c-8ef5-51e7b8e4dd1d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:04.976625 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728959f-97c4-491c-8ef5-51e7b8e4dd1d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:04.977891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-a8032d2e-729e-46ea-984c-3a3205296894 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 16:51:04.978905 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728959f-97c4-491c-8ef5-51e7b8e4dd1d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:04.984277 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 484/945] 10.222.0.42 () {56 vars in 1147 bytes} [Wed Feb 16 16:51:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:04.985293 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8032d2e-729e-46ea-984c-3a3205296894 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:04.993665 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 462/946] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:51:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:04.998516 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8032d2e-729e-46ea-984c-3a3205296894 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:04.999652 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728959f-97c4-491c-8ef5-51e7b8e4dd1d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:05.000443 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b52fbb-339c-4e8d-9550-679fa41bd7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:05.001265 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b52fbb-339c-4e8d-9550-679fa41bd7db admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:05.001543 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b52fbb-339c-4e8d-9550-679fa41bd7db admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:05.001814 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b52fbb-339c-4e8d-9550-679fa41bd7db admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:05.002507 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b52fbb-339c-4e8d-9550-679fa41bd7db admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:05.002844 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b52fbb-339c-4e8d-9550-679fa41bd7db admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:05.004462 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b52fbb-339c-4e8d-9550-679fa41bd7db admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:05.010187 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 485/947] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Feb 16 16:51:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:05.012981 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728959f-97c4-491c-8ef5-51e7b8e4dd1d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:05.015622 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b52fbb-339c-4e8d-9550-679fa41bd7db admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:05.018956 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b220b8-f37b-457b-90f0-adcfb7321f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:05.019861 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b220b8-f37b-457b-90f0-adcfb7321f73 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:05.020395 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b220b8-f37b-457b-90f0-adcfb7321f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:05.021111 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b220b8-f37b-457b-90f0-adcfb7321f73 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:05.022815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b220b8-f37b-457b-90f0-adcfb7321f73 admin admin] RBAC: Adding query filter params (role.id=7a712c9c729e424bab90590b1f232d0b, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=fa9ea7738c634318a532ebca2e564745) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:05.023354 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b220b8-f37b-457b-90f0-adcfb7321f73 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:05.025685 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b220b8-f37b-457b-90f0-adcfb7321f73 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:05.026005 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b52fbb-339c-4e8d-9550-679fa41bd7db admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:05.030443 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddddbd-0b1f-4740-b8d4-1b4692aeaba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:05.031125 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddddbd-0b1f-4740-b8d4-1b4692aeaba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:05.031403 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddddbd-0b1f-4740-b8d4-1b4692aeaba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:05.031670 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddddbd-0b1f-4740-b8d4-1b4692aeaba5 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:05.032357 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daddddbd-0b1f-4740-b8d4-1b4692aeaba5 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:05.032818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daddddbd-0b1f-4740-b8d4-1b4692aeaba5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:05.032917 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 463/948] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:51:04 2022] GET /identity/v3/role_assignments?user.id=fa9ea7738c634318a532ebca2e564745&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=7a712c9c729e424bab90590b1f232d0b => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:05.033929 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd31c89-1453-458b-87eb-3ecb817616f8 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:05.034245 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd31c89-1453-458b-87eb-3ecb817616f8 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:05.034355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daddddbd-0b1f-4740-b8d4-1b4692aeaba5 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:05.034536 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd31c89-1453-458b-87eb-3ecb817616f8 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:05.036838 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 464/949] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:05.042518 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0e3fd-6668-47e3-a28f-e1bcbdaeecbc None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:05.042849 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0e3fd-6668-47e3-a28f-e1bcbdaeecbc None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:05.043129 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0e3fd-6668-47e3-a28f-e1bcbdaeecbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:05.043678 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 486/950] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Feb 16 16:51:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:05.049539 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddddbd-0b1f-4740-b8d4-1b4692aeaba5 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:05.060215 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddddbd-0b1f-4740-b8d4-1b4692aeaba5 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:05.065104 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f5a25-60b6-4cd9-a895-25003b4acc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:05.065763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f5a25-60b6-4cd9-a895-25003b4acc1a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:05.066090 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f5a25-60b6-4cd9-a895-25003b4acc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:05.066363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f5a25-60b6-4cd9-a895-25003b4acc1a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:05.067233 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f5a25-60b6-4cd9-a895-25003b4acc1a admin admin] RBAC: Adding query filter params (interface=public, service_id=2f261264593c4bddbb538917431d9a95, region_id=RegionOne) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:05.067473 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-c6c0e3fd-6668-47e3-a28f-e1bcbdaeecbc None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:05.067585 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f5a25-60b6-4cd9-a895-25003b4acc1a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:05.068741 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-c6c0e3fd-6668-47e3-a28f-e1bcbdaeecbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:05.069858 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f5a25-60b6-4cd9-a895-25003b4acc1a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:05.079028 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 465/951] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:05 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 16:51:05.082852 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 487/952] 10.222.0.42 () {56 vars in 1272 bytes} [Wed Feb 16 16:51:05 2022] GET /identity/v3/endpoints?service_id=2f261264593c4bddbb538917431d9a95&interface=public®ion_id=RegionOne => generated 194 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:05.094668 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0e3fd-6668-47e3-a28f-e1bcbdaeecbc None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:05.104218 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f5a25-60b6-4cd9-a895-25003b4acc1a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:05.105111 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0e3fd-6668-47e3-a28f-e1bcbdaeecbc None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:05.110356 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958bf59-8936-4ba3-992a-5c77e0f41af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:05.111106 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958bf59-8936-4ba3-992a-5c77e0f41af1 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:05.111382 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958bf59-8936-4ba3-992a-5c77e0f41af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:05.111653 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958bf59-8936-4ba3-992a-5c77e0f41af1 admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:05.112400 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958bf59-8936-4ba3-992a-5c77e0f41af1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:05.114082 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958bf59-8936-4ba3-992a-5c77e0f41af1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:05.115562 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f5a25-60b6-4cd9-a895-25003b4acc1a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:05.120971 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709e69c-7a45-4981-939b-de5abf93cc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:05.121766 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709e69c-7a45-4981-939b-de5abf93cc52 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:05.122046 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709e69c-7a45-4981-939b-de5abf93cc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:05.122320 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709e69c-7a45-4981-939b-de5abf93cc52 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:05.122585 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 466/953] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Feb 16 16:51:05 2022] GET /identity/v3/services => generated 1497 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 16:51:05.123004 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709e69c-7a45-4981-939b-de5abf93cc52 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:05.124604 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709e69c-7a45-4981-939b-de5abf93cc52 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:05.140075 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-c709e69c-7a45-4981-939b-de5abf93cc52 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 16 16:51:05.141750 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 488/954] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:51:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:51:05.148429 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958bf59-8936-4ba3-992a-5c77e0f41af1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:05.160399 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958bf59-8936-4ba3-992a-5c77e0f41af1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:05.166081 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa378e-291a-4574-84c1-e652332636cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:05.166848 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa378e-291a-4574-84c1-e652332636cf admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:05.167187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa378e-291a-4574-84c1-e652332636cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:05.167465 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa378e-291a-4574-84c1-e652332636cf admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:05.168245 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa378e-291a-4574-84c1-e652332636cf admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:05.168554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa378e-291a-4574-84c1-e652332636cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:05.170337 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa378e-291a-4574-84c1-e652332636cf admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:05.176399 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 467/955] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:51:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:05.182235 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709e69c-7a45-4981-939b-de5abf93cc52 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:05.194092 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709e69c-7a45-4981-939b-de5abf93cc52 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:05.199321 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede4792-711e-492e-8a4a-401b16c0e299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:05.200070 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede4792-711e-492e-8a4a-401b16c0e299 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:05.200336 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede4792-711e-492e-8a4a-401b16c0e299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:05.200607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede4792-711e-492e-8a4a-401b16c0e299 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:05.201387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede4792-711e-492e-8a4a-401b16c0e299 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:05.201691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede4792-711e-492e-8a4a-401b16c0e299 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:05.203424 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede4792-711e-492e-8a4a-401b16c0e299 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:05.210512 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 489/956] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Feb 16 16:51:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:05.216503 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa378e-291a-4574-84c1-e652332636cf admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:05.227811 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa378e-291a-4574-84c1-e652332636cf admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:05.233293 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ed592-7b34-4de9-a754-ab9dcb1e0ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:05.234030 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ed592-7b34-4de9-a754-ab9dcb1e0ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:05.234317 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ed592-7b34-4de9-a754-ab9dcb1e0ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:05.234592 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ed592-7b34-4de9-a754-ab9dcb1e0ad6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:05.235472 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ed592-7b34-4de9-a754-ab9dcb1e0ad6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:05.237189 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ed592-7b34-4de9-a754-ab9dcb1e0ad6 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:05.325158 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 468/957] 10.222.0.42 () {60 vars in 1165 bytes} [Wed Feb 16 16:51:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:51:05.853219 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357803a2-fa22-4616-896c-a5dd90769a0d None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:05.853724 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357803a2-fa22-4616-896c-a5dd90769a0d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:05.853724 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357803a2-fa22-4616-896c-a5dd90769a0d None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:05.855614 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 490/958] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:05.863321 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc565ee-5cce-4809-a5f1-a1b9c891f37e None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:05.863321 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc565ee-5cce-4809-a5f1-a1b9c891f37e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:05.863321 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc565ee-5cce-4809-a5f1-a1b9c891f37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:05.882751 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-7cc565ee-5cce-4809-a5f1-a1b9c891f37e None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:05.884296 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-7cc565ee-5cce-4809-a5f1-a1b9c891f37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:05.901509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 469/959] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:05 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:05.926250 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357803a2-fa22-4616-896c-a5dd90769a0d None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:05.939843 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357803a2-fa22-4616-896c-a5dd90769a0d None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:05.944951 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77602ebb-ef19-4bb0-8f16-92e80d39e7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:05.945976 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77602ebb-ef19-4bb0-8f16-92e80d39e7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:05.946480 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77602ebb-ef19-4bb0-8f16-92e80d39e7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:05.947004 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77602ebb-ef19-4bb0-8f16-92e80d39e7b1 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:05.947899 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77602ebb-ef19-4bb0-8f16-92e80d39e7b1 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:05.949702 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77602ebb-ef19-4bb0-8f16-92e80d39e7b1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:05.962027 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-77602ebb-ef19-4bb0-8f16-92e80d39e7b1 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 16 16:51:05.963770 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 491/960] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:51:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:05.969978 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc565ee-5cce-4809-a5f1-a1b9c891f37e None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:05.979950 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc565ee-5cce-4809-a5f1-a1b9c891f37e None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:05.985148 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f384ac-62de-47bb-9baa-8f679da70393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:05.986026 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f384ac-62de-47bb-9baa-8f679da70393 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:05.986537 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f384ac-62de-47bb-9baa-8f679da70393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:05.987048 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f384ac-62de-47bb-9baa-8f679da70393 admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:05.987966 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f384ac-62de-47bb-9baa-8f679da70393 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:05.988521 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f384ac-62de-47bb-9baa-8f679da70393 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:05.990294 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f384ac-62de-47bb-9baa-8f679da70393 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:05.995899 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 470/961] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Feb 16 16:51:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:06.001638 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77602ebb-ef19-4bb0-8f16-92e80d39e7b1 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:06.011855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77602ebb-ef19-4bb0-8f16-92e80d39e7b1 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:06.017456 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73331d2-73bf-4989-ad5b-6668095006d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:06.018589 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73331d2-73bf-4989-ad5b-6668095006d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:06.019115 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73331d2-73bf-4989-ad5b-6668095006d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:06.019661 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73331d2-73bf-4989-ad5b-6668095006d9 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:06.020620 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73331d2-73bf-4989-ad5b-6668095006d9 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:06.021132 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73331d2-73bf-4989-ad5b-6668095006d9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:06.023559 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73331d2-73bf-4989-ad5b-6668095006d9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:06.029268 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 492/962] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Feb 16 16:51:06 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:07.497365 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3bda7-e335-4d63-8bf5-16b7e37f4ea7 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:07.497988 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3bda7-e335-4d63-8bf5-16b7e37f4ea7 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:07.497988 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3bda7-e335-4d63-8bf5-16b7e37f4ea7 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:07.499923 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 471/963] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:07.505223 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c624881-ebbc-4a72-b643-c2b6a66dcc3a None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:07.505642 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c624881-ebbc-4a72-b643-c2b6a66dcc3a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:07.505834 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c624881-ebbc-4a72-b643-c2b6a66dcc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:07.526630 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-4c624881-ebbc-4a72-b643-c2b6a66dcc3a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:07.527916 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-4c624881-ebbc-4a72-b643-c2b6a66dcc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:07.535980 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 493/964] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:07 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:07.559895 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3bda7-e335-4d63-8bf5-16b7e37f4ea7 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:07.573578 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3bda7-e335-4d63-8bf5-16b7e37f4ea7 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:07.578486 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1998858-1705-4e8f-9c6f-049471ecc782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:07.579301 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1998858-1705-4e8f-9c6f-049471ecc782 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:07.579580 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1998858-1705-4e8f-9c6f-049471ecc782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:07.579942 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1998858-1705-4e8f-9c6f-049471ecc782 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:07.580595 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1998858-1705-4e8f-9c6f-049471ecc782 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:07.581402 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d683206-ea4b-4292-bedd-bb19d0ff731a None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:07.581687 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d683206-ea4b-4292-bedd-bb19d0ff731a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:07.581959 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d683206-ea4b-4292-bedd-bb19d0ff731a None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:07.582225 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1998858-1705-4e8f-9c6f-049471ecc782 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:07.587010 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 494/965] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:51:07.589377 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62ff75-5f95-4cc6-a6e8-aa3a18097754 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:07.589661 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62ff75-5f95-4cc6-a6e8-aa3a18097754 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:07.589931 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62ff75-5f95-4cc6-a6e8-aa3a18097754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:07.598382 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-a1998858-1705-4e8f-9c6f-049471ecc782 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 16 16:51:07.600133 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 472/966] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Feb 16 16:51:07 2022] GET /identity/v3/services/image => generated 86 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:07.606114 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1998858-1705-4e8f-9c6f-049471ecc782 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:07.609610 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-ec62ff75-5f95-4cc6-a6e8-aa3a18097754 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:07.610834 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-ec62ff75-5f95-4cc6-a6e8-aa3a18097754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:07.619151 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1998858-1705-4e8f-9c6f-049471ecc782 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:07.626669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 495/967] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:07 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 16:51:07.629644 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed129e7-d046-49f7-b10c-bc3252dab9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:07.630294 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed129e7-d046-49f7-b10c-bc3252dab9ad admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:07.630572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed129e7-d046-49f7-b10c-bc3252dab9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:07.630871 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed129e7-d046-49f7-b10c-bc3252dab9ad admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:07.632061 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed129e7-d046-49f7-b10c-bc3252dab9ad admin admin] RBAC: Adding query filter params (name=image) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:07.632367 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed129e7-d046-49f7-b10c-bc3252dab9ad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:07.633934 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed129e7-d046-49f7-b10c-bc3252dab9ad admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:07.639333 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 473/968] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:07.647610 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed129e7-d046-49f7-b10c-bc3252dab9ad admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:07.647760 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62ff75-5f95-4cc6-a6e8-aa3a18097754 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:07.657575 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed129e7-d046-49f7-b10c-bc3252dab9ad admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:07.657896 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62ff75-5f95-4cc6-a6e8-aa3a18097754 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:07.663271 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586c151-9710-4e0a-84e7-6ca43a9a59ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:07.663922 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25027c2-9900-48fb-b6af-2de061638641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:07.664418 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586c151-9710-4e0a-84e7-6ca43a9a59ff admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:07.664713 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25027c2-9900-48fb-b6af-2de061638641 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:07.664989 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25027c2-9900-48fb-b6af-2de061638641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:07.665258 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25027c2-9900-48fb-b6af-2de061638641 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:07.665549 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586c151-9710-4e0a-84e7-6ca43a9a59ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:07.665907 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25027c2-9900-48fb-b6af-2de061638641 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:07.666225 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586c151-9710-4e0a-84e7-6ca43a9a59ff admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:07.667173 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586c151-9710-4e0a-84e7-6ca43a9a59ff admin admin] RBAC: Adding query filter params (type=image) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:07.667528 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25027c2-9900-48fb-b6af-2de061638641 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:07.667884 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586c151-9710-4e0a-84e7-6ca43a9a59ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:07.669655 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586c151-9710-4e0a-84e7-6ca43a9a59ff admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:07.681421 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-f25027c2-9900-48fb-b6af-2de061638641 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 16:51:07.682111 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 474/969] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:07.687115 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 496/970] 10.222.0.42 () {56 vars in 1147 bytes} [Wed Feb 16 16:51:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:51:07.689162 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586c151-9710-4e0a-84e7-6ca43a9a59ff admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:07.701240 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586c151-9710-4e0a-84e7-6ca43a9a59ff admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:07.706231 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aac193-e025-4083-a0a2-df7dcd9c2902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:07.706934 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aac193-e025-4083-a0a2-df7dcd9c2902 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:07.707210 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aac193-e025-4083-a0a2-df7dcd9c2902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:07.707482 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aac193-e025-4083-a0a2-df7dcd9c2902 admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:07.708207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aac193-e025-4083-a0a2-df7dcd9c2902 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:07.708513 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aac193-e025-4083-a0a2-df7dcd9c2902 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:07.710939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aac193-e025-4083-a0a2-df7dcd9c2902 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:07.716810 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 475/971] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Feb 16 16:51:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:07.720550 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6bd9c-6b1f-4af2-8acb-c2a5f22b307c None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:07.720550 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6bd9c-6b1f-4af2-8acb-c2a5f22b307c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:07.720550 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6bd9c-6b1f-4af2-8acb-c2a5f22b307c None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:07.722444 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aac193-e025-4083-a0a2-df7dcd9c2902 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:07.722708 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 497/972] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:07.728777 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29750c43-e1d3-4534-97d4-216d95a4d8ad None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:07.729079 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29750c43-e1d3-4534-97d4-216d95a4d8ad None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:07.729325 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29750c43-e1d3-4534-97d4-216d95a4d8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:07.733990 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aac193-e025-4083-a0a2-df7dcd9c2902 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:07.740068 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569e6da-ead0-4c8f-9f8e-cb64ec09bf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:07.741568 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569e6da-ead0-4c8f-9f8e-cb64ec09bf00 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:07.741869 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569e6da-ead0-4c8f-9f8e-cb64ec09bf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:07.742143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569e6da-ead0-4c8f-9f8e-cb64ec09bf00 admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:07.742985 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569e6da-ead0-4c8f-9f8e-cb64ec09bf00 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:07.743917 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569e6da-ead0-4c8f-9f8e-cb64ec09bf00 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:07.745636 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569e6da-ead0-4c8f-9f8e-cb64ec09bf00 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:07.754393 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-29750c43-e1d3-4534-97d4-216d95a4d8ad None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:07.754568 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 476/973] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Feb 16 16:51:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:07.757972 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-29750c43-e1d3-4534-97d4-216d95a4d8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:07.761869 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569e6da-ead0-4c8f-9f8e-cb64ec09bf00 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:07.765598 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 498/974] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:07 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 16:51:07.774053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569e6da-ead0-4c8f-9f8e-cb64ec09bf00 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:07.778980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952b598-2543-4ebe-871a-cf6c3dbf0cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:07.779748 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952b598-2543-4ebe-871a-cf6c3dbf0cfa admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:07.780100 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952b598-2543-4ebe-871a-cf6c3dbf0cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:07.780442 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952b598-2543-4ebe-871a-cf6c3dbf0cfa admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:07.781353 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952b598-2543-4ebe-871a-cf6c3dbf0cfa admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:07.783275 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952b598-2543-4ebe-871a-cf6c3dbf0cfa admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:07.793316 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29750c43-e1d3-4534-97d4-216d95a4d8ad None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:07.803455 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29750c43-e1d3-4534-97d4-216d95a4d8ad None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:07.809387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0e915-ea63-4158-806a-e96a57fb69b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:07.809387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0e915-ea63-4158-806a-e96a57fb69b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:07.809387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0e915-ea63-4158-806a-e96a57fb69b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:07.809387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0e915-ea63-4158-806a-e96a57fb69b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:07.810160 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0e915-ea63-4158-806a-e96a57fb69b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:07.812156 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0e915-ea63-4158-806a-e96a57fb69b5 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:07.813592 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.common [None req-66b0e915-ea63-4158-806a-e96a57fb69b5 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 16 16:51:07.867566 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.sql.core [None req-66b0e915-ea63-4158-806a-e96a57fb69b5 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 16 16:51:07.867566 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 16 16:51:07.867566 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [parameters: {'id': 'c89ed18ae0a24724947bc5f777be3c49', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 16 16:51:07.867566 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79469) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 16 16:51:07.875315 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 477/975] 10.222.0.42 () {60 vars in 1165 bytes} [Wed Feb 16 16:51:07 2022] POST /identity/v3/endpoints => generated 349 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:51:07.886183 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-66b0e915-ea63-4158-806a-e96a57fb69b5 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c89ed18ae0a24724947bc5f777be3c49.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c89ed18ae0a24724947bc5f777be3c49. Feb 16 16:51:07.888259 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 499/976] 10.222.0.42 () {60 vars in 1161 bytes} [Wed Feb 16 16:51:07 2022] POST /identity/v3/projects => generated 262 bytes in 95 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:51:07.894011 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952b598-2543-4ebe-871a-cf6c3dbf0cfa admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:07.919206 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952b598-2543-4ebe-871a-cf6c3dbf0cfa admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:07.925503 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f373b3-43f0-41b1-abc3-05e8d1a2a783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:07.926442 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f373b3-43f0-41b1-abc3-05e8d1a2a783 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:07.926879 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f373b3-43f0-41b1-abc3-05e8d1a2a783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:07.927338 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f373b3-43f0-41b1-abc3-05e8d1a2a783 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:07.940286 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f373b3-43f0-41b1-abc3-05e8d1a2a783 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:07.942341 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f373b3-43f0-41b1-abc3-05e8d1a2a783 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:07.958311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-e2f373b3-43f0-41b1-abc3-05e8d1a2a783 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:51:07.960581 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 478/977] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:51:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:51:07.967103 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0e915-ea63-4158-806a-e96a57fb69b5 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:07.980283 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0e915-ea63-4158-806a-e96a57fb69b5 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:07.985496 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22151e91-ccc1-4d50-921a-153dd495327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:07.986169 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22151e91-ccc1-4d50-921a-153dd495327b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:07.986448 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22151e91-ccc1-4d50-921a-153dd495327b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:07.986763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22151e91-ccc1-4d50-921a-153dd495327b admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:07.987591 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22151e91-ccc1-4d50-921a-153dd495327b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:07.987906 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22151e91-ccc1-4d50-921a-153dd495327b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:07.990158 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22151e91-ccc1-4d50-921a-153dd495327b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:08.015007 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 500/978] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Feb 16 16:51:07 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:08.466174 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9a52e-94ae-410e-ba48-94f64d55d85e None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:08.466459 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9a52e-94ae-410e-ba48-94f64d55d85e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:08.466767 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9a52e-94ae-410e-ba48-94f64d55d85e None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:08.468820 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 479/979] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:08.474330 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de14eb-0474-4121-b662-ce794a7c188d None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:08.474622 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de14eb-0474-4121-b662-ce794a7c188d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:08.475482 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de14eb-0474-4121-b662-ce794a7c188d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:08.494489 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-92de14eb-0474-4121-b662-ce794a7c188d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:08.496102 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-92de14eb-0474-4121-b662-ce794a7c188d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:08.504319 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 501/980] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:08 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:08.528580 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9a52e-94ae-410e-ba48-94f64d55d85e None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:08.541928 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9a52e-94ae-410e-ba48-94f64d55d85e None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:08.546664 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3197c-4d16-49bb-8cb6-c6f25cde0eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:08.547311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3197c-4d16-49bb-8cb6-c6f25cde0eac admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:08.547571 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3197c-4d16-49bb-8cb6-c6f25cde0eac admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:08.547846 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3197c-4d16-49bb-8cb6-c6f25cde0eac admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:08.548738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3197c-4d16-49bb-8cb6-c6f25cde0eac admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:08.550306 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3197c-4d16-49bb-8cb6-c6f25cde0eac admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:08.634934 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 480/981] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Feb 16 16:51:08 2022] POST /identity/v3/services => generated 242 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 16:51:10.136305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234a73e-2689-465d-a6e9-928e0f9dd031 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:10.137040 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234a73e-2689-465d-a6e9-928e0f9dd031 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:10.137040 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234a73e-2689-465d-a6e9-928e0f9dd031 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:10.138943 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 502/982] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:10.144363 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fb5f5-f76e-4336-8a37-8d608d9888cf None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:10.144875 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fb5f5-f76e-4336-8a37-8d608d9888cf None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:10.145039 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fb5f5-f76e-4336-8a37-8d608d9888cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:10.163975 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-ae7fb5f5-f76e-4336-8a37-8d608d9888cf None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:10.165159 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-ae7fb5f5-f76e-4336-8a37-8d608d9888cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:10.186786 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 481/983] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:10 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:10.206244 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234a73e-2689-465d-a6e9-928e0f9dd031 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:10.223608 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234a73e-2689-465d-a6e9-928e0f9dd031 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:10.228155 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914e119-e007-4068-8c61-ee198b4d2ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:10.228807 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914e119-e007-4068-8c61-ee198b4d2ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:10.229085 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914e119-e007-4068-8c61-ee198b4d2ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:10.229361 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914e119-e007-4068-8c61-ee198b4d2ac9 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:10.230097 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914e119-e007-4068-8c61-ee198b4d2ac9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:10.231845 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914e119-e007-4068-8c61-ee198b4d2ac9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:10.241501 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac9bcb-0a51-4c98-86bd-c1cff3da4125 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:10.241802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac9bcb-0a51-4c98-86bd-c1cff3da4125 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:10.242093 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac9bcb-0a51-4c98-86bd-c1cff3da4125 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:10.244378 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 482/984] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:10.249423 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a15708-b22b-47f4-92e4-fb32128f2a97 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:10.252860 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a15708-b22b-47f4-92e4-fb32128f2a97 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:10.252860 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a15708-b22b-47f4-92e4-fb32128f2a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:10.275523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-c9a15708-b22b-47f4-92e4-fb32128f2a97 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:10.276766 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-c9a15708-b22b-47f4-92e4-fb32128f2a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:10.286680 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 483/985] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:10 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 16:51:10.310584 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a15708-b22b-47f4-92e4-fb32128f2a97 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:10.322710 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a15708-b22b-47f4-92e4-fb32128f2a97 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:10.323104 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 503/986] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Feb 16 16:51:10 2022] POST /identity/v3/services => generated 242 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:51:10.338311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71bd64-c289-4f37-9ab5-b437f63e4849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:10.339159 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71bd64-c289-4f37-9ab5-b437f63e4849 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:10.339441 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71bd64-c289-4f37-9ab5-b437f63e4849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:10.339715 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71bd64-c289-4f37-9ab5-b437f63e4849 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:10.340373 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71bd64-c289-4f37-9ab5-b437f63e4849 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:10.341999 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71bd64-c289-4f37-9ab5-b437f63e4849 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:10.355533 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-0b71bd64-c289-4f37-9ab5-b437f63e4849 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 16:51:10.357380 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 484/987] 10.222.0.42 () {56 vars in 1147 bytes} [Wed Feb 16 16:51:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:51:10.363541 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914e119-e007-4068-8c61-ee198b4d2ac9 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:10.378603 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914e119-e007-4068-8c61-ee198b4d2ac9 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:10.384572 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560799b-d141-4374-9585-ae0f300e3848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:10.385602 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560799b-d141-4374-9585-ae0f300e3848 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:10.386087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560799b-d141-4374-9585-ae0f300e3848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:10.386598 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560799b-d141-4374-9585-ae0f300e3848 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:10.387683 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560799b-d141-4374-9585-ae0f300e3848 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:10.388422 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560799b-d141-4374-9585-ae0f300e3848 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:10.390434 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560799b-d141-4374-9585-ae0f300e3848 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:10.398437 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 504/988] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Feb 16 16:51:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:10.404721 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71bd64-c289-4f37-9ab5-b437f63e4849 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:10.417236 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71bd64-c289-4f37-9ab5-b437f63e4849 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:10.422670 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89c4ce-cae6-4378-9fef-54d9e475ecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:10.423617 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89c4ce-cae6-4378-9fef-54d9e475ecfb admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:10.424096 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89c4ce-cae6-4378-9fef-54d9e475ecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:10.424551 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89c4ce-cae6-4378-9fef-54d9e475ecfb admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:10.425544 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89c4ce-cae6-4378-9fef-54d9e475ecfb admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:10.426141 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89c4ce-cae6-4378-9fef-54d9e475ecfb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:10.428106 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89c4ce-cae6-4378-9fef-54d9e475ecfb admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:10.435368 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 485/989] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Feb 16 16:51:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:10.441695 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560799b-d141-4374-9585-ae0f300e3848 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:10.453426 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560799b-d141-4374-9585-ae0f300e3848 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:10.458812 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e3aae-2bdc-4af6-8d87-0c679610a934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:10.461077 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e3aae-2bdc-4af6-8d87-0c679610a934 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:10.461549 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e3aae-2bdc-4af6-8d87-0c679610a934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:10.462016 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e3aae-2bdc-4af6-8d87-0c679610a934 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:10.463112 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e3aae-2bdc-4af6-8d87-0c679610a934 admin admin] RBAC: Adding query filter params (interface=admin, service_id=2f261264593c4bddbb538917431d9a95, region_id=RegionOne) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:10.463606 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e3aae-2bdc-4af6-8d87-0c679610a934 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:10.465475 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e3aae-2bdc-4af6-8d87-0c679610a934 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:10.472830 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9f3b2-9e23-4fd7-9694-1ccf5447f9a7 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:10.473393 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 505/990] 10.222.0.42 () {56 vars in 1270 bytes} [Wed Feb 16 16:51:10 2022] GET /identity/v3/endpoints?service_id=2f261264593c4bddbb538917431d9a95&interface=admin®ion_id=RegionOne => generated 193 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:10.473708 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9f3b2-9e23-4fd7-9694-1ccf5447f9a7 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:10.474703 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9f3b2-9e23-4fd7-9694-1ccf5447f9a7 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:10.477514 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 486/991] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:51:10.479796 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e3aae-2bdc-4af6-8d87-0c679610a934 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:10.483297 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e75b55-4fcf-4bd7-b3d4-19a20dfc5bf5 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:10.483579 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e75b55-4fcf-4bd7-b3d4-19a20dfc5bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:10.483857 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e75b55-4fcf-4bd7-b3d4-19a20dfc5bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:10.491134 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e3aae-2bdc-4af6-8d87-0c679610a934 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:10.496945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbe938-b1f7-4a39-b780-0b22031ab30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:10.497615 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbe938-b1f7-4a39-b780-0b22031ab30d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:10.497947 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbe938-b1f7-4a39-b780-0b22031ab30d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:10.498225 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbe938-b1f7-4a39-b780-0b22031ab30d admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:10.499001 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbe938-b1f7-4a39-b780-0b22031ab30d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:10.500729 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbe938-b1f7-4a39-b780-0b22031ab30d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:10.505528 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-61e75b55-4fcf-4bd7-b3d4-19a20dfc5bf5 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:10.507427 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-61e75b55-4fcf-4bd7-b3d4-19a20dfc5bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:10.510736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 506/992] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Feb 16 16:51:10 2022] GET /identity/v3/services => generated 1957 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 16:51:10.522117 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 487/993] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:10 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 16:51:10.549608 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbe938-b1f7-4a39-b780-0b22031ab30d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:10.560691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbe938-b1f7-4a39-b780-0b22031ab30d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:10.567763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606c0b5-bbd3-4634-8bbb-faf3dab62f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:10.568829 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606c0b5-bbd3-4634-8bbb-faf3dab62f03 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:10.568829 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606c0b5-bbd3-4634-8bbb-faf3dab62f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:10.569500 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606c0b5-bbd3-4634-8bbb-faf3dab62f03 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:10.569862 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606c0b5-bbd3-4634-8bbb-faf3dab62f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:10.571915 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606c0b5-bbd3-4634-8bbb-faf3dab62f03 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:10.637574 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.sql.core [None req-9606c0b5-bbd3-4634-8bbb-faf3dab62f03 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 16 16:51:10.637574 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 16 16:51:10.637574 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [parameters: {'user_id': '2a6fd911200e4a1e8f97b7061b9ea2a7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 16 16:51:10.637574 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79469) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 16 16:51:10.644521 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-9606c0b5-bbd3-4634-8bbb-faf3dab62f03 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 16 16:51:10.647433 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 507/994] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 16:51:10 2022] POST /identity/v3/users => generated 160 bytes in 98 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:10.653914 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e75b55-4fcf-4bd7-b3d4-19a20dfc5bf5 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:10.664437 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e75b55-4fcf-4bd7-b3d4-19a20dfc5bf5 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:10.669469 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37f332-e449-4224-a632-cb893497240f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:10.670305 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37f332-e449-4224-a632-cb893497240f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:10.670587 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37f332-e449-4224-a632-cb893497240f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:10.670903 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37f332-e449-4224-a632-cb893497240f admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:10.680219 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37f332-e449-4224-a632-cb893497240f admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:10.682741 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37f332-e449-4224-a632-cb893497240f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:10.699508 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-6a37f332-e449-4224-a632-cb893497240f admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 16 16:51:10.701503 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 488/995] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:51:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:10.707643 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606c0b5-bbd3-4634-8bbb-faf3dab62f03 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:10.718845 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606c0b5-bbd3-4634-8bbb-faf3dab62f03 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:10.725339 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19794d-c8cb-4c57-a2d1-691d343ff7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:10.725339 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19794d-c8cb-4c57-a2d1-691d343ff7be admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:10.725339 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19794d-c8cb-4c57-a2d1-691d343ff7be admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:10.725678 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19794d-c8cb-4c57-a2d1-691d343ff7be admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:10.726467 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19794d-c8cb-4c57-a2d1-691d343ff7be admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:10.726804 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19794d-c8cb-4c57-a2d1-691d343ff7be admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:10.728887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19794d-c8cb-4c57-a2d1-691d343ff7be admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:10.774919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 508/996] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Feb 16 16:51:10 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:11.025022 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be4b37-3996-41e2-88f7-48779eb9c1b0 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:11.025644 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be4b37-3996-41e2-88f7-48779eb9c1b0 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:11.026119 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be4b37-3996-41e2-88f7-48779eb9c1b0 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:11.028549 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 489/997] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:11.033695 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0362a3f-8871-4b69-8b3f-524e7420a104 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:11.033988 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0362a3f-8871-4b69-8b3f-524e7420a104 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:11.034266 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0362a3f-8871-4b69-8b3f-524e7420a104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:11.053530 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-a0362a3f-8871-4b69-8b3f-524e7420a104 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:11.055476 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a0362a3f-8871-4b69-8b3f-524e7420a104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:11.064431 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 509/998] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:11 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:11.088809 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be4b37-3996-41e2-88f7-48779eb9c1b0 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:11.101936 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be4b37-3996-41e2-88f7-48779eb9c1b0 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:11.106626 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90829b6f-051e-4f72-bee0-a3ee926d296a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:11.107689 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90829b6f-051e-4f72-bee0-a3ee926d296a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:11.107970 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90829b6f-051e-4f72-bee0-a3ee926d296a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:11.108243 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90829b6f-051e-4f72-bee0-a3ee926d296a admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:11.108889 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90829b6f-051e-4f72-bee0-a3ee926d296a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:11.110451 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90829b6f-051e-4f72-bee0-a3ee926d296a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:11.121570 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-90829b6f-051e-4f72-bee0-a3ee926d296a admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 16 16:51:11.122890 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 490/999] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:51:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:11.128678 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0362a3f-8871-4b69-8b3f-524e7420a104 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:11.137755 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0362a3f-8871-4b69-8b3f-524e7420a104 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:11.142379 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e06ac1-3a13-4a89-ab03-929b60855de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:11.143131 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e06ac1-3a13-4a89-ab03-929b60855de3 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:11.143483 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e06ac1-3a13-4a89-ab03-929b60855de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:11.143835 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e06ac1-3a13-4a89-ab03-929b60855de3 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:11.144647 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e06ac1-3a13-4a89-ab03-929b60855de3 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:11.145020 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e06ac1-3a13-4a89-ab03-929b60855de3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:11.147281 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e06ac1-3a13-4a89-ab03-929b60855de3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:11.152552 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 510/1000] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Feb 16 16:51:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:11.158031 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90829b6f-051e-4f72-bee0-a3ee926d296a admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:11.168047 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90829b6f-051e-4f72-bee0-a3ee926d296a admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:11.172603 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e074d-8a9a-4cc7-b7a3-8584235b3256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:11.173313 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e074d-8a9a-4cc7-b7a3-8584235b3256 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:11.173669 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e074d-8a9a-4cc7-b7a3-8584235b3256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:11.174047 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e074d-8a9a-4cc7-b7a3-8584235b3256 admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:11.174862 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e074d-8a9a-4cc7-b7a3-8584235b3256 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:11.175246 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e074d-8a9a-4cc7-b7a3-8584235b3256 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:11.176878 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e074d-8a9a-4cc7-b7a3-8584235b3256 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:11.182531 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 491/1001] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Feb 16 16:51:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:11.188328 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e06ac1-3a13-4a89-ab03-929b60855de3 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:11.197975 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e06ac1-3a13-4a89-ab03-929b60855de3 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:11.202474 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c84441-4cb6-47c1-afea-a0d61af0eda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:11.203184 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c84441-4cb6-47c1-afea-a0d61af0eda9 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:11.203466 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c84441-4cb6-47c1-afea-a0d61af0eda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:11.203741 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c84441-4cb6-47c1-afea-a0d61af0eda9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:11.204520 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c84441-4cb6-47c1-afea-a0d61af0eda9 admin admin] RBAC: Adding query filter params (interface=public, service_id=fecba39fe0ae4246964cd2ea19213617, region_id=RegionOne) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:11.204831 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c84441-4cb6-47c1-afea-a0d61af0eda9 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:11.206400 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c84441-4cb6-47c1-afea-a0d61af0eda9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:11.212314 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 511/1002] 10.222.0.42 () {56 vars in 1272 bytes} [Wed Feb 16 16:51:11 2022] GET /identity/v3/endpoints?service_id=fecba39fe0ae4246964cd2ea19213617&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:11.217891 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e074d-8a9a-4cc7-b7a3-8584235b3256 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:11.228139 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e074d-8a9a-4cc7-b7a3-8584235b3256 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:11.232921 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72982c5e-7f20-4a98-ab1a-a60e6d339f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:11.233569 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72982c5e-7f20-4a98-ab1a-a60e6d339f62 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:11.233849 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72982c5e-7f20-4a98-ab1a-a60e6d339f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:11.234123 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72982c5e-7f20-4a98-ab1a-a60e6d339f62 admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:11.234836 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72982c5e-7f20-4a98-ab1a-a60e6d339f62 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:11.236412 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72982c5e-7f20-4a98-ab1a-a60e6d339f62 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:11.243226 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 492/1003] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Feb 16 16:51:11 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 16:51:12.807174 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1daad-ed94-464c-91b2-ebd00d65f691 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:12.807752 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1daad-ed94-464c-91b2-ebd00d65f691 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:12.807752 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1daad-ed94-464c-91b2-ebd00d65f691 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:12.809601 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 512/1004] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:12.814811 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a76c8-61dc-4c37-9b7b-e1605726c402 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:12.815209 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a76c8-61dc-4c37-9b7b-e1605726c402 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:12.815423 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a76c8-61dc-4c37-9b7b-e1605726c402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:12.834181 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-468a76c8-61dc-4c37-9b7b-e1605726c402 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:12.835468 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-468a76c8-61dc-4c37-9b7b-e1605726c402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:12.843586 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 493/1005] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:12 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:12.856703 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd0617-c943-41a8-b973-082057c5aaf7 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:12.857243 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd0617-c943-41a8-b973-082057c5aaf7 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:12.857516 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd0617-c943-41a8-b973-082057c5aaf7 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:12.859424 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 513/1006] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:12.864473 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85eea2-7819-416c-8623-20c8f8f38d49 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:12.864757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85eea2-7819-416c-8623-20c8f8f38d49 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:12.865028 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85eea2-7819-416c-8623-20c8f8f38d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:12.868806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd0617-c943-41a8-b973-082057c5aaf7 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:12.880934 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd0617-c943-41a8-b973-082057c5aaf7 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:12.883496 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-bb85eea2-7819-416c-8623-20c8f8f38d49 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:12.884653 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-bb85eea2-7819-416c-8623-20c8f8f38d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:12.885623 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d51580-bb18-4e6e-9a82-e19506ef87ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:12.886382 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d51580-bb18-4e6e-9a82-e19506ef87ca admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:12.886676 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d51580-bb18-4e6e-9a82-e19506ef87ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:12.886949 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d51580-bb18-4e6e-9a82-e19506ef87ca admin admin] PATH_INFO: `/v3/services/image` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:12.887612 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d51580-bb18-4e6e-9a82-e19506ef87ca admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:12.889139 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d51580-bb18-4e6e-9a82-e19506ef87ca admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:12.892393 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 494/1007] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:12 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:12.900283 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-f8d51580-bb18-4e6e-9a82-e19506ef87ca admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 16 16:51:12.901534 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 514/1008] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Feb 16 16:51:12 2022] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:51:12.907444 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85eea2-7819-416c-8623-20c8f8f38d49 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:12.916043 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d51580-bb18-4e6e-9a82-e19506ef87ca admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:12.917892 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85eea2-7819-416c-8623-20c8f8f38d49 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:12.922509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1b662-b03c-4f91-bf43-4630f2b145d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:12.922962 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1b662-b03c-4f91-bf43-4630f2b145d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:12.923238 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1b662-b03c-4f91-bf43-4630f2b145d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:12.923595 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1b662-b03c-4f91-bf43-4630f2b145d0 admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:12.924193 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1b662-b03c-4f91-bf43-4630f2b145d0 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:12.924493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1b662-b03c-4f91-bf43-4630f2b145d0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:12.925832 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d51580-bb18-4e6e-9a82-e19506ef87ca admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:12.926047 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1b662-b03c-4f91-bf43-4630f2b145d0 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:12.932097 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 495/1009] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:12.935315 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e499d11-6a72-4038-8eaf-c9e56df1c531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:12.936102 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e499d11-6a72-4038-8eaf-c9e56df1c531 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:12.936384 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e499d11-6a72-4038-8eaf-c9e56df1c531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:12.936684 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e499d11-6a72-4038-8eaf-c9e56df1c531 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:12.937335 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e499d11-6a72-4038-8eaf-c9e56df1c531 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:12.937737 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1b662-b03c-4f91-bf43-4630f2b145d0 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:12.939239 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e499d11-6a72-4038-8eaf-c9e56df1c531 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:12.947141 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1b662-b03c-4f91-bf43-4630f2b145d0 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:12.950993 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-0e499d11-6a72-4038-8eaf-c9e56df1c531 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 16:51:12.951682 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cc551-1e5a-4a76-bebf-aff8347933e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:12.952223 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 515/1010] 10.222.0.42 () {56 vars in 1147 bytes} [Wed Feb 16 16:51:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:51:12.952650 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cc551-1e5a-4a76-bebf-aff8347933e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:12.952924 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cc551-1e5a-4a76-bebf-aff8347933e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:12.953262 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cc551-1e5a-4a76-bebf-aff8347933e8 admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:12.953960 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cc551-1e5a-4a76-bebf-aff8347933e8 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:12.954259 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cc551-1e5a-4a76-bebf-aff8347933e8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:12.955947 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cc551-1e5a-4a76-bebf-aff8347933e8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:12.957909 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e499d11-6a72-4038-8eaf-c9e56df1c531 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:12.961299 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 496/1011] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:12.967067 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cc551-1e5a-4a76-bebf-aff8347933e8 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:12.968268 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e499d11-6a72-4038-8eaf-c9e56df1c531 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:12.973003 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f99ed3-0f4a-4565-a0e0-f5262737fac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:12.973696 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f99ed3-0f4a-4565-a0e0-f5262737fac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:12.973994 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f99ed3-0f4a-4565-a0e0-f5262737fac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:12.974288 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f99ed3-0f4a-4565-a0e0-f5262737fac9 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:12.975792 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f99ed3-0f4a-4565-a0e0-f5262737fac9 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:12.976222 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f99ed3-0f4a-4565-a0e0-f5262737fac9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:12.977311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cc551-1e5a-4a76-bebf-aff8347933e8 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:12.977827 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f99ed3-0f4a-4565-a0e0-f5262737fac9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:12.982918 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36d500-6004-4f96-a8aa-b61d3533078c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:12.983191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 516/1012] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Feb 16 16:51:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:12.987738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36d500-6004-4f96-a8aa-b61d3533078c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:12.987738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36d500-6004-4f96-a8aa-b61d3533078c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:12.987738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36d500-6004-4f96-a8aa-b61d3533078c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:12.987738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36d500-6004-4f96-a8aa-b61d3533078c admin admin] RBAC: Adding query filter params (interface=public, service_id=d88f3b48bfc0468ab5371331215f1ed4, region_id=RegionOne) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:12.987738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36d500-6004-4f96-a8aa-b61d3533078c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:12.987738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36d500-6004-4f96-a8aa-b61d3533078c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:12.989002 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f99ed3-0f4a-4565-a0e0-f5262737fac9 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:12.993568 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 497/1013] 10.222.0.42 () {56 vars in 1272 bytes} [Wed Feb 16 16:51:12 2022] GET /identity/v3/endpoints?service_id=d88f3b48bfc0468ab5371331215f1ed4&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:12.999156 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36d500-6004-4f96-a8aa-b61d3533078c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:13.000527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f99ed3-0f4a-4565-a0e0-f5262737fac9 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:13.005078 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eac8d0-5eb5-42b7-9475-7840cde4421b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:13.005790 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eac8d0-5eb5-42b7-9475-7840cde4421b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:13.006240 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eac8d0-5eb5-42b7-9475-7840cde4421b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:13.006666 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eac8d0-5eb5-42b7-9475-7840cde4421b admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:13.007593 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eac8d0-5eb5-42b7-9475-7840cde4421b admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:13.007895 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eac8d0-5eb5-42b7-9475-7840cde4421b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:13.008874 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36d500-6004-4f96-a8aa-b61d3533078c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:13.009493 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eac8d0-5eb5-42b7-9475-7840cde4421b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:13.013704 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca223a9-0668-4318-a55c-321d5294149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:13.014614 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca223a9-0668-4318-a55c-321d5294149b admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:13.014747 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 517/1014] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Feb 16 16:51:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:13.014822 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca223a9-0668-4318-a55c-321d5294149b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:13.014980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca223a9-0668-4318-a55c-321d5294149b admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:13.015634 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca223a9-0668-4318-a55c-321d5294149b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:13.017215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca223a9-0668-4318-a55c-321d5294149b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:13.019832 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eac8d0-5eb5-42b7-9475-7840cde4421b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:13.024775 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 498/1015] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Feb 16 16:51:12 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 16:51:13.029941 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eac8d0-5eb5-42b7-9475-7840cde4421b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:13.034606 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bce0eb-48e3-4574-92fb-424ed9c7c23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:13.035317 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bce0eb-48e3-4574-92fb-424ed9c7c23b admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:13.035592 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bce0eb-48e3-4574-92fb-424ed9c7c23b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:13.035861 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bce0eb-48e3-4574-92fb-424ed9c7c23b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:13.036603 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bce0eb-48e3-4574-92fb-424ed9c7c23b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:13.039828 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bce0eb-48e3-4574-92fb-424ed9c7c23b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:13.124623 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 518/1016] 10.222.0.42 () {60 vars in 1165 bytes} [Wed Feb 16 16:51:13 2022] POST /identity/v3/endpoints => generated 325 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 16:51:13.576692 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2aaf5-35c5-48c6-8e18-aea5e5cc956e None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:13.576692 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2aaf5-35c5-48c6-8e18-aea5e5cc956e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:13.576692 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2aaf5-35c5-48c6-8e18-aea5e5cc956e None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:13.578012 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 499/1017] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:13.583309 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e239a86-5a50-4ca2-8615-e1f6b1ab2165 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:13.583638 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e239a86-5a50-4ca2-8615-e1f6b1ab2165 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:13.583916 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e239a86-5a50-4ca2-8615-e1f6b1ab2165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:13.602244 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-1e239a86-5a50-4ca2-8615-e1f6b1ab2165 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:13.603528 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-1e239a86-5a50-4ca2-8615-e1f6b1ab2165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:13.621519 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 519/1018] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:13 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 16:51:13.645418 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2aaf5-35c5-48c6-8e18-aea5e5cc956e None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:13.658389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2aaf5-35c5-48c6-8e18-aea5e5cc956e None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:13.663986 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af7e6f-c036-47c7-9bce-971f8a5be554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:13.664756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af7e6f-c036-47c7-9bce-971f8a5be554 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:13.665037 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af7e6f-c036-47c7-9bce-971f8a5be554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:13.665338 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af7e6f-c036-47c7-9bce-971f8a5be554 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:13.666027 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af7e6f-c036-47c7-9bce-971f8a5be554 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:13.667665 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af7e6f-c036-47c7-9bce-971f8a5be554 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:13.679465 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-f5af7e6f-c036-47c7-9bce-971f8a5be554 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 16 16:51:13.680901 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 500/1019] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:51:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:13.686818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e239a86-5a50-4ca2-8615-e1f6b1ab2165 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:13.695964 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e239a86-5a50-4ca2-8615-e1f6b1ab2165 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:13.700844 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3930071-e6f1-4864-8992-1adb1fd04a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:13.701748 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3930071-e6f1-4864-8992-1adb1fd04a43 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:13.702148 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3930071-e6f1-4864-8992-1adb1fd04a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:13.702418 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3930071-e6f1-4864-8992-1adb1fd04a43 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:13.703148 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3930071-e6f1-4864-8992-1adb1fd04a43 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:13.703448 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3930071-e6f1-4864-8992-1adb1fd04a43 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:13.705025 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3930071-e6f1-4864-8992-1adb1fd04a43 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:13.714713 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 520/1020] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Feb 16 16:51:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:13.717618 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af7e6f-c036-47c7-9bce-971f8a5be554 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:13.727939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af7e6f-c036-47c7-9bce-971f8a5be554 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:13.732785 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f694e-e038-4663-b866-10ac95a7d918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:13.733429 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f694e-e038-4663-b866-10ac95a7d918 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:13.733706 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f694e-e038-4663-b866-10ac95a7d918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:13.733983 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f694e-e038-4663-b866-10ac95a7d918 admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:13.734701 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f694e-e038-4663-b866-10ac95a7d918 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:13.744429 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f694e-e038-4663-b866-10ac95a7d918 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:13.744429 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f694e-e038-4663-b866-10ac95a7d918 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:13.744429 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 501/1021] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Feb 16 16:51:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:13.747701 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3930071-e6f1-4864-8992-1adb1fd04a43 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:13.757535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3930071-e6f1-4864-8992-1adb1fd04a43 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:13.762077 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc981fd-871c-42f0-84d3-18daca92a9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:13.762751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc981fd-871c-42f0-84d3-18daca92a9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:13.763034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc981fd-871c-42f0-84d3-18daca92a9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:13.763309 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc981fd-871c-42f0-84d3-18daca92a9e9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:13.764037 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc981fd-871c-42f0-84d3-18daca92a9e9 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:13.765610 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc981fd-871c-42f0-84d3-18daca92a9e9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:13.948616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 521/1022] 10.222.0.42 () {60 vars in 1165 bytes} [Wed Feb 16 16:51:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 16:51:15.389186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6f938-04c4-4343-bbf7-535f1e5594ff None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:15.389738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6f938-04c4-4343-bbf7-535f1e5594ff None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:15.389738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6f938-04c4-4343-bbf7-535f1e5594ff None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:15.391694 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 502/1023] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:15.397420 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9051c1-2722-48f0-93fc-29a0cb767eec None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:15.397864 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9051c1-2722-48f0-93fc-29a0cb767eec None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:15.398052 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9051c1-2722-48f0-93fc-29a0cb767eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:15.417510 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-3e9051c1-2722-48f0-93fc-29a0cb767eec None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:15.418743 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-3e9051c1-2722-48f0-93fc-29a0cb767eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:15.435558 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 522/1024] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:15 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:15.448573 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ced42e-fb75-4eb7-a7d5-be6dfde6abb6 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:15.448854 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ced42e-fb75-4eb7-a7d5-be6dfde6abb6 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:15.449125 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ced42e-fb75-4eb7-a7d5-be6dfde6abb6 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:15.450904 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 503/1025] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:15.456094 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b5a72-354d-44ca-ae88-f406cdd74704 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:15.456380 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b5a72-354d-44ca-ae88-f406cdd74704 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:15.456647 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b5a72-354d-44ca-ae88-f406cdd74704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:15.460425 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ced42e-fb75-4eb7-a7d5-be6dfde6abb6 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:15.472562 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ced42e-fb75-4eb7-a7d5-be6dfde6abb6 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:15.476936 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-425b5a72-354d-44ca-ae88-f406cdd74704 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:15.478394 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad6529-bbf4-4736-99a1-536141098e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:15.478603 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-425b5a72-354d-44ca-ae88-f406cdd74704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:15.479191 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad6529-bbf4-4736-99a1-536141098e23 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:15.479472 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad6529-bbf4-4736-99a1-536141098e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:15.479744 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad6529-bbf4-4736-99a1-536141098e23 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:15.480393 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad6529-bbf4-4736-99a1-536141098e23 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:15.482212 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad6529-bbf4-4736-99a1-536141098e23 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:15.488329 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 523/1026] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:15 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:15.494048 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-d2ad6529-bbf4-4736-99a1-536141098e23 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 16 16:51:15.495355 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 504/1027] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Feb 16 16:51:15 2022] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:51:15.501836 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b5a72-354d-44ca-ae88-f406cdd74704 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:15.512005 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b5a72-354d-44ca-ae88-f406cdd74704 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:15.513872 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad6529-bbf4-4736-99a1-536141098e23 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:15.516644 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07ea7a-10fb-4634-bcf4-efeab4ba62de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:15.517292 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07ea7a-10fb-4634-bcf4-efeab4ba62de admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:15.517569 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07ea7a-10fb-4634-bcf4-efeab4ba62de admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:15.517839 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07ea7a-10fb-4634-bcf4-efeab4ba62de admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:15.518686 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07ea7a-10fb-4634-bcf4-efeab4ba62de admin admin] RBAC: Adding query filter params (name=image) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:15.518867 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07ea7a-10fb-4634-bcf4-efeab4ba62de admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:15.520460 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07ea7a-10fb-4634-bcf4-efeab4ba62de admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:15.525819 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad6529-bbf4-4736-99a1-536141098e23 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:15.529198 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a726a-c378-467d-bd0a-d6f209b383f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:15.529656 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 524/1028] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:15.531328 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a726a-c378-467d-bd0a-d6f209b383f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:15.531606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a726a-c378-467d-bd0a-d6f209b383f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:15.531875 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a726a-c378-467d-bd0a-d6f209b383f7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:15.533077 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a726a-c378-467d-bd0a-d6f209b383f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:15.534771 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a726a-c378-467d-bd0a-d6f209b383f7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:15.534891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07ea7a-10fb-4634-bcf4-efeab4ba62de admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:15.540766 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 505/1029] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:15.541699 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a726a-c378-467d-bd0a-d6f209b383f7 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:15.544936 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07ea7a-10fb-4634-bcf4-efeab4ba62de admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:15.549710 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3dbcd-a49c-4e2b-b82e-278e53415d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:15.550358 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3dbcd-a49c-4e2b-b82e-278e53415d1b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:15.550695 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3dbcd-a49c-4e2b-b82e-278e53415d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:15.550976 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3dbcd-a49c-4e2b-b82e-278e53415d1b admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:15.551087 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a726a-c378-467d-bd0a-d6f209b383f7 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:15.551669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3dbcd-a49c-4e2b-b82e-278e53415d1b admin admin] RBAC: Adding query filter params (type=image) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:15.551977 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3dbcd-a49c-4e2b-b82e-278e53415d1b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:15.554080 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3dbcd-a49c-4e2b-b82e-278e53415d1b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:15.556931 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677503b-6174-4d76-8ccf-9ed6ccdd4815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:15.557738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677503b-6174-4d76-8ccf-9ed6ccdd4815 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:15.558167 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677503b-6174-4d76-8ccf-9ed6ccdd4815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:15.558584 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677503b-6174-4d76-8ccf-9ed6ccdd4815 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:15.559160 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 525/1030] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:15.559611 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677503b-6174-4d76-8ccf-9ed6ccdd4815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:15.561660 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677503b-6174-4d76-8ccf-9ed6ccdd4815 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:15.564527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3dbcd-a49c-4e2b-b82e-278e53415d1b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:15.575002 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3dbcd-a49c-4e2b-b82e-278e53415d1b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:15.579939 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f590bd-12be-4e23-92f5-3b0bd21bdfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:15.580692 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f590bd-12be-4e23-92f5-3b0bd21bdfbe admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:15.581045 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f590bd-12be-4e23-92f5-3b0bd21bdfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:15.581323 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f590bd-12be-4e23-92f5-3b0bd21bdfbe admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:15.582063 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f590bd-12be-4e23-92f5-3b0bd21bdfbe admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:15.583742 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f590bd-12be-4e23-92f5-3b0bd21bdfbe admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:15.680621 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 506/1031] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Feb 16 16:51:15 2022] POST /identity/v3/projects => generated 311 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 16:51:15.726954 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 526/1032] 10.222.0.42 () {60 vars in 1165 bytes} [Wed Feb 16 16:51:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 16:51:16.340815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756168a1-7e58-4d30-8292-50040d4d0d15 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:16.341152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756168a1-7e58-4d30-8292-50040d4d0d15 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:16.341467 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756168a1-7e58-4d30-8292-50040d4d0d15 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:16.343329 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 507/1033] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:16.348459 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66beac5-73a4-4f24-93c5-456c6d78fc03 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:16.348753 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66beac5-73a4-4f24-93c5-456c6d78fc03 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:16.349033 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66beac5-73a4-4f24-93c5-456c6d78fc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:16.366999 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-f66beac5-73a4-4f24-93c5-456c6d78fc03 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:16.368185 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f66beac5-73a4-4f24-93c5-456c6d78fc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:16.434979 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 527/1034] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:16.462048 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756168a1-7e58-4d30-8292-50040d4d0d15 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:16.475376 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756168a1-7e58-4d30-8292-50040d4d0d15 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:16.479894 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380965db-bb9e-4836-83c8-f84d7337d7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:16.480689 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380965db-bb9e-4836-83c8-f84d7337d7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:16.480972 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380965db-bb9e-4836-83c8-f84d7337d7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:16.481246 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380965db-bb9e-4836-83c8-f84d7337d7d2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:16.492704 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380965db-bb9e-4836-83c8-f84d7337d7d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:51:16.500047 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-380965db-bb9e-4836-83c8-f84d7337d7d2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 16:51:16.506568 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 508/1035] 10.222.0.42 () {56 vars in 1141 bytes} [Wed Feb 16 16:51:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:16.507613 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66beac5-73a4-4f24-93c5-456c6d78fc03 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:16.516683 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66beac5-73a4-4f24-93c5-456c6d78fc03 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:16.527802 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ee4a2-6603-4e96-b158-79895da22055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:16.528479 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ee4a2-6603-4e96-b158-79895da22055 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:16.528762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ee4a2-6603-4e96-b158-79895da22055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:16.529034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ee4a2-6603-4e96-b158-79895da22055 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:16.531669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ee4a2-6603-4e96-b158-79895da22055 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:16.531992 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ee4a2-6603-4e96-b158-79895da22055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:16.533623 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ee4a2-6603-4e96-b158-79895da22055 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:16.545384 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 528/1036] 10.222.0.42 () {56 vars in 1136 bytes} [Wed Feb 16 16:51:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:16.551106 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380965db-bb9e-4836-83c8-f84d7337d7d2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:16.562936 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380965db-bb9e-4836-83c8-f84d7337d7d2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:16.567848 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09af89e-173f-45be-ae51-fa574b49289b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:16.568725 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09af89e-173f-45be-ae51-fa574b49289b admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:16.569007 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09af89e-173f-45be-ae51-fa574b49289b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:16.569298 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09af89e-173f-45be-ae51-fa574b49289b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:16.582534 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09af89e-173f-45be-ae51-fa574b49289b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:16.585139 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09af89e-173f-45be-ae51-fa574b49289b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:16.615697 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-c09af89e-173f-45be-ae51-fa574b49289b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:51:16.623413 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ee4a2-6603-4e96-b158-79895da22055 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:16.624139 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 509/1037] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:16.634553 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ee4a2-6603-4e96-b158-79895da22055 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:16.639463 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c457b44-caad-482b-b6b9-b11facfc7a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:16.640191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c457b44-caad-482b-b6b9-b11facfc7a6b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:16.640476 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c457b44-caad-482b-b6b9-b11facfc7a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:16.640835 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c457b44-caad-482b-b6b9-b11facfc7a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:16.641559 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c457b44-caad-482b-b6b9-b11facfc7a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:16.641936 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c457b44-caad-482b-b6b9-b11facfc7a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:16.643667 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c457b44-caad-482b-b6b9-b11facfc7a6b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:16.657772 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 529/1038] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:16.663681 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09af89e-173f-45be-ae51-fa574b49289b admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:16.673588 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09af89e-173f-45be-ae51-fa574b49289b admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:16.678695 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3d040-e45a-4f2b-b897-228a0857e9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:16.679474 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3d040-e45a-4f2b-b897-228a0857e9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:16.679756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3d040-e45a-4f2b-b897-228a0857e9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:16.680030 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3d040-e45a-4f2b-b897-228a0857e9e1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:16.687407 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3d040-e45a-4f2b-b897-228a0857e9e1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:16.689389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3d040-e45a-4f2b-b897-228a0857e9e1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:16.704001 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-04c3d040-e45a-4f2b-b897-228a0857e9e1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 16:51:16.706680 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 510/1039] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Feb 16 16:51:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:16.711162 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c457b44-caad-482b-b6b9-b11facfc7a6b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:16.721035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c457b44-caad-482b-b6b9-b11facfc7a6b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:16.726085 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b0186-08aa-4034-bd0b-e450ebbc3678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:16.726777 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b0186-08aa-4034-bd0b-e450ebbc3678 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:16.727051 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b0186-08aa-4034-bd0b-e450ebbc3678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:16.728075 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b0186-08aa-4034-bd0b-e450ebbc3678 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:16.728181 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b0186-08aa-4034-bd0b-e450ebbc3678 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:16.728419 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b0186-08aa-4034-bd0b-e450ebbc3678 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:16.730239 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b0186-08aa-4034-bd0b-e450ebbc3678 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:16.756935 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 530/1040] 10.222.0.42 () {56 vars in 1154 bytes} [Wed Feb 16 16:51:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:16.758335 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3d040-e45a-4f2b-b897-228a0857e9e1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:16.768286 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3d040-e45a-4f2b-b897-228a0857e9e1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:16.775538 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5f552-c991-44b4-bb73-ca844a8c8856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:16.781885 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5f552-c991-44b4-bb73-ca844a8c8856 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:16.781885 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5f552-c991-44b4-bb73-ca844a8c8856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:16.781885 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5f552-c991-44b4-bb73-ca844a8c8856 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:16.792969 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5f552-c991-44b4-bb73-ca844a8c8856 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:16.793777 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5f552-c991-44b4-bb73-ca844a8c8856 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:16.809064 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 511/1041] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:51:16 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:51:16.810773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b0186-08aa-4034-bd0b-e450ebbc3678 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:16.821221 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b0186-08aa-4034-bd0b-e450ebbc3678 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:16.826327 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd65831-4076-4efb-a3b3-bdfd7a714aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:16.827440 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd65831-4076-4efb-a3b3-bdfd7a714aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:16.827934 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd65831-4076-4efb-a3b3-bdfd7a714aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:16.828516 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd65831-4076-4efb-a3b3-bdfd7a714aa3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:16.839768 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd65831-4076-4efb-a3b3-bdfd7a714aa3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:16.841950 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd65831-4076-4efb-a3b3-bdfd7a714aa3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:16.860050 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-4cd65831-4076-4efb-a3b3-bdfd7a714aa3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:51:16.866909 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 531/1042] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:16.868678 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5f552-c991-44b4-bb73-ca844a8c8856 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:16.877611 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5f552-c991-44b4-bb73-ca844a8c8856 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:16.882610 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdb59b-9124-45df-99fe-83d5da54456b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:16.883276 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdb59b-9124-45df-99fe-83d5da54456b admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:16.883567 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdb59b-9124-45df-99fe-83d5da54456b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:16.883845 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdb59b-9124-45df-99fe-83d5da54456b admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:16.884558 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cdb59b-9124-45df-99fe-83d5da54456b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:16.884868 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cdb59b-9124-45df-99fe-83d5da54456b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:16.886435 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cdb59b-9124-45df-99fe-83d5da54456b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:16.902772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 512/1043] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:16.904424 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd65831-4076-4efb-a3b3-bdfd7a714aa3 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:16.915649 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd65831-4076-4efb-a3b3-bdfd7a714aa3 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:16.920608 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05dfca-cf8c-4dcb-9919-c2fa1b9c42a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:16.921578 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05dfca-cf8c-4dcb-9919-c2fa1b9c42a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:16.921962 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05dfca-cf8c-4dcb-9919-c2fa1b9c42a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:16.922368 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05dfca-cf8c-4dcb-9919-c2fa1b9c42a4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:16.931030 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05dfca-cf8c-4dcb-9919-c2fa1b9c42a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:16.933154 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05dfca-cf8c-4dcb-9919-c2fa1b9c42a4 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:16.947029 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-dc05dfca-cf8c-4dcb-9919-c2fa1b9c42a4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:51:16.948564 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 532/1044] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:51:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:16.954503 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdb59b-9124-45df-99fe-83d5da54456b admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:16.964762 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdb59b-9124-45df-99fe-83d5da54456b admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:16.969344 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032743a-5c13-49c5-bbe8-0403953b9ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:16.969980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032743a-5c13-49c5-bbe8-0403953b9ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:16.970256 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032743a-5c13-49c5-bbe8-0403953b9ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:16.970523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032743a-5c13-49c5-bbe8-0403953b9ae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:16.971338 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032743a-5c13-49c5-bbe8-0403953b9ae1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:16.971641 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032743a-5c13-49c5-bbe8-0403953b9ae1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:16.973431 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032743a-5c13-49c5-bbe8-0403953b9ae1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:16.986729 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 513/1045] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:51:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:16.992734 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05dfca-cf8c-4dcb-9919-c2fa1b9c42a4 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:17.003247 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05dfca-cf8c-4dcb-9919-c2fa1b9c42a4 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:17.007960 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0f32b-aa72-4833-bf7e-2f0569ba5e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:17.008593 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0f32b-aa72-4833-bf7e-2f0569ba5e33 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:17.008873 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0f32b-aa72-4833-bf7e-2f0569ba5e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:17.009147 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0f32b-aa72-4833-bf7e-2f0569ba5e33 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:17.009964 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0f32b-aa72-4833-bf7e-2f0569ba5e33 admin admin] RBAC: Adding query filter params (role.id=7a712c9c729e424bab90590b1f232d0b, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=9a30603a236e4681a7702eec7029e9db) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:17.010274 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0f32b-aa72-4833-bf7e-2f0569ba5e33 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:17.012143 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0f32b-aa72-4833-bf7e-2f0569ba5e33 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:17.018573 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 533/1046] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:51:16 2022] GET /identity/v3/role_assignments?user.id=9a30603a236e4681a7702eec7029e9db&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=7a712c9c729e424bab90590b1f232d0b => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:18.082775 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc48dc1-0247-4df4-ba08-003cda980d29 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:18.083287 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc48dc1-0247-4df4-ba08-003cda980d29 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:18.083366 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc48dc1-0247-4df4-ba08-003cda980d29 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:18.085302 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 514/1047] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:18.090660 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490294d8-0e00-4415-a1e2-50cfccf8a346 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:18.091066 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490294d8-0e00-4415-a1e2-50cfccf8a346 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:18.091233 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490294d8-0e00-4415-a1e2-50cfccf8a346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:18.109712 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-490294d8-0e00-4415-a1e2-50cfccf8a346 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:18.110920 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-490294d8-0e00-4415-a1e2-50cfccf8a346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:18.119375 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 534/1048] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:18.141779 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc48dc1-0247-4df4-ba08-003cda980d29 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:18.144072 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f8fd2-e4a3-4e94-bba3-0f1a1a6e965e None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:18.144367 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f8fd2-e4a3-4e94-bba3-0f1a1a6e965e None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:18.144655 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f8fd2-e4a3-4e94-bba3-0f1a1a6e965e None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:18.146506 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 535/1049] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 16:51:18.151600 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d59ff-12a4-45d2-87b8-8b01e9ec4001 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:18.151910 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d59ff-12a4-45d2-87b8-8b01e9ec4001 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:18.152191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d59ff-12a4-45d2-87b8-8b01e9ec4001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:18.154087 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc48dc1-0247-4df4-ba08-003cda980d29 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:18.158314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629eef0f-98c4-47cd-976d-76884a533b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:18.158982 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629eef0f-98c4-47cd-976d-76884a533b79 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:18.159254 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629eef0f-98c4-47cd-976d-76884a533b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:18.159518 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629eef0f-98c4-47cd-976d-76884a533b79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:18.168324 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629eef0f-98c4-47cd-976d-76884a533b79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:18.170299 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629eef0f-98c4-47cd-976d-76884a533b79 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:18.170413 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-fc3d59ff-12a4-45d2-87b8-8b01e9ec4001 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:18.171594 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-fc3d59ff-12a4-45d2-87b8-8b01e9ec4001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:18.180115 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 515/1050] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:51:18 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:51:18.182679 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 536/1051] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 16:51:18.187776 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629eef0f-98c4-47cd-976d-76884a533b79 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:18.196332 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629eef0f-98c4-47cd-976d-76884a533b79 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:18.200896 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbc5f3-7020-472b-b866-d5d2bc1888ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:18.201654 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbc5f3-7020-472b-b866-d5d2bc1888ad admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:18.201933 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbc5f3-7020-472b-b866-d5d2bc1888ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:18.202204 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbc5f3-7020-472b-b866-d5d2bc1888ad admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:18.203375 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbc5f3-7020-472b-b866-d5d2bc1888ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:18.205104 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbc5f3-7020-472b-b866-d5d2bc1888ad admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:18.205722 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d59ff-12a4-45d2-87b8-8b01e9ec4001 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:18.206791 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 516/1052] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:18.216237 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d59ff-12a4-45d2-87b8-8b01e9ec4001 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:18.221063 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bc1d2-e9f5-44a4-83f6-da57d9ccf111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:18.221937 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bc1d2-e9f5-44a4-83f6-da57d9ccf111 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:18.222217 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bc1d2-e9f5-44a4-83f6-da57d9ccf111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:18.222487 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bc1d2-e9f5-44a4-83f6-da57d9ccf111 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:18.223813 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bc1d2-e9f5-44a4-83f6-da57d9ccf111 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:18.226224 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bc1d2-e9f5-44a4-83f6-da57d9ccf111 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:18.228177 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 537/1053] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:18.234135 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbc5f3-7020-472b-b866-d5d2bc1888ad admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:18.245462 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbc5f3-7020-472b-b866-d5d2bc1888ad admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:18.250302 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6740a4-0bd4-4d46-b31c-316737a8d198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:18.250997 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6740a4-0bd4-4d46-b31c-316737a8d198 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:18.251273 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6740a4-0bd4-4d46-b31c-316737a8d198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:18.251541 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6740a4-0bd4-4d46-b31c-316737a8d198 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:18.252264 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6740a4-0bd4-4d46-b31c-316737a8d198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:18.254136 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6740a4-0bd4-4d46-b31c-316737a8d198 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:18.380289 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 517/1054] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Feb 16 16:51:18 2022] POST /identity/v3/users => generated 285 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 16:51:19.329976 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1013c3-0076-4316-b07f-c3849e67510c None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:19.330530 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1013c3-0076-4316-b07f-c3849e67510c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:19.330530 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1013c3-0076-4316-b07f-c3849e67510c None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:19.332391 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 538/1055] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:19.338077 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13386aed-da03-410d-813e-77b446183de5 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:19.338493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13386aed-da03-410d-813e-77b446183de5 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:19.338632 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13386aed-da03-410d-813e-77b446183de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:19.356172 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-13386aed-da03-410d-813e-77b446183de5 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:19.357594 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-13386aed-da03-410d-813e-77b446183de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:19.365755 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 518/1056] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:19 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:19.389981 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1013c3-0076-4316-b07f-c3849e67510c None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:19.403336 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1013c3-0076-4316-b07f-c3849e67510c None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:19.407852 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e031ec-2bec-473e-8cc3-f97d6364d75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:19.408639 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e031ec-2bec-473e-8cc3-f97d6364d75d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:19.408919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e031ec-2bec-473e-8cc3-f97d6364d75d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:19.409192 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e031ec-2bec-473e-8cc3-f97d6364d75d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:19.419325 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e031ec-2bec-473e-8cc3-f97d6364d75d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:51:19.426526 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-65e031ec-2bec-473e-8cc3-f97d6364d75d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 16:51:19.428293 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 539/1057] 10.222.0.42 () {56 vars in 1141 bytes} [Wed Feb 16 16:51:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:19.434382 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13386aed-da03-410d-813e-77b446183de5 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:19.444029 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13386aed-da03-410d-813e-77b446183de5 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:19.448524 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f880784-4b70-460f-aea3-686d54fd0566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:19.449171 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f880784-4b70-460f-aea3-686d54fd0566 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:19.449451 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f880784-4b70-460f-aea3-686d54fd0566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:19.449722 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f880784-4b70-460f-aea3-686d54fd0566 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:19.450460 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f880784-4b70-460f-aea3-686d54fd0566 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:19.450802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f880784-4b70-460f-aea3-686d54fd0566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:19.452369 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f880784-4b70-460f-aea3-686d54fd0566 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:19.460523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 519/1058] 10.222.0.42 () {56 vars in 1136 bytes} [Wed Feb 16 16:51:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:19.466212 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e031ec-2bec-473e-8cc3-f97d6364d75d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:19.478423 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e031ec-2bec-473e-8cc3-f97d6364d75d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:19.483210 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc2e5f-589e-4391-a38b-8eae75d49e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:19.483982 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc2e5f-589e-4391-a38b-8eae75d49e3d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:19.484256 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc2e5f-589e-4391-a38b-8eae75d49e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:19.484524 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc2e5f-589e-4391-a38b-8eae75d49e3d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:19.495669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc2e5f-589e-4391-a38b-8eae75d49e3d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:19.497519 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc2e5f-589e-4391-a38b-8eae75d49e3d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:19.514423 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-80cc2e5f-589e-4391-a38b-8eae75d49e3d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:51:19.515619 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 540/1059] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:51:19.522163 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f880784-4b70-460f-aea3-686d54fd0566 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:19.531705 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f880784-4b70-460f-aea3-686d54fd0566 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:19.536108 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8491ef-c053-4411-b102-8674a762ea0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:19.536743 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8491ef-c053-4411-b102-8674a762ea0c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:19.537085 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8491ef-c053-4411-b102-8674a762ea0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:19.537361 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8491ef-c053-4411-b102-8674a762ea0c admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:19.538062 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8491ef-c053-4411-b102-8674a762ea0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:19.538358 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8491ef-c053-4411-b102-8674a762ea0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:19.539941 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8491ef-c053-4411-b102-8674a762ea0c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:19.551437 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 520/1060] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:19.558051 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc2e5f-589e-4391-a38b-8eae75d49e3d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:19.568178 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc2e5f-589e-4391-a38b-8eae75d49e3d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:19.573547 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e9902-5459-42ba-b2ea-e3b89d35c464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:19.574345 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e9902-5459-42ba-b2ea-e3b89d35c464 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:19.574624 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e9902-5459-42ba-b2ea-e3b89d35c464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:19.574941 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e9902-5459-42ba-b2ea-e3b89d35c464 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:19.582817 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e9902-5459-42ba-b2ea-e3b89d35c464 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:19.585014 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e9902-5459-42ba-b2ea-e3b89d35c464 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:19.599265 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-d11e9902-5459-42ba-b2ea-e3b89d35c464 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 16:51:19.601171 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 541/1061] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Feb 16 16:51:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:19.606945 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8491ef-c053-4411-b102-8674a762ea0c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:19.617855 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8491ef-c053-4411-b102-8674a762ea0c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:19.622314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd850548-1f0a-453b-a85d-5569747fe3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:19.622987 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd850548-1f0a-453b-a85d-5569747fe3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:19.623267 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd850548-1f0a-453b-a85d-5569747fe3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:19.623540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd850548-1f0a-453b-a85d-5569747fe3d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:19.624366 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd850548-1f0a-453b-a85d-5569747fe3d1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:19.624669 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd850548-1f0a-453b-a85d-5569747fe3d1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:19.626473 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd850548-1f0a-453b-a85d-5569747fe3d1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:19.643419 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 521/1062] 10.222.0.42 () {56 vars in 1154 bytes} [Wed Feb 16 16:51:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:19.649418 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e9902-5459-42ba-b2ea-e3b89d35c464 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:19.658952 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e9902-5459-42ba-b2ea-e3b89d35c464 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:19.664256 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68d413-f3c5-41bb-a1d0-760caf86380a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:19.665909 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68d413-f3c5-41bb-a1d0-760caf86380a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:19.665909 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68d413-f3c5-41bb-a1d0-760caf86380a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:19.665909 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68d413-f3c5-41bb-a1d0-760caf86380a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:19.675681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68d413-f3c5-41bb-a1d0-760caf86380a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:19.677535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68d413-f3c5-41bb-a1d0-760caf86380a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:19.694622 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-af68d413-f3c5-41bb-a1d0-760caf86380a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:51:19.695784 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 542/1063] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:19.701520 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd850548-1f0a-453b-a85d-5569747fe3d1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:19.712273 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd850548-1f0a-453b-a85d-5569747fe3d1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:19.716851 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc6d1a-ab7b-4565-8f8d-582e8fde42e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:19.717494 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc6d1a-ab7b-4565-8f8d-582e8fde42e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:19.717776 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc6d1a-ab7b-4565-8f8d-582e8fde42e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:19.718048 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc6d1a-ab7b-4565-8f8d-582e8fde42e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:19.718801 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc6d1a-ab7b-4565-8f8d-582e8fde42e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:19.719115 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc6d1a-ab7b-4565-8f8d-582e8fde42e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:19.720679 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc6d1a-ab7b-4565-8f8d-582e8fde42e9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:19.732586 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 522/1064] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:19.738120 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68d413-f3c5-41bb-a1d0-760caf86380a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:19.748571 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68d413-f3c5-41bb-a1d0-760caf86380a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:19.753082 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69653d2-0d91-4c94-9760-c05e60a808c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:19.753840 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69653d2-0d91-4c94-9760-c05e60a808c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:19.754118 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69653d2-0d91-4c94-9760-c05e60a808c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:19.754386 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69653d2-0d91-4c94-9760-c05e60a808c4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:19.761945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69653d2-0d91-4c94-9760-c05e60a808c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:19.763887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69653d2-0d91-4c94-9760-c05e60a808c4 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:19.777535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-a69653d2-0d91-4c94-9760-c05e60a808c4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:51:19.778675 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 543/1065] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:51:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:19.784236 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc6d1a-ab7b-4565-8f8d-582e8fde42e9 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:19.793741 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc6d1a-ab7b-4565-8f8d-582e8fde42e9 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:19.798132 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795f5db-145d-4a09-bdbb-6acfe4420e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:19.798811 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795f5db-145d-4a09-bdbb-6acfe4420e61 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:19.799089 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795f5db-145d-4a09-bdbb-6acfe4420e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:19.799363 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795f5db-145d-4a09-bdbb-6acfe4420e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:19.800126 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795f5db-145d-4a09-bdbb-6acfe4420e61 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:19.800429 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795f5db-145d-4a09-bdbb-6acfe4420e61 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:19.802232 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795f5db-145d-4a09-bdbb-6acfe4420e61 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:19.814099 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 523/1066] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:51:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:19.820568 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69653d2-0d91-4c94-9760-c05e60a808c4 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:19.831854 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69653d2-0d91-4c94-9760-c05e60a808c4 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:19.837656 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c7693-4914-4e2d-a553-5d9aa8356519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:19.838517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c7693-4914-4e2d-a553-5d9aa8356519 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:19.838860 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c7693-4914-4e2d-a553-5d9aa8356519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:19.839139 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c7693-4914-4e2d-a553-5d9aa8356519 admin admin] PATH_INFO: `/v3/projects/6160f9606d06486b9a11a23ee717af79/users/9a30603a236e4681a7702eec7029e9db/roles/7a712c9c729e424bab90590b1f232d0b` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:19.841505 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c7693-4914-4e2d-a553-5d9aa8356519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6160f9606d06486b9a11a23ee717af79, user_id=9a30603a236e4681a7702eec7029e9db, role_id=7a712c9c729e424bab90590b1f232d0b)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:19.844396 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c7693-4914-4e2d-a553-5d9aa8356519 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:20.015684 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 544/1067] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:51:19 2022] PUT /identity/v3/projects/6160f9606d06486b9a11a23ee717af79/users/9a30603a236e4681a7702eec7029e9db/roles/7a712c9c729e424bab90590b1f232d0b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:51:20.765665 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346b054-448a-4771-8867-134c79a665cb None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:20.766316 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346b054-448a-4771-8867-134c79a665cb None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:20.766316 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346b054-448a-4771-8867-134c79a665cb None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:20.768143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 524/1068] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:20.773621 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8feebe1-d36c-4aab-9796-a342f8f0bd7d None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:20.774052 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8feebe1-d36c-4aab-9796-a342f8f0bd7d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:20.774164 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8feebe1-d36c-4aab-9796-a342f8f0bd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:20.791389 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-c8feebe1-d36c-4aab-9796-a342f8f0bd7d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:20.792498 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-c8feebe1-d36c-4aab-9796-a342f8f0bd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:20.848515 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 545/1069] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:20 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 16:51:20.873199 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346b054-448a-4771-8867-134c79a665cb None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:20.886274 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346b054-448a-4771-8867-134c79a665cb None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:20.890572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214697e-9c51-47c7-bbb5-e5f05426fafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:20.891364 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214697e-9c51-47c7-bbb5-e5f05426fafd admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:20.891730 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214697e-9c51-47c7-bbb5-e5f05426fafd admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:20.891964 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214697e-9c51-47c7-bbb5-e5f05426fafd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:20.902230 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214697e-9c51-47c7-bbb5-e5f05426fafd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:51:20.908902 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-a214697e-9c51-47c7-bbb5-e5f05426fafd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:51:20.910064 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 525/1070] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:51:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:20.916494 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8feebe1-d36c-4aab-9796-a342f8f0bd7d None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:20.925210 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8feebe1-d36c-4aab-9796-a342f8f0bd7d None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:20.930373 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8e925-487c-4794-8705-288fad86b6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:20.931044 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8e925-487c-4794-8705-288fad86b6fd admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:20.931320 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8e925-487c-4794-8705-288fad86b6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:20.931588 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8e925-487c-4794-8705-288fad86b6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:20.932384 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8e925-487c-4794-8705-288fad86b6fd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:20.932688 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8e925-487c-4794-8705-288fad86b6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:20.934251 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8e925-487c-4794-8705-288fad86b6fd admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:20.942163 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 546/1071] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:51:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:20.948407 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214697e-9c51-47c7-bbb5-e5f05426fafd admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:20.958594 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214697e-9c51-47c7-bbb5-e5f05426fafd admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:20.963346 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd6b55-c055-47b9-b5c1-0b43f5f0f08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:20.964188 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd6b55-c055-47b9-b5c1-0b43f5f0f08e admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:20.964470 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd6b55-c055-47b9-b5c1-0b43f5f0f08e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:20.964745 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd6b55-c055-47b9-b5c1-0b43f5f0f08e admin admin] PATH_INFO: `/v3/users/453424cdeca44b2a8b510e0561be23f5` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:20.977703 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd6b55-c055-47b9-b5c1-0b43f5f0f08e admin admin] RBAC: Authorizing `identity:get_user(user_id=453424cdeca44b2a8b510e0561be23f5)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:20.979894 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd6b55-c055-47b9-b5c1-0b43f5f0f08e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:20.981613 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 526/1072] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:51:20 2022] GET /identity/v3/users/453424cdeca44b2a8b510e0561be23f5 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:20.987611 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8e925-487c-4794-8705-288fad86b6fd admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:20.997579 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8e925-487c-4794-8705-288fad86b6fd admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:21.001957 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d21b9d-0d02-4834-9371-6fb96b683afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:21.002577 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d21b9d-0d02-4834-9371-6fb96b683afa admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:21.002892 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d21b9d-0d02-4834-9371-6fb96b683afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:21.003163 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d21b9d-0d02-4834-9371-6fb96b683afa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:21.011252 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d21b9d-0d02-4834-9371-6fb96b683afa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:21.012970 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d21b9d-0d02-4834-9371-6fb96b683afa admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:21.021616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 547/1073] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:51:20 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:51:21.027345 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd6b55-c055-47b9-b5c1-0b43f5f0f08e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:21.036974 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd6b55-c055-47b9-b5c1-0b43f5f0f08e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:21.041615 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeda62d-87f1-4e25-8968-26db4cc492d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:21.042406 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeda62d-87f1-4e25-8968-26db4cc492d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:21.042709 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeda62d-87f1-4e25-8968-26db4cc492d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:21.042984 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeda62d-87f1-4e25-8968-26db4cc492d3 admin admin] PATH_INFO: `/v3/projects/81cd31799a904ecda7fe1e54f024b4e5` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:21.044186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeda62d-87f1-4e25-8968-26db4cc492d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=81cd31799a904ecda7fe1e54f024b4e5)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:21.046224 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeda62d-87f1-4e25-8968-26db4cc492d3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:21.047900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 527/1074] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:51:21 2022] GET /identity/v3/projects/81cd31799a904ecda7fe1e54f024b4e5 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:21.054368 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d21b9d-0d02-4834-9371-6fb96b683afa admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:21.063279 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d21b9d-0d02-4834-9371-6fb96b683afa admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:21.067825 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265ecab-0990-4d06-8bb4-9b4164304f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:21.069080 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265ecab-0990-4d06-8bb4-9b4164304f9f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:21.069443 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265ecab-0990-4d06-8bb4-9b4164304f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:21.069724 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265ecab-0990-4d06-8bb4-9b4164304f9f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:21.070538 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265ecab-0990-4d06-8bb4-9b4164304f9f admin admin] RBAC: Adding query filter params (role.id=8263a29ceeed4576b3b6959c99964ed7, scope.project.id=81cd31799a904ecda7fe1e54f024b4e5, user.id=453424cdeca44b2a8b510e0561be23f5) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:21.070876 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265ecab-0990-4d06-8bb4-9b4164304f9f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:21.072684 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265ecab-0990-4d06-8bb4-9b4164304f9f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:21.078032 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 548/1075] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:51:21 2022] GET /identity/v3/role_assignments?user.id=453424cdeca44b2a8b510e0561be23f5&scope.project.id=81cd31799a904ecda7fe1e54f024b4e5&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:22.293332 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdcd77-c774-4717-aa6d-60ed8c91d23d None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:22.293855 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdcd77-c774-4717-aa6d-60ed8c91d23d None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:22.293855 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdcd77-c774-4717-aa6d-60ed8c91d23d None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:22.295676 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 528/1076] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:22.300833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14365bbc-7549-4425-aaf2-b4de38c447af None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:22.301229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14365bbc-7549-4425-aaf2-b4de38c447af None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:22.301379 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14365bbc-7549-4425-aaf2-b4de38c447af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:22.320109 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-14365bbc-7549-4425-aaf2-b4de38c447af None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:22.321424 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-14365bbc-7549-4425-aaf2-b4de38c447af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:22.329160 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 549/1077] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:22 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:22.354226 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdcd77-c774-4717-aa6d-60ed8c91d23d None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:22.366886 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdcd77-c774-4717-aa6d-60ed8c91d23d None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:22.371412 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe8cda-49f4-46b4-8a2a-d770b808fd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:22.372186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe8cda-49f4-46b4-8a2a-d770b808fd6f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:22.372465 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe8cda-49f4-46b4-8a2a-d770b808fd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:22.372737 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe8cda-49f4-46b4-8a2a-d770b808fd6f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:22.383200 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe8cda-49f4-46b4-8a2a-d770b808fd6f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:51:22.390311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-29fe8cda-49f4-46b4-8a2a-d770b808fd6f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 16:51:22.391467 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 529/1078] 10.222.0.42 () {56 vars in 1141 bytes} [Wed Feb 16 16:51:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:22.397511 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14365bbc-7549-4425-aaf2-b4de38c447af None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:22.408000 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14365bbc-7549-4425-aaf2-b4de38c447af None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:22.413152 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c5444-cced-4b75-a571-0688a65c3690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:22.413867 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c5444-cced-4b75-a571-0688a65c3690 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:22.414218 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c5444-cced-4b75-a571-0688a65c3690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:22.414555 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c5444-cced-4b75-a571-0688a65c3690 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:22.415390 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c5444-cced-4b75-a571-0688a65c3690 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:22.415691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c5444-cced-4b75-a571-0688a65c3690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:22.417256 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c5444-cced-4b75-a571-0688a65c3690 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:22.425307 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 550/1079] 10.222.0.42 () {56 vars in 1136 bytes} [Wed Feb 16 16:51:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:51:22.432279 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe8cda-49f4-46b4-8a2a-d770b808fd6f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:22.442458 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe8cda-49f4-46b4-8a2a-d770b808fd6f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:22.448237 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66eede-2d57-4e6b-99db-40970f962781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:22.448997 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66eede-2d57-4e6b-99db-40970f962781 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:22.449275 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66eede-2d57-4e6b-99db-40970f962781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:22.449574 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66eede-2d57-4e6b-99db-40970f962781 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:22.460057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66eede-2d57-4e6b-99db-40970f962781 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:22.462027 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66eede-2d57-4e6b-99db-40970f962781 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:22.478821 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-0e66eede-2d57-4e6b-99db-40970f962781 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:51:22.479973 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 530/1080] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:22.485916 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c5444-cced-4b75-a571-0688a65c3690 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:22.496324 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c5444-cced-4b75-a571-0688a65c3690 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:22.500848 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94c043-d78d-4fd0-bbd1-f049eb5b4102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:22.501489 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94c043-d78d-4fd0-bbd1-f049eb5b4102 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:22.501771 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94c043-d78d-4fd0-bbd1-f049eb5b4102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:22.502042 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94c043-d78d-4fd0-bbd1-f049eb5b4102 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:22.502785 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94c043-d78d-4fd0-bbd1-f049eb5b4102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:22.503092 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94c043-d78d-4fd0-bbd1-f049eb5b4102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:22.504654 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94c043-d78d-4fd0-bbd1-f049eb5b4102 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:22.516625 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 551/1081] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:22.522087 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66eede-2d57-4e6b-99db-40970f962781 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:22.531828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66eede-2d57-4e6b-99db-40970f962781 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:22.536325 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34d14d-b6da-47f0-937e-b153a10b9b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:22.537251 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34d14d-b6da-47f0-937e-b153a10b9b28 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:22.537537 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34d14d-b6da-47f0-937e-b153a10b9b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:22.537815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34d14d-b6da-47f0-937e-b153a10b9b28 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:22.545117 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34d14d-b6da-47f0-937e-b153a10b9b28 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:22.547059 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34d14d-b6da-47f0-937e-b153a10b9b28 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:22.561135 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-8e34d14d-b6da-47f0-937e-b153a10b9b28 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 16:51:22.562270 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 531/1082] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Feb 16 16:51:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:51:22.567932 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94c043-d78d-4fd0-bbd1-f049eb5b4102 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:22.578284 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94c043-d78d-4fd0-bbd1-f049eb5b4102 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:22.582870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a25dc-c85f-47ed-87c7-1403e66c6846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:22.583524 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a25dc-c85f-47ed-87c7-1403e66c6846 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:22.583968 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a25dc-c85f-47ed-87c7-1403e66c6846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:22.584250 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a25dc-c85f-47ed-87c7-1403e66c6846 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:22.585079 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a25dc-c85f-47ed-87c7-1403e66c6846 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:22.585384 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a25dc-c85f-47ed-87c7-1403e66c6846 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:22.587239 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a25dc-c85f-47ed-87c7-1403e66c6846 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:22.605307 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 552/1083] 10.222.0.42 () {56 vars in 1154 bytes} [Wed Feb 16 16:51:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:22.611368 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34d14d-b6da-47f0-937e-b153a10b9b28 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:22.628416 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34d14d-b6da-47f0-937e-b153a10b9b28 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:22.633066 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5d6a6-d522-478a-a019-996baf809a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:22.633699 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5d6a6-d522-478a-a019-996baf809a4b admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:22.633981 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5d6a6-d522-478a-a019-996baf809a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:22.634258 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5d6a6-d522-478a-a019-996baf809a4b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:22.642320 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5d6a6-d522-478a-a019-996baf809a4b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:22.644088 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5d6a6-d522-478a-a019-996baf809a4b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:22.653352 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 532/1084] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:51:22 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 16:51:22.659225 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a25dc-c85f-47ed-87c7-1403e66c6846 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:22.669601 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a25dc-c85f-47ed-87c7-1403e66c6846 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:22.674108 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03b55e-feec-4ae6-bf64-a58cc5deafaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:22.674907 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03b55e-feec-4ae6-bf64-a58cc5deafaf admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:22.675188 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03b55e-feec-4ae6-bf64-a58cc5deafaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:22.675457 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03b55e-feec-4ae6-bf64-a58cc5deafaf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:22.686394 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03b55e-feec-4ae6-bf64-a58cc5deafaf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:22.688237 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03b55e-feec-4ae6-bf64-a58cc5deafaf admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:22.704854 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-dd03b55e-feec-4ae6-bf64-a58cc5deafaf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:51:22.706008 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 553/1085] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:22.712186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5d6a6-d522-478a-a019-996baf809a4b admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:22.720987 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5d6a6-d522-478a-a019-996baf809a4b admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:22.726543 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc13321-5756-4041-8548-4fb775f833eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:22.727221 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc13321-5756-4041-8548-4fb775f833eb admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:22.727500 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc13321-5756-4041-8548-4fb775f833eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:22.727772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc13321-5756-4041-8548-4fb775f833eb admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:22.728489 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc13321-5756-4041-8548-4fb775f833eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:22.728795 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc13321-5756-4041-8548-4fb775f833eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:22.730355 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc13321-5756-4041-8548-4fb775f833eb admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:22.743120 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 533/1086] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:22.748650 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03b55e-feec-4ae6-bf64-a58cc5deafaf admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:22.758571 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03b55e-feec-4ae6-bf64-a58cc5deafaf admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:22.763348 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc4c68-886a-40aa-825b-9dde785ba3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:22.764174 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc4c68-886a-40aa-825b-9dde785ba3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:22.770381 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc4c68-886a-40aa-825b-9dde785ba3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:22.770381 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc4c68-886a-40aa-825b-9dde785ba3b7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:22.771996 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc4c68-886a-40aa-825b-9dde785ba3b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:22.774143 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc4c68-886a-40aa-825b-9dde785ba3b7 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:22.787725 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-80fc4c68-886a-40aa-825b-9dde785ba3b7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:51:22.789271 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 554/1087] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:51:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:22.794870 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc13321-5756-4041-8548-4fb775f833eb admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:22.805367 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc13321-5756-4041-8548-4fb775f833eb admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:22.809894 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df80b94-2256-4f7e-9caf-42a55259f833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:22.810599 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df80b94-2256-4f7e-9caf-42a55259f833 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:22.810989 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df80b94-2256-4f7e-9caf-42a55259f833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:22.811325 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df80b94-2256-4f7e-9caf-42a55259f833 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:22.812298 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df80b94-2256-4f7e-9caf-42a55259f833 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:22.812666 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df80b94-2256-4f7e-9caf-42a55259f833 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:22.814530 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df80b94-2256-4f7e-9caf-42a55259f833 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:22.826839 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 534/1088] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:51:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:22.832858 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc4c68-886a-40aa-825b-9dde785ba3b7 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:22.851660 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc4c68-886a-40aa-825b-9dde785ba3b7 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:22.856334 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f7b65-d60b-460c-8d0c-459e7049a8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:22.856976 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f7b65-d60b-460c-8d0c-459e7049a8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:22.857522 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f7b65-d60b-460c-8d0c-459e7049a8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:22.857796 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f7b65-d60b-460c-8d0c-459e7049a8d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:22.858615 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f7b65-d60b-460c-8d0c-459e7049a8d0 admin admin] RBAC: Adding query filter params (role.id=7a712c9c729e424bab90590b1f232d0b, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=9a30603a236e4681a7702eec7029e9db) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:22.858959 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f7b65-d60b-460c-8d0c-459e7049a8d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:22.860781 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f7b65-d60b-460c-8d0c-459e7049a8d0 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:22.867577 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 555/1089] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:51:22 2022] GET /identity/v3/role_assignments?user.id=9a30603a236e4681a7702eec7029e9db&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=7a712c9c729e424bab90590b1f232d0b => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:23.370833 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1a851-af83-49bf-bde3-e52b83c2c942 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:23.371372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1a851-af83-49bf-bde3-e52b83c2c942 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:23.371372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1a851-af83-49bf-bde3-e52b83c2c942 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:23.373452 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 535/1090] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:23.378463 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d682365-6140-49c4-920e-916e978f48f0 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:23.378917 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d682365-6140-49c4-920e-916e978f48f0 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:23.379043 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d682365-6140-49c4-920e-916e978f48f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:23.397041 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-7d682365-6140-49c4-920e-916e978f48f0 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:23.398223 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-7d682365-6140-49c4-920e-916e978f48f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:23.406016 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 556/1091] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:23.430488 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1a851-af83-49bf-bde3-e52b83c2c942 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:23.443360 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1a851-af83-49bf-bde3-e52b83c2c942 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:23.448389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a57aed-e6d7-48ef-bb68-78fd1064d44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:23.449184 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a57aed-e6d7-48ef-bb68-78fd1064d44c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:23.449465 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a57aed-e6d7-48ef-bb68-78fd1064d44c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:23.449739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a57aed-e6d7-48ef-bb68-78fd1064d44c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:23.460377 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a57aed-e6d7-48ef-bb68-78fd1064d44c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:51:23.467214 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-f4a57aed-e6d7-48ef-bb68-78fd1064d44c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:51:23.468395 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 536/1092] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:51:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:23.474949 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d682365-6140-49c4-920e-916e978f48f0 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:23.484490 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d682365-6140-49c4-920e-916e978f48f0 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:23.489024 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a9d63-98c1-46c6-ac88-d71407c1ca46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:23.489688 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a9d63-98c1-46c6-ac88-d71407c1ca46 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:23.491173 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a9d63-98c1-46c6-ac88-d71407c1ca46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:23.491523 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a9d63-98c1-46c6-ac88-d71407c1ca46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:23.492269 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a9d63-98c1-46c6-ac88-d71407c1ca46 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:23.492572 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a9d63-98c1-46c6-ac88-d71407c1ca46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:23.494129 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a9d63-98c1-46c6-ac88-d71407c1ca46 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:23.502855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 557/1093] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:51:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:23.509425 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a57aed-e6d7-48ef-bb68-78fd1064d44c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:23.519895 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a57aed-e6d7-48ef-bb68-78fd1064d44c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:23.524744 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfdae1-7bc6-4899-aa8b-3557ad115677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:23.525600 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfdae1-7bc6-4899-aa8b-3557ad115677 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:23.525877 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfdae1-7bc6-4899-aa8b-3557ad115677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:23.526146 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfdae1-7bc6-4899-aa8b-3557ad115677 admin admin] PATH_INFO: `/v3/users/453424cdeca44b2a8b510e0561be23f5` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:23.527444 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfdae1-7bc6-4899-aa8b-3557ad115677 admin admin] RBAC: Authorizing `identity:get_user(user_id=453424cdeca44b2a8b510e0561be23f5)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:23.529656 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfdae1-7bc6-4899-aa8b-3557ad115677 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:23.531891 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 537/1094] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:51:23 2022] GET /identity/v3/users/453424cdeca44b2a8b510e0561be23f5 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:23.537647 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a9d63-98c1-46c6-ac88-d71407c1ca46 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:23.547786 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a9d63-98c1-46c6-ac88-d71407c1ca46 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:23.552320 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00055d2c-ffa7-475e-bf55-363379bd45e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:23.553905 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00055d2c-ffa7-475e-bf55-363379bd45e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:23.554181 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00055d2c-ffa7-475e-bf55-363379bd45e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:23.554448 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00055d2c-ffa7-475e-bf55-363379bd45e3 admin admin] PATH_INFO: `/v3/projects/81cd31799a904ecda7fe1e54f024b4e5` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:23.555654 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00055d2c-ffa7-475e-bf55-363379bd45e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=81cd31799a904ecda7fe1e54f024b4e5)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:23.557669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00055d2c-ffa7-475e-bf55-363379bd45e3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:23.559377 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 558/1095] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:51:23 2022] GET /identity/v3/projects/81cd31799a904ecda7fe1e54f024b4e5 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:23.565274 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfdae1-7bc6-4899-aa8b-3557ad115677 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:23.576053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfdae1-7bc6-4899-aa8b-3557ad115677 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:23.581082 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce211c1b-4977-4149-bee0-fa4e90c3dd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:23.582017 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce211c1b-4977-4149-bee0-fa4e90c3dd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:23.582302 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce211c1b-4977-4149-bee0-fa4e90c3dd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:23.582581 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce211c1b-4977-4149-bee0-fa4e90c3dd08 admin admin] PATH_INFO: `/v3/projects/81cd31799a904ecda7fe1e54f024b4e5/users/453424cdeca44b2a8b510e0561be23f5/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:23.584703 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce211c1b-4977-4149-bee0-fa4e90c3dd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cd31799a904ecda7fe1e54f024b4e5, user_id=453424cdeca44b2a8b510e0561be23f5, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:23.587437 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce211c1b-4977-4149-bee0-fa4e90c3dd08 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:23.655752 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 538/1096] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:51:23 2022] PUT /identity/v3/projects/81cd31799a904ecda7fe1e54f024b4e5/users/453424cdeca44b2a8b510e0561be23f5/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:51:25.932661 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2257a-c581-4f72-adac-1a7b74b805d0 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:25.933180 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2257a-c581-4f72-adac-1a7b74b805d0 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:25.933180 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2257a-c581-4f72-adac-1a7b74b805d0 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:25.935008 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 559/1097] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:25.940133 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9340ad-d9c2-4826-a6e7-136e4feb99f4 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:25.940523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9340ad-d9c2-4826-a6e7-136e4feb99f4 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:25.940667 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9340ad-d9c2-4826-a6e7-136e4feb99f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:25.960303 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-ea9340ad-d9c2-4826-a6e7-136e4feb99f4 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:25.961464 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-ea9340ad-d9c2-4826-a6e7-136e4feb99f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:26.017805 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 539/1098] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:25 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 16:51:26.041236 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2257a-c581-4f72-adac-1a7b74b805d0 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:26.053652 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2257a-c581-4f72-adac-1a7b74b805d0 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:26.058028 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b65fa8-06fe-429a-8fdf-21d5631ba833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:26.058811 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b65fa8-06fe-429a-8fdf-21d5631ba833 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:26.059088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b65fa8-06fe-429a-8fdf-21d5631ba833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:26.059353 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b65fa8-06fe-429a-8fdf-21d5631ba833 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:26.070454 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b65fa8-06fe-429a-8fdf-21d5631ba833 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:51:26.077260 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-e9b65fa8-06fe-429a-8fdf-21d5631ba833 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:51:26.078382 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 560/1099] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:51:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:26.084198 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9340ad-d9c2-4826-a6e7-136e4feb99f4 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:26.092856 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9340ad-d9c2-4826-a6e7-136e4feb99f4 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:26.097265 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48089c43-586a-46f8-9c6b-63aeecdd9717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:26.097898 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48089c43-586a-46f8-9c6b-63aeecdd9717 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:26.098180 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48089c43-586a-46f8-9c6b-63aeecdd9717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:26.098450 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48089c43-586a-46f8-9c6b-63aeecdd9717 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:26.099224 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48089c43-586a-46f8-9c6b-63aeecdd9717 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:26.099589 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48089c43-586a-46f8-9c6b-63aeecdd9717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:26.101172 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48089c43-586a-46f8-9c6b-63aeecdd9717 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:26.109261 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 540/1100] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:51:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:26.115231 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b65fa8-06fe-429a-8fdf-21d5631ba833 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:26.124413 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b65fa8-06fe-429a-8fdf-21d5631ba833 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:26.128879 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d448157-5033-4bcc-b38d-01cd08e78a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:26.129702 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d448157-5033-4bcc-b38d-01cd08e78a35 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:26.129977 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d448157-5033-4bcc-b38d-01cd08e78a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:26.130246 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d448157-5033-4bcc-b38d-01cd08e78a35 admin admin] PATH_INFO: `/v3/users/453424cdeca44b2a8b510e0561be23f5` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:26.132165 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d448157-5033-4bcc-b38d-01cd08e78a35 admin admin] RBAC: Authorizing `identity:get_user(user_id=453424cdeca44b2a8b510e0561be23f5)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:26.134251 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d448157-5033-4bcc-b38d-01cd08e78a35 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:26.135845 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 561/1101] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:51:26 2022] GET /identity/v3/users/453424cdeca44b2a8b510e0561be23f5 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:26.141146 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48089c43-586a-46f8-9c6b-63aeecdd9717 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:26.150733 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48089c43-586a-46f8-9c6b-63aeecdd9717 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:26.155159 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec9e09-5bcd-4d26-8b64-64f11ec0439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:26.155768 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec9e09-5bcd-4d26-8b64-64f11ec0439e admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:26.156045 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec9e09-5bcd-4d26-8b64-64f11ec0439e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:26.156318 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec9e09-5bcd-4d26-8b64-64f11ec0439e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:26.164075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec9e09-5bcd-4d26-8b64-64f11ec0439e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:26.165728 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec9e09-5bcd-4d26-8b64-64f11ec0439e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:26.174386 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 541/1102] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:51:26 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 16:51:26.180347 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d448157-5033-4bcc-b38d-01cd08e78a35 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:26.189617 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d448157-5033-4bcc-b38d-01cd08e78a35 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:26.194601 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f85fd-15e2-48b3-88d1-3c2c0129058a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:26.195436 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f85fd-15e2-48b3-88d1-3c2c0129058a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:26.195713 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f85fd-15e2-48b3-88d1-3c2c0129058a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:26.195983 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f85fd-15e2-48b3-88d1-3c2c0129058a admin admin] PATH_INFO: `/v3/projects/81cd31799a904ecda7fe1e54f024b4e5` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:26.197116 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f85fd-15e2-48b3-88d1-3c2c0129058a admin admin] RBAC: Authorizing `identity:get_project(project_id=81cd31799a904ecda7fe1e54f024b4e5)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:26.199142 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f85fd-15e2-48b3-88d1-3c2c0129058a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:26.200760 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 562/1103] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:51:26 2022] GET /identity/v3/projects/81cd31799a904ecda7fe1e54f024b4e5 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:26.206218 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec9e09-5bcd-4d26-8b64-64f11ec0439e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:26.216076 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec9e09-5bcd-4d26-8b64-64f11ec0439e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:26.220587 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbb720-6ca4-48f5-85cd-4367939c53f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:26.233841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbb720-6ca4-48f5-85cd-4367939c53f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:26.233841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbb720-6ca4-48f5-85cd-4367939c53f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:26.233841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbb720-6ca4-48f5-85cd-4367939c53f6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:26.233841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbb720-6ca4-48f5-85cd-4367939c53f6 admin admin] RBAC: Adding query filter params (role.id=8263a29ceeed4576b3b6959c99964ed7, scope.project.id=81cd31799a904ecda7fe1e54f024b4e5, user.id=453424cdeca44b2a8b510e0561be23f5) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:26.233841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbb720-6ca4-48f5-85cd-4367939c53f6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:26.234238 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbb720-6ca4-48f5-85cd-4367939c53f6 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:26.234238 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 542/1104] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:51:26 2022] GET /identity/v3/role_assignments?user.id=453424cdeca44b2a8b510e0561be23f5&scope.project.id=81cd31799a904ecda7fe1e54f024b4e5&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:28.553720 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6a135-9bc8-4610-bb20-5cf0babd522a None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:28.554178 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6a135-9bc8-4610-bb20-5cf0babd522a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:28.554265 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6a135-9bc8-4610-bb20-5cf0babd522a None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:28.556073 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 563/1105] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:28.561411 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651ba3d-34e3-49ef-b218-2f5d2b58dfc1 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:28.561810 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651ba3d-34e3-49ef-b218-2f5d2b58dfc1 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:28.561964 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651ba3d-34e3-49ef-b218-2f5d2b58dfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:28.579356 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-c651ba3d-34e3-49ef-b218-2f5d2b58dfc1 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:28.580528 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-c651ba3d-34e3-49ef-b218-2f5d2b58dfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:28.588705 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 543/1106] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:28 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:28.614123 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6a135-9bc8-4610-bb20-5cf0babd522a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:28.626943 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6a135-9bc8-4610-bb20-5cf0babd522a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:28.632046 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ea044-63c0-472b-8e20-0d9d9bb25297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:28.632804 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ea044-63c0-472b-8e20-0d9d9bb25297 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:28.633083 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ea044-63c0-472b-8e20-0d9d9bb25297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:28.633355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ea044-63c0-472b-8e20-0d9d9bb25297 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:28.634495 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ea044-63c0-472b-8e20-0d9d9bb25297 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:28.636185 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ea044-63c0-472b-8e20-0d9d9bb25297 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:28.637744 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 564/1107] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:28.643290 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651ba3d-34e3-49ef-b218-2f5d2b58dfc1 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:28.652800 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651ba3d-34e3-49ef-b218-2f5d2b58dfc1 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:28.657293 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f40aba-9ce1-4358-a5f7-d63c8024fe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:28.657933 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f40aba-9ce1-4358-a5f7-d63c8024fe1f admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:28.658211 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f40aba-9ce1-4358-a5f7-d63c8024fe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:28.658482 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f40aba-9ce1-4358-a5f7-d63c8024fe1f admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:28.659217 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f40aba-9ce1-4358-a5f7-d63c8024fe1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:28.661076 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f40aba-9ce1-4358-a5f7-d63c8024fe1f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:28.797016 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 544/1108] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Feb 16 16:51:28 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:51:31.172041 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0862bf2-e2ae-471e-9976-d8aba11054c5 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:31.172595 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0862bf2-e2ae-471e-9976-d8aba11054c5 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:31.172595 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0862bf2-e2ae-471e-9976-d8aba11054c5 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:31.174365 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 565/1109] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:31.179642 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dd6de-9242-4754-b096-80718bb9637e None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:31.180040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dd6de-9242-4754-b096-80718bb9637e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:31.180195 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dd6de-9242-4754-b096-80718bb9637e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:31.198212 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-2f9dd6de-9242-4754-b096-80718bb9637e None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:31.199432 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-2f9dd6de-9242-4754-b096-80718bb9637e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:31.207111 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 545/1110] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:31 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:31.232046 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0862bf2-e2ae-471e-9976-d8aba11054c5 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:31.245392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0862bf2-e2ae-471e-9976-d8aba11054c5 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:31.249686 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6aa481-4e81-4037-9c7d-98c9023da595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:31.250503 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6aa481-4e81-4037-9c7d-98c9023da595 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:31.250821 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6aa481-4e81-4037-9c7d-98c9023da595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:31.251093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6aa481-4e81-4037-9c7d-98c9023da595 admin admin] PATH_INFO: `/v3/roles/cf30e55f556b4e0cbee0317b16316b0f` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:31.252541 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6aa481-4e81-4037-9c7d-98c9023da595 admin admin] RBAC: Authorizing `identity:get_role(role_id=cf30e55f556b4e0cbee0317b16316b0f)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:31.253546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-7f6aa481-4e81-4037-9c7d-98c9023da595 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:51:31.253546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 16:51:31.253546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 16:51:31.254403 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6aa481-4e81-4037-9c7d-98c9023da595 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:31.256611 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 566/1111] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:51:31 2022] GET /identity/v3/roles/cf30e55f556b4e0cbee0317b16316b0f => generated 223 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:31.261983 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dd6de-9242-4754-b096-80718bb9637e None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:31.270808 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dd6de-9242-4754-b096-80718bb9637e None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:31.275494 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97109bf4-c922-4b55-9ee4-bbd6a9edd9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:31.276331 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97109bf4-c922-4b55-9ee4-bbd6a9edd9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:31.276614 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97109bf4-c922-4b55-9ee4-bbd6a9edd9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:31.276890 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97109bf4-c922-4b55-9ee4-bbd6a9edd9b2 admin admin] PATH_INFO: `/v3/users/8280edd99cec46b0b9ab33d47a405879` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:31.289919 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97109bf4-c922-4b55-9ee4-bbd6a9edd9b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=8280edd99cec46b0b9ab33d47a405879)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:31.292092 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97109bf4-c922-4b55-9ee4-bbd6a9edd9b2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:31.293706 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 546/1112] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:51:31 2022] GET /identity/v3/users/8280edd99cec46b0b9ab33d47a405879 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:31.299047 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6aa481-4e81-4037-9c7d-98c9023da595 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:31.309012 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6aa481-4e81-4037-9c7d-98c9023da595 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:31.313459 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b3401-8a71-4bda-8951-495b59aa18a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:31.314075 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b3401-8a71-4bda-8951-495b59aa18a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:31.314358 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b3401-8a71-4bda-8951-495b59aa18a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:31.314633 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b3401-8a71-4bda-8951-495b59aa18a4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:31.322850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b3401-8a71-4bda-8951-495b59aa18a4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:31.324564 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b3401-8a71-4bda-8951-495b59aa18a4 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:31.333195 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 567/1113] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:51:31 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:51:31.338797 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97109bf4-c922-4b55-9ee4-bbd6a9edd9b2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:31.347980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97109bf4-c922-4b55-9ee4-bbd6a9edd9b2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:31.352461 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05297b-253d-48f9-afdd-26cb62c4c064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:31.353275 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05297b-253d-48f9-afdd-26cb62c4c064 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:31.353551 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05297b-253d-48f9-afdd-26cb62c4c064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:31.353817 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05297b-253d-48f9-afdd-26cb62c4c064 admin admin] PATH_INFO: `/v3/projects/81cd31799a904ecda7fe1e54f024b4e5` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:31.354992 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05297b-253d-48f9-afdd-26cb62c4c064 admin admin] RBAC: Authorizing `identity:get_project(project_id=81cd31799a904ecda7fe1e54f024b4e5)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:31.356954 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05297b-253d-48f9-afdd-26cb62c4c064 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:31.358837 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 547/1114] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:51:31 2022] GET /identity/v3/projects/81cd31799a904ecda7fe1e54f024b4e5 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:31.364413 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b3401-8a71-4bda-8951-495b59aa18a4 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:31.373423 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b3401-8a71-4bda-8951-495b59aa18a4 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:31.377928 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5a0c6-191e-4f5d-a26f-78deff81cc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:31.378537 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5a0c6-191e-4f5d-a26f-78deff81cc2c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:31.378856 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5a0c6-191e-4f5d-a26f-78deff81cc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:31.379132 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5a0c6-191e-4f5d-a26f-78deff81cc2c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:31.379934 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5a0c6-191e-4f5d-a26f-78deff81cc2c admin admin] RBAC: Adding query filter params (role.id=cf30e55f556b4e0cbee0317b16316b0f, scope.project.id=81cd31799a904ecda7fe1e54f024b4e5, user.id=8280edd99cec46b0b9ab33d47a405879) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:31.380835 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5a0c6-191e-4f5d-a26f-78deff81cc2c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:31.382617 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5a0c6-191e-4f5d-a26f-78deff81cc2c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:31.387816 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 568/1115] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:51:31 2022] GET /identity/v3/role_assignments?user.id=8280edd99cec46b0b9ab33d47a405879&scope.project.id=81cd31799a904ecda7fe1e54f024b4e5&role.id=cf30e55f556b4e0cbee0317b16316b0f => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:33.700154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb0510-39fe-4341-880b-41c5e6936a37 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:33.700697 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb0510-39fe-4341-880b-41c5e6936a37 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:33.700697 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb0510-39fe-4341-880b-41c5e6936a37 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:33.702435 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 548/1116] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:33.707576 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9986f2-c30a-4f48-b14b-b4f946b7fd9d None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:33.707949 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9986f2-c30a-4f48-b14b-b4f946b7fd9d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:33.708121 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9986f2-c30a-4f48-b14b-b4f946b7fd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:33.726834 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-7f9986f2-c30a-4f48-b14b-b4f946b7fd9d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:33.728013 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-7f9986f2-c30a-4f48-b14b-b4f946b7fd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:33.735962 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 569/1117] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:33.758996 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb0510-39fe-4341-880b-41c5e6936a37 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:33.771526 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb0510-39fe-4341-880b-41c5e6936a37 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:33.775926 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fd2da-b809-4cd5-9e32-0b7c95f87692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:33.776755 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fd2da-b809-4cd5-9e32-0b7c95f87692 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:33.777038 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fd2da-b809-4cd5-9e32-0b7c95f87692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:33.777315 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fd2da-b809-4cd5-9e32-0b7c95f87692 admin admin] PATH_INFO: `/v3/roles/cf30e55f556b4e0cbee0317b16316b0f` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:33.778856 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fd2da-b809-4cd5-9e32-0b7c95f87692 admin admin] RBAC: Authorizing `identity:get_role(role_id=cf30e55f556b4e0cbee0317b16316b0f)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:33.779810 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING py.warnings [None req-179fd2da-b809-4cd5-9e32-0b7c95f87692 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:51:33.779810 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: warnings.warn(msg) Feb 16 16:51:33.779810 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: Feb 16 16:51:33.780661 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fd2da-b809-4cd5-9e32-0b7c95f87692 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:33.781964 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 549/1118] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:51:33 2022] GET /identity/v3/roles/cf30e55f556b4e0cbee0317b16316b0f => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:33.788293 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9986f2-c30a-4f48-b14b-b4f946b7fd9d None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:33.796987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9986f2-c30a-4f48-b14b-b4f946b7fd9d None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:33.801450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce26b12-b3a1-4251-b9a9-2b6a4e085d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:33.802485 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce26b12-b3a1-4251-b9a9-2b6a4e085d18 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:33.802874 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce26b12-b3a1-4251-b9a9-2b6a4e085d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:33.803152 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce26b12-b3a1-4251-b9a9-2b6a4e085d18 admin admin] PATH_INFO: `/v3/users/8280edd99cec46b0b9ab33d47a405879` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:33.804341 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce26b12-b3a1-4251-b9a9-2b6a4e085d18 admin admin] RBAC: Authorizing `identity:get_user(user_id=8280edd99cec46b0b9ab33d47a405879)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:33.806460 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce26b12-b3a1-4251-b9a9-2b6a4e085d18 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:33.808052 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 570/1119] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:51:33 2022] GET /identity/v3/users/8280edd99cec46b0b9ab33d47a405879 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:33.813234 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fd2da-b809-4cd5-9e32-0b7c95f87692 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:33.823193 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fd2da-b809-4cd5-9e32-0b7c95f87692 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:33.827751 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce20b48-e7ed-4c0a-81d8-ce2ee0d10bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:33.828571 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce20b48-e7ed-4c0a-81d8-ce2ee0d10bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:33.828847 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce20b48-e7ed-4c0a-81d8-ce2ee0d10bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:33.829117 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce20b48-e7ed-4c0a-81d8-ce2ee0d10bf1 admin admin] PATH_INFO: `/v3/projects/81cd31799a904ecda7fe1e54f024b4e5` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:33.830253 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce20b48-e7ed-4c0a-81d8-ce2ee0d10bf1 admin admin] RBAC: Authorizing `identity:get_project(project_id=81cd31799a904ecda7fe1e54f024b4e5)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:33.832284 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce20b48-e7ed-4c0a-81d8-ce2ee0d10bf1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:33.834383 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 550/1120] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:51:33 2022] GET /identity/v3/projects/81cd31799a904ecda7fe1e54f024b4e5 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:33.839944 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce26b12-b3a1-4251-b9a9-2b6a4e085d18 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:33.850130 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce26b12-b3a1-4251-b9a9-2b6a4e085d18 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:33.854746 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad8ce1-fc7a-417f-8c41-d7ff9aec3d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:33.855591 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad8ce1-fc7a-417f-8c41-d7ff9aec3d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:33.855870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad8ce1-fc7a-417f-8c41-d7ff9aec3d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:33.856141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad8ce1-fc7a-417f-8c41-d7ff9aec3d99 admin admin] PATH_INFO: `/v3/projects/81cd31799a904ecda7fe1e54f024b4e5/users/8280edd99cec46b0b9ab33d47a405879/roles/cf30e55f556b4e0cbee0317b16316b0f` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:33.858579 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad8ce1-fc7a-417f-8c41-d7ff9aec3d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cd31799a904ecda7fe1e54f024b4e5, user_id=8280edd99cec46b0b9ab33d47a405879, role_id=cf30e55f556b4e0cbee0317b16316b0f)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:33.861191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad8ce1-fc7a-417f-8c41-d7ff9aec3d99 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:33.940667 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 571/1121] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:51:33 2022] PUT /identity/v3/projects/81cd31799a904ecda7fe1e54f024b4e5/users/8280edd99cec46b0b9ab33d47a405879/roles/cf30e55f556b4e0cbee0317b16316b0f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:51:36.230800 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b787-9d45-4ec4-85f5-b52f01179916 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:36.231324 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b787-9d45-4ec4-85f5-b52f01179916 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:36.231413 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b787-9d45-4ec4-85f5-b52f01179916 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:36.233384 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 551/1122] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:36.238638 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ab04a-2192-4601-90d8-48ad94f64ef9 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:36.239099 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ab04a-2192-4601-90d8-48ad94f64ef9 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:36.239201 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ab04a-2192-4601-90d8-48ad94f64ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:36.257204 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-8e7ab04a-2192-4601-90d8-48ad94f64ef9 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:36.258381 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8e7ab04a-2192-4601-90d8-48ad94f64ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:36.315262 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 572/1123] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:36 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:36.339076 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76b787-9d45-4ec4-85f5-b52f01179916 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:36.351629 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76b787-9d45-4ec4-85f5-b52f01179916 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:36.355971 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53517020-5106-4fca-bbdc-5458bc4e7c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:36.356793 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53517020-5106-4fca-bbdc-5458bc4e7c42 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:36.357074 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53517020-5106-4fca-bbdc-5458bc4e7c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:36.357621 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53517020-5106-4fca-bbdc-5458bc4e7c42 admin admin] PATH_INFO: `/v3/roles/cf30e55f556b4e0cbee0317b16316b0f` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:36.359120 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53517020-5106-4fca-bbdc-5458bc4e7c42 admin admin] RBAC: Authorizing `identity:get_role(role_id=cf30e55f556b4e0cbee0317b16316b0f)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:36.360684 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53517020-5106-4fca-bbdc-5458bc4e7c42 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:36.361983 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 552/1124] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:51:36 2022] GET /identity/v3/roles/cf30e55f556b4e0cbee0317b16316b0f => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:36.368088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ab04a-2192-4601-90d8-48ad94f64ef9 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:36.376794 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ab04a-2192-4601-90d8-48ad94f64ef9 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:36.381267 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69251fc-fc70-4b80-8c88-4d3413ca11d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:36.382103 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69251fc-fc70-4b80-8c88-4d3413ca11d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:36.382378 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69251fc-fc70-4b80-8c88-4d3413ca11d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:36.382663 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69251fc-fc70-4b80-8c88-4d3413ca11d6 admin admin] PATH_INFO: `/v3/users/8280edd99cec46b0b9ab33d47a405879` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:36.383833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69251fc-fc70-4b80-8c88-4d3413ca11d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=8280edd99cec46b0b9ab33d47a405879)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:36.385913 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69251fc-fc70-4b80-8c88-4d3413ca11d6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:36.387481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 573/1125] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:51:36 2022] GET /identity/v3/users/8280edd99cec46b0b9ab33d47a405879 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:36.392782 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53517020-5106-4fca-bbdc-5458bc4e7c42 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:36.402214 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53517020-5106-4fca-bbdc-5458bc4e7c42 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:36.406740 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728f2d7-50c6-4270-9c92-b49e46886c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:36.407347 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728f2d7-50c6-4270-9c92-b49e46886c1c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:36.407629 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728f2d7-50c6-4270-9c92-b49e46886c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:36.407906 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728f2d7-50c6-4270-9c92-b49e46886c1c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:36.416228 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728f2d7-50c6-4270-9c92-b49e46886c1c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:36.417929 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728f2d7-50c6-4270-9c92-b49e46886c1c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:36.426578 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 553/1126] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:51:36 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:51:36.432422 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69251fc-fc70-4b80-8c88-4d3413ca11d6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:36.441486 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69251fc-fc70-4b80-8c88-4d3413ca11d6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:36.445926 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d075804-0147-4f60-9cc6-af770edf1e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:36.446750 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d075804-0147-4f60-9cc6-af770edf1e34 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:36.447028 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d075804-0147-4f60-9cc6-af770edf1e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:36.447294 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d075804-0147-4f60-9cc6-af770edf1e34 admin admin] PATH_INFO: `/v3/projects/81cd31799a904ecda7fe1e54f024b4e5` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:36.448420 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d075804-0147-4f60-9cc6-af770edf1e34 admin admin] RBAC: Authorizing `identity:get_project(project_id=81cd31799a904ecda7fe1e54f024b4e5)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:36.450360 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d075804-0147-4f60-9cc6-af770edf1e34 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:36.451963 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 574/1127] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:51:36 2022] GET /identity/v3/projects/81cd31799a904ecda7fe1e54f024b4e5 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:36.457612 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728f2d7-50c6-4270-9c92-b49e46886c1c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:36.466627 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728f2d7-50c6-4270-9c92-b49e46886c1c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:36.471368 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0355f0-6627-4246-a15c-b28b2aa8879a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:36.471982 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0355f0-6627-4246-a15c-b28b2aa8879a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:36.472322 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0355f0-6627-4246-a15c-b28b2aa8879a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:36.472602 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0355f0-6627-4246-a15c-b28b2aa8879a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:36.473417 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0355f0-6627-4246-a15c-b28b2aa8879a admin admin] RBAC: Adding query filter params (role.id=cf30e55f556b4e0cbee0317b16316b0f, scope.project.id=81cd31799a904ecda7fe1e54f024b4e5, user.id=8280edd99cec46b0b9ab33d47a405879) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:36.473730 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0355f0-6627-4246-a15c-b28b2aa8879a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:36.476356 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0355f0-6627-4246-a15c-b28b2aa8879a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:36.482104 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 554/1128] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:51:36 2022] GET /identity/v3/role_assignments?user.id=8280edd99cec46b0b9ab33d47a405879&scope.project.id=81cd31799a904ecda7fe1e54f024b4e5&role.id=cf30e55f556b4e0cbee0317b16316b0f => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:38.759992 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8378cd5-fd00-4fb1-bb73-b0d7af1f9236 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:38.760564 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8378cd5-fd00-4fb1-bb73-b0d7af1f9236 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:38.760564 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8378cd5-fd00-4fb1-bb73-b0d7af1f9236 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:38.762303 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 575/1129] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:38.767604 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436271e-1d27-4f2c-9dc0-3e7b9ebd2a14 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:38.768056 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436271e-1d27-4f2c-9dc0-3e7b9ebd2a14 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:38.768156 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436271e-1d27-4f2c-9dc0-3e7b9ebd2a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:38.786291 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-c436271e-1d27-4f2c-9dc0-3e7b9ebd2a14 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:38.787423 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-c436271e-1d27-4f2c-9dc0-3e7b9ebd2a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:38.795006 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 555/1130] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:38.820100 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8378cd5-fd00-4fb1-bb73-b0d7af1f9236 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:38.832243 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8378cd5-fd00-4fb1-bb73-b0d7af1f9236 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:38.836869 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94fcd1-8919-44fe-9586-667655184b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:38.837633 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94fcd1-8919-44fe-9586-667655184b22 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:38.837912 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94fcd1-8919-44fe-9586-667655184b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:38.838184 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94fcd1-8919-44fe-9586-667655184b22 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:38.839340 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94fcd1-8919-44fe-9586-667655184b22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:38.841008 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94fcd1-8919-44fe-9586-667655184b22 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:38.842668 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 576/1131] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:38.848104 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436271e-1d27-4f2c-9dc0-3e7b9ebd2a14 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:38.856819 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436271e-1d27-4f2c-9dc0-3e7b9ebd2a14 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:38.861582 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87974ea8-b809-41eb-886f-783b87f36572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:38.862205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87974ea8-b809-41eb-886f-783b87f36572 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:38.862485 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87974ea8-b809-41eb-886f-783b87f36572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:38.862801 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87974ea8-b809-41eb-886f-783b87f36572 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:38.863500 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87974ea8-b809-41eb-886f-783b87f36572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:38.866069 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87974ea8-b809-41eb-886f-783b87f36572 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:38.969959 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 556/1132] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Feb 16 16:51:38 2022] POST /identity/v3/projects => generated 311 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:51:41.302807 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e49a5-a4c5-4235-9558-c29ffe2d3747 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:41.303351 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e49a5-a4c5-4235-9558-c29ffe2d3747 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:41.303351 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e49a5-a4c5-4235-9558-c29ffe2d3747 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:41.305197 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 577/1133] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:41.310432 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa1e14-cff2-4926-b0c7-5450e6cac126 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:41.310904 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa1e14-cff2-4926-b0c7-5450e6cac126 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:41.311004 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa1e14-cff2-4926-b0c7-5450e6cac126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:41.328928 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-d6fa1e14-cff2-4926-b0c7-5450e6cac126 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:41.330117 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d6fa1e14-cff2-4926-b0c7-5450e6cac126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:41.386563 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 557/1134] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:41 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:41.412236 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e49a5-a4c5-4235-9558-c29ffe2d3747 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:41.424400 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e49a5-a4c5-4235-9558-c29ffe2d3747 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:41.429530 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb1313-330a-4656-841b-959ab4b7f7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:41.430294 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb1313-330a-4656-841b-959ab4b7f7bb admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:41.430597 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb1313-330a-4656-841b-959ab4b7f7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:41.430984 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb1313-330a-4656-841b-959ab4b7f7bb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:41.432155 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb1313-330a-4656-841b-959ab4b7f7bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:41.433853 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb1313-330a-4656-841b-959ab4b7f7bb admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:41.435455 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 578/1135] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:51:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:41.440840 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa1e14-cff2-4926-b0c7-5450e6cac126 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:41.449460 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa1e14-cff2-4926-b0c7-5450e6cac126 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:41.453874 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d40487-6a5b-45d3-89de-75abe6bcf67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:41.454507 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d40487-6a5b-45d3-89de-75abe6bcf67b admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:41.454821 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d40487-6a5b-45d3-89de-75abe6bcf67b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:41.455091 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d40487-6a5b-45d3-89de-75abe6bcf67b admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:41.455783 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d40487-6a5b-45d3-89de-75abe6bcf67b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:41.457636 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d40487-6a5b-45d3-89de-75abe6bcf67b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:41.563780 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 558/1136] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Feb 16 16:51:41 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:51:43.933138 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872eee9-00ea-4200-904a-869ad5edcbdb None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:43.933668 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872eee9-00ea-4200-904a-869ad5edcbdb None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:43.933668 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872eee9-00ea-4200-904a-869ad5edcbdb None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:43.935484 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 579/1137] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:43.940531 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7605433-b8f1-4822-88a8-3168329e2dbf None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:43.940956 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7605433-b8f1-4822-88a8-3168329e2dbf None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:43.941056 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7605433-b8f1-4822-88a8-3168329e2dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:43.959276 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-e7605433-b8f1-4822-88a8-3168329e2dbf None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:43.960442 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e7605433-b8f1-4822-88a8-3168329e2dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:43.967977 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 559/1138] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:43 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:43.992212 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872eee9-00ea-4200-904a-869ad5edcbdb None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:44.003980 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872eee9-00ea-4200-904a-869ad5edcbdb None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:44.008774 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7147b9f-6650-4df2-89b3-4661ebc45ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:44.009523 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7147b9f-6650-4df2-89b3-4661ebc45ccd admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:44.009796 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7147b9f-6650-4df2-89b3-4661ebc45ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:44.010063 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7147b9f-6650-4df2-89b3-4661ebc45ccd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:44.019821 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7147b9f-6650-4df2-89b3-4661ebc45ccd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:51:44.027330 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-f7147b9f-6650-4df2-89b3-4661ebc45ccd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:51:44.028439 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 580/1139] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:51:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:44.033963 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7605433-b8f1-4822-88a8-3168329e2dbf None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:44.043319 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7605433-b8f1-4822-88a8-3168329e2dbf None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:44.047768 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962b067-8308-492f-b00e-85f2603a03d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:44.048430 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962b067-8308-492f-b00e-85f2603a03d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:44.048707 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962b067-8308-492f-b00e-85f2603a03d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:44.048977 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962b067-8308-492f-b00e-85f2603a03d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:44.049719 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962b067-8308-492f-b00e-85f2603a03d9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:44.050022 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962b067-8308-492f-b00e-85f2603a03d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:44.051969 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962b067-8308-492f-b00e-85f2603a03d9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:44.059553 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 560/1140] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:51:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:44.064755 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7147b9f-6650-4df2-89b3-4661ebc45ccd admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:44.074483 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7147b9f-6650-4df2-89b3-4661ebc45ccd admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:44.078908 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2ee32-3138-4d3a-93b8-0873f1c44f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:44.079727 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2ee32-3138-4d3a-93b8-0873f1c44f58 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:44.080001 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2ee32-3138-4d3a-93b8-0873f1c44f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:44.080269 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2ee32-3138-4d3a-93b8-0873f1c44f58 admin admin] PATH_INFO: `/v3/users/26fcd8e429eb45678b0093b4ce24a380` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:44.093617 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2ee32-3138-4d3a-93b8-0873f1c44f58 admin admin] RBAC: Authorizing `identity:get_user(user_id=26fcd8e429eb45678b0093b4ce24a380)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:44.095758 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2ee32-3138-4d3a-93b8-0873f1c44f58 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:44.097376 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 581/1141] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:51:44 2022] GET /identity/v3/users/26fcd8e429eb45678b0093b4ce24a380 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:44.103873 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962b067-8308-492f-b00e-85f2603a03d9 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:44.113467 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962b067-8308-492f-b00e-85f2603a03d9 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:44.118164 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5a3f9-c08c-4852-a92c-93739c78ac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:44.118819 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5a3f9-c08c-4852-a92c-93739c78ac7c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:44.119100 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5a3f9-c08c-4852-a92c-93739c78ac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:44.119372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5a3f9-c08c-4852-a92c-93739c78ac7c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:44.126786 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5a3f9-c08c-4852-a92c-93739c78ac7c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:44.128484 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5a3f9-c08c-4852-a92c-93739c78ac7c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:44.137258 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 561/1142] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:51:44 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:51:44.142761 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2ee32-3138-4d3a-93b8-0873f1c44f58 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:44.152423 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2ee32-3138-4d3a-93b8-0873f1c44f58 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:44.156858 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf9b51-7044-43e1-a675-efc0a9b152fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:44.157671 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf9b51-7044-43e1-a675-efc0a9b152fc admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:44.157945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf9b51-7044-43e1-a675-efc0a9b152fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:44.158212 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf9b51-7044-43e1-a675-efc0a9b152fc admin admin] PATH_INFO: `/v3/projects/dab05b955e2148afba780573267cc2be` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:44.159375 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf9b51-7044-43e1-a675-efc0a9b152fc admin admin] RBAC: Authorizing `identity:get_project(project_id=dab05b955e2148afba780573267cc2be)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:44.161982 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf9b51-7044-43e1-a675-efc0a9b152fc admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:44.163612 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 582/1143] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:51:44 2022] GET /identity/v3/projects/dab05b955e2148afba780573267cc2be => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:44.169158 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5a3f9-c08c-4852-a92c-93739c78ac7c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:44.177682 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5a3f9-c08c-4852-a92c-93739c78ac7c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:44.182204 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644121f-0443-476f-9ef3-4b9b4e1b52a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:44.182852 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644121f-0443-476f-9ef3-4b9b4e1b52a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:44.183137 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644121f-0443-476f-9ef3-4b9b4e1b52a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:44.183462 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644121f-0443-476f-9ef3-4b9b4e1b52a2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:44.184228 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644121f-0443-476f-9ef3-4b9b4e1b52a2 admin admin] RBAC: Adding query filter params (role.id=8263a29ceeed4576b3b6959c99964ed7, scope.project.id=dab05b955e2148afba780573267cc2be, user.id=26fcd8e429eb45678b0093b4ce24a380) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:44.184538 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644121f-0443-476f-9ef3-4b9b4e1b52a2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:44.186321 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644121f-0443-476f-9ef3-4b9b4e1b52a2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:44.191469 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 562/1144] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:51:44 2022] GET /identity/v3/role_assignments?user.id=26fcd8e429eb45678b0093b4ce24a380&scope.project.id=dab05b955e2148afba780573267cc2be&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:46.450455 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe47269-399e-4263-84d7-624407dbb99c None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:46.451036 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe47269-399e-4263-84d7-624407dbb99c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:46.451036 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe47269-399e-4263-84d7-624407dbb99c None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:46.452799 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 583/1145] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:46.458573 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42747cb7-1c3e-454e-b389-11c70f3e501d None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:46.458993 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42747cb7-1c3e-454e-b389-11c70f3e501d None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:46.459237 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42747cb7-1c3e-454e-b389-11c70f3e501d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:46.477250 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-42747cb7-1c3e-454e-b389-11c70f3e501d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:46.478421 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-42747cb7-1c3e-454e-b389-11c70f3e501d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:46.486312 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 563/1146] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:46.509086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe47269-399e-4263-84d7-624407dbb99c None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:46.521578 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe47269-399e-4263-84d7-624407dbb99c None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:46.526027 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d042d3-74cf-4690-ab16-d3528ec66443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:46.526834 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d042d3-74cf-4690-ab16-d3528ec66443 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:46.527116 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d042d3-74cf-4690-ab16-d3528ec66443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:46.527832 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d042d3-74cf-4690-ab16-d3528ec66443 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:46.538214 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d042d3-74cf-4690-ab16-d3528ec66443 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:51:46.544964 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-c5d042d3-74cf-4690-ab16-d3528ec66443 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:51:46.546105 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 584/1147] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:51:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:46.552386 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42747cb7-1c3e-454e-b389-11c70f3e501d None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:46.561432 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42747cb7-1c3e-454e-b389-11c70f3e501d None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:46.565955 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8b2f4-5cdb-491f-ac1c-3f21b0971594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:46.566597 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8b2f4-5cdb-491f-ac1c-3f21b0971594 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:46.566937 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8b2f4-5cdb-491f-ac1c-3f21b0971594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:46.567815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8b2f4-5cdb-491f-ac1c-3f21b0971594 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:46.568684 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8b2f4-5cdb-491f-ac1c-3f21b0971594 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:46.568994 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8b2f4-5cdb-491f-ac1c-3f21b0971594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:46.570705 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8b2f4-5cdb-491f-ac1c-3f21b0971594 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:46.578864 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 564/1148] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:51:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:46.584373 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d042d3-74cf-4690-ab16-d3528ec66443 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:46.594352 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d042d3-74cf-4690-ab16-d3528ec66443 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:46.599278 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2887fda-0428-4009-9a53-1e969ab54d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:46.600097 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2887fda-0428-4009-9a53-1e969ab54d87 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:46.600367 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2887fda-0428-4009-9a53-1e969ab54d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:46.600628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2887fda-0428-4009-9a53-1e969ab54d87 admin admin] PATH_INFO: `/v3/users/26fcd8e429eb45678b0093b4ce24a380` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:46.601797 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2887fda-0428-4009-9a53-1e969ab54d87 admin admin] RBAC: Authorizing `identity:get_user(user_id=26fcd8e429eb45678b0093b4ce24a380)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:46.603980 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2887fda-0428-4009-9a53-1e969ab54d87 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:46.605517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 585/1149] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:51:46 2022] GET /identity/v3/users/26fcd8e429eb45678b0093b4ce24a380 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:46.611032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8b2f4-5cdb-491f-ac1c-3f21b0971594 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:46.621053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8b2f4-5cdb-491f-ac1c-3f21b0971594 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:46.625555 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc7050-f510-4ed6-b68c-3af9aeca2623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:46.626383 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc7050-f510-4ed6-b68c-3af9aeca2623 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:46.626690 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc7050-f510-4ed6-b68c-3af9aeca2623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:46.626973 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc7050-f510-4ed6-b68c-3af9aeca2623 admin admin] PATH_INFO: `/v3/projects/dab05b955e2148afba780573267cc2be` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:46.628141 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc7050-f510-4ed6-b68c-3af9aeca2623 admin admin] RBAC: Authorizing `identity:get_project(project_id=dab05b955e2148afba780573267cc2be)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:46.630143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc7050-f510-4ed6-b68c-3af9aeca2623 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:46.631801 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 565/1150] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:51:46 2022] GET /identity/v3/projects/dab05b955e2148afba780573267cc2be => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:46.637173 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2887fda-0428-4009-9a53-1e969ab54d87 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:46.646460 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2887fda-0428-4009-9a53-1e969ab54d87 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:46.650950 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f05fe5-fd5e-4579-ac9f-65b71b387427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:46.651782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f05fe5-fd5e-4579-ac9f-65b71b387427 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:46.652057 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f05fe5-fd5e-4579-ac9f-65b71b387427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:46.652326 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f05fe5-fd5e-4579-ac9f-65b71b387427 admin admin] PATH_INFO: `/v3/projects/dab05b955e2148afba780573267cc2be/users/26fcd8e429eb45678b0093b4ce24a380/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:46.654228 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f05fe5-fd5e-4579-ac9f-65b71b387427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab05b955e2148afba780573267cc2be, user_id=26fcd8e429eb45678b0093b4ce24a380, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:46.656873 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f05fe5-fd5e-4579-ac9f-65b71b387427 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:46.740045 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 586/1151] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:51:46 2022] PUT /identity/v3/projects/dab05b955e2148afba780573267cc2be/users/26fcd8e429eb45678b0093b4ce24a380/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:51:49.010580 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05cba0-18d5-43ff-9c12-346a4aac72c3 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:49.011158 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05cba0-18d5-43ff-9c12-346a4aac72c3 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:49.011158 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05cba0-18d5-43ff-9c12-346a4aac72c3 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:49.012899 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 566/1152] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:49.018099 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f056b9-6dc8-4c6a-bdfc-5c0a05d11bad None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:49.018515 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f056b9-6dc8-4c6a-bdfc-5c0a05d11bad None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:49.018662 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f056b9-6dc8-4c6a-bdfc-5c0a05d11bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:49.036449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-e4f056b9-6dc8-4c6a-bdfc-5c0a05d11bad None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:49.037642 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e4f056b9-6dc8-4c6a-bdfc-5c0a05d11bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:49.092203 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 587/1153] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:49 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:49.116235 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05cba0-18d5-43ff-9c12-346a4aac72c3 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:49.128456 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05cba0-18d5-43ff-9c12-346a4aac72c3 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:49.133381 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372d57d-bb46-4462-8eae-a1d31f421368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:49.134144 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372d57d-bb46-4462-8eae-a1d31f421368 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:49.134427 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372d57d-bb46-4462-8eae-a1d31f421368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:49.134763 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372d57d-bb46-4462-8eae-a1d31f421368 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:49.144780 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372d57d-bb46-4462-8eae-a1d31f421368 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:51:49.152368 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-b372d57d-bb46-4462-8eae-a1d31f421368 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:51:49.153517 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 567/1154] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:51:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:49.159129 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f056b9-6dc8-4c6a-bdfc-5c0a05d11bad None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:49.167867 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f056b9-6dc8-4c6a-bdfc-5c0a05d11bad None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:49.172438 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df39b5-ab9e-44ab-ac4a-ab47525c32af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:49.173080 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df39b5-ab9e-44ab-ac4a-ab47525c32af admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:49.173359 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df39b5-ab9e-44ab-ac4a-ab47525c32af admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:49.173633 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df39b5-ab9e-44ab-ac4a-ab47525c32af admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:49.174371 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df39b5-ab9e-44ab-ac4a-ab47525c32af admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:49.174700 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df39b5-ab9e-44ab-ac4a-ab47525c32af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:49.176278 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df39b5-ab9e-44ab-ac4a-ab47525c32af admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:49.184253 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 588/1155] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:51:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:49.189667 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372d57d-bb46-4462-8eae-a1d31f421368 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:49.200120 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372d57d-bb46-4462-8eae-a1d31f421368 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:49.204496 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b26386-d9f4-42e6-8fad-201f41e4d825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:49.205305 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b26386-d9f4-42e6-8fad-201f41e4d825 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:49.205580 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b26386-d9f4-42e6-8fad-201f41e4d825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:49.205846 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b26386-d9f4-42e6-8fad-201f41e4d825 admin admin] PATH_INFO: `/v3/users/26fcd8e429eb45678b0093b4ce24a380` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:49.207032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b26386-d9f4-42e6-8fad-201f41e4d825 admin admin] RBAC: Authorizing `identity:get_user(user_id=26fcd8e429eb45678b0093b4ce24a380)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:49.210016 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b26386-d9f4-42e6-8fad-201f41e4d825 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:49.211582 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 568/1156] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:51:49 2022] GET /identity/v3/users/26fcd8e429eb45678b0093b4ce24a380 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:49.216848 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df39b5-ab9e-44ab-ac4a-ab47525c32af admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:49.225994 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df39b5-ab9e-44ab-ac4a-ab47525c32af admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:49.230367 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5d8f2-ead2-41f9-8f0d-c2d0bf19b64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:49.231009 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5d8f2-ead2-41f9-8f0d-c2d0bf19b64d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:49.231286 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5d8f2-ead2-41f9-8f0d-c2d0bf19b64d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:49.231556 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5d8f2-ead2-41f9-8f0d-c2d0bf19b64d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:49.239679 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5d8f2-ead2-41f9-8f0d-c2d0bf19b64d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:49.241442 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5d8f2-ead2-41f9-8f0d-c2d0bf19b64d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:49.249915 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 589/1157] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:51:49 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:51:49.256252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b26386-d9f4-42e6-8fad-201f41e4d825 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:49.265581 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b26386-d9f4-42e6-8fad-201f41e4d825 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:49.270020 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b8f04-e56e-4981-a1e3-756882c38fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:49.271110 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b8f04-e56e-4981-a1e3-756882c38fee admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:49.271389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b8f04-e56e-4981-a1e3-756882c38fee admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:49.271661 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b8f04-e56e-4981-a1e3-756882c38fee admin admin] PATH_INFO: `/v3/projects/dab05b955e2148afba780573267cc2be` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:49.272823 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b8f04-e56e-4981-a1e3-756882c38fee admin admin] RBAC: Authorizing `identity:get_project(project_id=dab05b955e2148afba780573267cc2be)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:49.274835 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b8f04-e56e-4981-a1e3-756882c38fee admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:49.276440 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 569/1158] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:51:49 2022] GET /identity/v3/projects/dab05b955e2148afba780573267cc2be => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:49.281944 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5d8f2-ead2-41f9-8f0d-c2d0bf19b64d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:49.290884 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5d8f2-ead2-41f9-8f0d-c2d0bf19b64d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:49.295461 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfda2a-e792-4316-bcba-975a1c5aefee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:49.296073 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfda2a-e792-4316-bcba-975a1c5aefee admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:49.296349 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfda2a-e792-4316-bcba-975a1c5aefee admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:49.296677 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfda2a-e792-4316-bcba-975a1c5aefee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:49.297447 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfda2a-e792-4316-bcba-975a1c5aefee admin admin] RBAC: Adding query filter params (role.id=8263a29ceeed4576b3b6959c99964ed7, scope.project.id=dab05b955e2148afba780573267cc2be, user.id=26fcd8e429eb45678b0093b4ce24a380) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:49.297751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfda2a-e792-4316-bcba-975a1c5aefee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:49.299583 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfda2a-e792-4316-bcba-975a1c5aefee admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:49.305811 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 590/1159] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:51:49 2022] GET /identity/v3/role_assignments?user.id=26fcd8e429eb45678b0093b4ce24a380&scope.project.id=dab05b955e2148afba780573267cc2be&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:51.627667 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6235c-c110-4a0c-9a3e-94d241004fb4 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:51.628181 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6235c-c110-4a0c-9a3e-94d241004fb4 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:51.628269 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6235c-c110-4a0c-9a3e-94d241004fb4 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:51.630611 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 570/1160] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:51.635954 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4789a4-4e65-4c9b-a0fa-79d987ab203b None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:51.636380 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4789a4-4e65-4c9b-a0fa-79d987ab203b None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:51.636506 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4789a4-4e65-4c9b-a0fa-79d987ab203b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:51.654433 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-ea4789a4-4e65-4c9b-a0fa-79d987ab203b None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:51.655675 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-ea4789a4-4e65-4c9b-a0fa-79d987ab203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:51.664135 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 591/1161] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:51.687326 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6235c-c110-4a0c-9a3e-94d241004fb4 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:51.699916 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6235c-c110-4a0c-9a3e-94d241004fb4 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:51.704228 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3ab02-a443-4c2c-b6a5-5801ee435b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:51.704847 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3ab02-a443-4c2c-b6a5-5801ee435b9e admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:51.705124 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3ab02-a443-4c2c-b6a5-5801ee435b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:51.705393 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3ab02-a443-4c2c-b6a5-5801ee435b9e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:51.712823 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3ab02-a443-4c2c-b6a5-5801ee435b9e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:51.714530 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3ab02-a443-4c2c-b6a5-5801ee435b9e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:51.723075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 571/1162] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:51:51 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:51:51.729011 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4789a4-4e65-4c9b-a0fa-79d987ab203b None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:51.738182 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4789a4-4e65-4c9b-a0fa-79d987ab203b None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:51.743387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a859ec-791a-4a5e-94b0-829b4fdd6ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:51.744165 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a859ec-791a-4a5e-94b0-829b4fdd6ccb admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:51.744445 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a859ec-791a-4a5e-94b0-829b4fdd6ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:51.744718 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a859ec-791a-4a5e-94b0-829b4fdd6ccb admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:51.751583 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a859ec-791a-4a5e-94b0-829b4fdd6ccb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:51.753390 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a859ec-791a-4a5e-94b0-829b4fdd6ccb admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:51.767766 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-93a859ec-791a-4a5e-94b0-829b4fdd6ccb admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 16 16:51:51.768886 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 592/1163] 10.222.0.42 () {56 vars in 1138 bytes} [Wed Feb 16 16:51:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:51:51.774561 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3ab02-a443-4c2c-b6a5-5801ee435b9e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:51.783881 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3ab02-a443-4c2c-b6a5-5801ee435b9e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:51.788215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b07026-bfc7-4be4-802b-ab145eecadb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:51.788873 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b07026-bfc7-4be4-802b-ab145eecadb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:51.789154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b07026-bfc7-4be4-802b-ab145eecadb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:51.789428 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b07026-bfc7-4be4-802b-ab145eecadb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:51.790142 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b07026-bfc7-4be4-802b-ab145eecadb8 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:51:51.790446 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b07026-bfc7-4be4-802b-ab145eecadb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:51.792074 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b07026-bfc7-4be4-802b-ab145eecadb8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:51.799420 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 572/1164] 10.222.0.42 () {56 vars in 1136 bytes} [Wed Feb 16 16:51:51 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:54.083593 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae75817-4724-4774-976e-e8ace24ecdcc None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:54.084148 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae75817-4724-4774-976e-e8ace24ecdcc None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:54.084148 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae75817-4724-4774-976e-e8ace24ecdcc None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:54.085933 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 593/1165] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:54.091625 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3aa9c-442a-40c1-b9cd-567dacc3f63b None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:54.092039 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3aa9c-442a-40c1-b9cd-567dacc3f63b None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:54.092173 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3aa9c-442a-40c1-b9cd-567dacc3f63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:54.112603 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-19e3aa9c-442a-40c1-b9cd-567dacc3f63b None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:54.114899 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-19e3aa9c-442a-40c1-b9cd-567dacc3f63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:54.122734 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 573/1166] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:54.149211 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae75817-4724-4774-976e-e8ace24ecdcc None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:54.161913 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae75817-4724-4774-976e-e8ace24ecdcc None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:54.167771 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f5370-f04f-4187-9cac-bc97fc0d8650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:54.168410 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f5370-f04f-4187-9cac-bc97fc0d8650 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:54.168686 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f5370-f04f-4187-9cac-bc97fc0d8650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:54.168953 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f5370-f04f-4187-9cac-bc97fc0d8650 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:54.169674 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f5370-f04f-4187-9cac-bc97fc0d8650 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:54.170694 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-c31f5370-f04f-4187-9cac-bc97fc0d8650 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 16:51:54.170694 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 16:51:54.170694 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 16:51:54.171735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f5370-f04f-4187-9cac-bc97fc0d8650 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:54.302898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 594/1167] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Feb 16 16:51:54 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:51:56.785173 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f44a84-8c8f-4723-9761-46264e0e5bab None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:56.785693 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f44a84-8c8f-4723-9761-46264e0e5bab None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:56.785799 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f44a84-8c8f-4723-9761-46264e0e5bab None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:56.787816 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 574/1168] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:56.792936 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e1069-9b92-4051-a942-f49de028c448 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:56.793330 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e1069-9b92-4051-a942-f49de028c448 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:56.793476 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e1069-9b92-4051-a942-f49de028c448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:56.811443 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-f85e1069-9b92-4051-a942-f49de028c448 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:56.812619 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f85e1069-9b92-4051-a942-f49de028c448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:56.867930 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 595/1169] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:56 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:56.892839 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f44a84-8c8f-4723-9761-46264e0e5bab None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:56.905054 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f44a84-8c8f-4723-9761-46264e0e5bab None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:56.909377 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01277b6f-c63b-4fae-aa5f-0082d43ee7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:56.910208 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01277b6f-c63b-4fae-aa5f-0082d43ee7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:56.918834 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01277b6f-c63b-4fae-aa5f-0082d43ee7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:56.919119 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01277b6f-c63b-4fae-aa5f-0082d43ee7e0 admin admin] PATH_INFO: `/v3/domains/8855eb9024764342a9ca7a37276614dc` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:56.935112 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01277b6f-c63b-4fae-aa5f-0082d43ee7e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=8855eb9024764342a9ca7a37276614dc)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:56.937026 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01277b6f-c63b-4fae-aa5f-0082d43ee7e0 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:56.938605 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 575/1170] 10.222.0.42 () {56 vars in 1204 bytes} [Wed Feb 16 16:51:56 2022] GET /identity/v3/domains/8855eb9024764342a9ca7a37276614dc => generated 267 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:56.944787 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e1069-9b92-4051-a942-f49de028c448 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:56.953439 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e1069-9b92-4051-a942-f49de028c448 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:56.957896 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d5444-49ae-46c6-ac06-8754c575aee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:56.958528 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d5444-49ae-46c6-ac06-8754c575aee2 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:56.958835 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d5444-49ae-46c6-ac06-8754c575aee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:56.959103 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d5444-49ae-46c6-ac06-8754c575aee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:56.959805 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d5444-49ae-46c6-ac06-8754c575aee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:56.961642 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d5444-49ae-46c6-ac06-8754c575aee2 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:57.181523 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 596/1171] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Feb 16 16:51:56 2022] POST /identity/v3/projects => generated 361 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:51:59.469516 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f730b8-8c2f-4410-84ff-f6a73e7f5117 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:59.470072 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f730b8-8c2f-4410-84ff-f6a73e7f5117 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:59.470072 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f730b8-8c2f-4410-84ff-f6a73e7f5117 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:59.471908 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 576/1172] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:51:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:51:59.477658 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0075d6-7b5f-4e60-84ce-abf063e9b339 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:59.478087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0075d6-7b5f-4e60-84ce-abf063e9b339 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:59.478207 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0075d6-7b5f-4e60-84ce-abf063e9b339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:59.497124 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-fd0075d6-7b5f-4e60-84ce-abf063e9b339 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:51:59.498277 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-fd0075d6-7b5f-4e60-84ce-abf063e9b339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:51:59.556424 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 597/1173] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:51:59 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:51:59.581339 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f730b8-8c2f-4410-84ff-f6a73e7f5117 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:59.593623 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f730b8-8c2f-4410-84ff-f6a73e7f5117 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:59.598499 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8a123-43c6-4bd6-a474-ef90306b8063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:59.599355 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8a123-43c6-4bd6-a474-ef90306b8063 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:59.599634 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8a123-43c6-4bd6-a474-ef90306b8063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:59.599904 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8a123-43c6-4bd6-a474-ef90306b8063 admin admin] PATH_INFO: `/v3/domains/8855eb9024764342a9ca7a37276614dc` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:59.601081 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8a123-43c6-4bd6-a474-ef90306b8063 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=8855eb9024764342a9ca7a37276614dc)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:59.603058 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8a123-43c6-4bd6-a474-ef90306b8063 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:59.604601 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 577/1174] 10.222.0.42 () {56 vars in 1204 bytes} [Wed Feb 16 16:51:59 2022] GET /identity/v3/domains/8855eb9024764342a9ca7a37276614dc => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:51:59.610122 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0075d6-7b5f-4e60-84ce-abf063e9b339 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:51:59.619571 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0075d6-7b5f-4e60-84ce-abf063e9b339 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:51:59.624035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd22b00-1e04-4143-b64c-48c2da7b8f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:51:59.624671 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd22b00-1e04-4143-b64c-48c2da7b8f7d admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:51:59.624944 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd22b00-1e04-4143-b64c-48c2da7b8f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:51:59.625210 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd22b00-1e04-4143-b64c-48c2da7b8f7d admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:51:59.625909 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd22b00-1e04-4143-b64c-48c2da7b8f7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:51:59.627828 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd22b00-1e04-4143-b64c-48c2da7b8f7d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:51:59.717445 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 598/1175] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Feb 16 16:51:59 2022] POST /identity/v3/users => generated 311 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 16:52:02.116584 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7a9cd-cef2-409c-9f41-d83acb1b4492 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:02.117108 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7a9cd-cef2-409c-9f41-d83acb1b4492 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:02.117108 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7a9cd-cef2-409c-9f41-d83acb1b4492 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:02.118900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 578/1176] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:52:02.124016 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc97ef9-f3f3-4a4d-856e-347fb0bcab6a None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:02.124419 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc97ef9-f3f3-4a4d-856e-347fb0bcab6a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:02.124566 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc97ef9-f3f3-4a4d-856e-347fb0bcab6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:02.142917 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-ccc97ef9-f3f3-4a4d-856e-347fb0bcab6a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:52:02.144104 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-ccc97ef9-f3f3-4a4d-856e-347fb0bcab6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:52:02.152035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 599/1177] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:52:02 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:52:02.176725 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7a9cd-cef2-409c-9f41-d83acb1b4492 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:52:02.189185 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7a9cd-cef2-409c-9f41-d83acb1b4492 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:52:02.194401 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de45ad-d066-435d-9d2b-a9c00cd6b8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:52:02.195193 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de45ad-d066-435d-9d2b-a9c00cd6b8df admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:02.195470 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de45ad-d066-435d-9d2b-a9c00cd6b8df admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:02.195738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de45ad-d066-435d-9d2b-a9c00cd6b8df admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:02.206393 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de45ad-d066-435d-9d2b-a9c00cd6b8df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:52:02.214109 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-b7de45ad-d066-435d-9d2b-a9c00cd6b8df admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:52:02.215269 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 579/1178] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:52:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:52:02.221033 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc97ef9-f3f3-4a4d-856e-347fb0bcab6a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:52:02.230593 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc97ef9-f3f3-4a4d-856e-347fb0bcab6a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:52:02.235393 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2744e-ee1d-4327-9b76-7b1fbdf85b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:52:02.236085 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2744e-ee1d-4327-9b76-7b1fbdf85b84 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:02.236364 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2744e-ee1d-4327-9b76-7b1fbdf85b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:02.236637 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2744e-ee1d-4327-9b76-7b1fbdf85b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:02.237373 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2744e-ee1d-4327-9b76-7b1fbdf85b84 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:52:02.237679 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2744e-ee1d-4327-9b76-7b1fbdf85b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:52:02.239388 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2744e-ee1d-4327-9b76-7b1fbdf85b84 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:52:02.247464 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 600/1179] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:52:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:52:02.252854 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de45ad-d066-435d-9d2b-a9c00cd6b8df admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:52:02.262422 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de45ad-d066-435d-9d2b-a9c00cd6b8df admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:52:02.266888 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63531111-0309-42e1-abab-cf5d746c6a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:52:02.267708 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63531111-0309-42e1-abab-cf5d746c6a5f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:02.267982 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63531111-0309-42e1-abab-cf5d746c6a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:02.268251 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63531111-0309-42e1-abab-cf5d746c6a5f admin admin] PATH_INFO: `/v3/users/36c9d05ed48e4daf84e96d13362b9758` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:02.281851 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63531111-0309-42e1-abab-cf5d746c6a5f admin admin] RBAC: Authorizing `identity:get_user(user_id=36c9d05ed48e4daf84e96d13362b9758)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:52:02.283973 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63531111-0309-42e1-abab-cf5d746c6a5f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:52:02.286489 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 580/1180] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:52:02 2022] GET /identity/v3/users/36c9d05ed48e4daf84e96d13362b9758 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:52:02.291729 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2744e-ee1d-4327-9b76-7b1fbdf85b84 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:52:02.301084 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2744e-ee1d-4327-9b76-7b1fbdf85b84 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:52:02.305792 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a18095-a200-4664-8064-3178d759040f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:52:02.306407 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a18095-a200-4664-8064-3178d759040f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:02.306724 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a18095-a200-4664-8064-3178d759040f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:02.307003 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a18095-a200-4664-8064-3178d759040f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:02.314533 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a18095-a200-4664-8064-3178d759040f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:52:02.316338 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a18095-a200-4664-8064-3178d759040f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:52:02.324985 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 601/1181] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:52:02 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:52:02.330338 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63531111-0309-42e1-abab-cf5d746c6a5f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:52:02.340134 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63531111-0309-42e1-abab-cf5d746c6a5f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:52:02.344511 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc16ab7-ba47-42e0-9531-4006bbbc786a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:52:02.345324 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc16ab7-ba47-42e0-9531-4006bbbc786a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:02.345599 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc16ab7-ba47-42e0-9531-4006bbbc786a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:02.345869 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc16ab7-ba47-42e0-9531-4006bbbc786a admin admin] PATH_INFO: `/v3/projects/fca126f41e4347ceb324cc320360f462` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:02.347027 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc16ab7-ba47-42e0-9531-4006bbbc786a admin admin] RBAC: Authorizing `identity:get_project(project_id=fca126f41e4347ceb324cc320360f462)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:52:02.349707 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc16ab7-ba47-42e0-9531-4006bbbc786a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:52:02.351306 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 581/1182] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:52:02 2022] GET /identity/v3/projects/fca126f41e4347ceb324cc320360f462 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:52:02.356876 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a18095-a200-4664-8064-3178d759040f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:52:02.367677 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a18095-a200-4664-8064-3178d759040f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:52:02.372208 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ddeaa-1c97-46f6-97a8-a0a4ee698326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:52:02.372844 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ddeaa-1c97-46f6-97a8-a0a4ee698326 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:02.373124 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ddeaa-1c97-46f6-97a8-a0a4ee698326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:02.373397 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ddeaa-1c97-46f6-97a8-a0a4ee698326 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:02.374203 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ddeaa-1c97-46f6-97a8-a0a4ee698326 admin admin] RBAC: Adding query filter params (role.id=8263a29ceeed4576b3b6959c99964ed7, scope.project.id=fca126f41e4347ceb324cc320360f462, user.id=36c9d05ed48e4daf84e96d13362b9758) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:52:02.374511 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ddeaa-1c97-46f6-97a8-a0a4ee698326 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:52:02.376354 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ddeaa-1c97-46f6-97a8-a0a4ee698326 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:52:02.382372 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 602/1183] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:52:02 2022] GET /identity/v3/role_assignments?user.id=36c9d05ed48e4daf84e96d13362b9758&scope.project.id=fca126f41e4347ceb324cc320360f462&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:52:04.674278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e559-da23-4f4a-99fe-50aa34ec3b39 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:04.674817 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e559-da23-4f4a-99fe-50aa34ec3b39 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:04.674817 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e559-da23-4f4a-99fe-50aa34ec3b39 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:04.677182 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 582/1184] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:52:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:52:04.682419 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16834b0-6dbf-4b7c-98c3-7f457cba3f7d None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:04.682896 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16834b0-6dbf-4b7c-98c3-7f457cba3f7d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:04.682998 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16834b0-6dbf-4b7c-98c3-7f457cba3f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:04.701042 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-d16834b0-6dbf-4b7c-98c3-7f457cba3f7d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:52:04.702214 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d16834b0-6dbf-4b7c-98c3-7f457cba3f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:52:04.710016 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 603/1185] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:52:04 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:52:04.733374 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7e559-da23-4f4a-99fe-50aa34ec3b39 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:52:04.745910 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7e559-da23-4f4a-99fe-50aa34ec3b39 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:52:04.750159 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fcb05-fd5b-41a2-bfd8-88312003e1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:52:04.750941 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fcb05-fd5b-41a2-bfd8-88312003e1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:04.751214 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fcb05-fd5b-41a2-bfd8-88312003e1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:04.751480 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fcb05-fd5b-41a2-bfd8-88312003e1f1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:04.761463 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fcb05-fd5b-41a2-bfd8-88312003e1f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:52:04.768287 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-d42fcb05-fd5b-41a2-bfd8-88312003e1f1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:52:04.769421 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 583/1186] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:52:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:52:04.775038 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16834b0-6dbf-4b7c-98c3-7f457cba3f7d None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:52:04.783815 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16834b0-6dbf-4b7c-98c3-7f457cba3f7d None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:52:04.788886 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a849a-7414-422d-b575-4a4a614b7f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:52:04.789527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a849a-7414-422d-b575-4a4a614b7f38 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:04.789808 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a849a-7414-422d-b575-4a4a614b7f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:04.790090 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a849a-7414-422d-b575-4a4a614b7f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:04.790870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a849a-7414-422d-b575-4a4a614b7f38 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:52:04.791177 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a849a-7414-422d-b575-4a4a614b7f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:52:04.792742 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a849a-7414-422d-b575-4a4a614b7f38 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:52:04.800700 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 604/1187] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:52:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:52:04.806499 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fcb05-fd5b-41a2-bfd8-88312003e1f1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:52:04.816239 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fcb05-fd5b-41a2-bfd8-88312003e1f1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:52:04.820685 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58aa77-052a-44bf-93c1-fd346ef0c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:52:04.821498 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58aa77-052a-44bf-93c1-fd346ef0c58f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:04.821773 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58aa77-052a-44bf-93c1-fd346ef0c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:04.822042 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58aa77-052a-44bf-93c1-fd346ef0c58f admin admin] PATH_INFO: `/v3/users/36c9d05ed48e4daf84e96d13362b9758` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:04.823264 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58aa77-052a-44bf-93c1-fd346ef0c58f admin admin] RBAC: Authorizing `identity:get_user(user_id=36c9d05ed48e4daf84e96d13362b9758)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:52:04.825307 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58aa77-052a-44bf-93c1-fd346ef0c58f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:52:04.826849 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 584/1188] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:52:04 2022] GET /identity/v3/users/36c9d05ed48e4daf84e96d13362b9758 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:52:04.832051 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a849a-7414-422d-b575-4a4a614b7f38 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:52:04.841632 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a849a-7414-422d-b575-4a4a614b7f38 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:52:04.846126 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5fbd5-2937-4812-b27a-089b265b9f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:52:04.846993 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5fbd5-2937-4812-b27a-089b265b9f71 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:04.847269 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5fbd5-2937-4812-b27a-089b265b9f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:04.847559 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5fbd5-2937-4812-b27a-089b265b9f71 admin admin] PATH_INFO: `/v3/projects/fca126f41e4347ceb324cc320360f462` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:04.849586 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5fbd5-2937-4812-b27a-089b265b9f71 admin admin] RBAC: Authorizing `identity:get_project(project_id=fca126f41e4347ceb324cc320360f462)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:52:04.851740 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5fbd5-2937-4812-b27a-089b265b9f71 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:52:04.853390 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 605/1189] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:52:04 2022] GET /identity/v3/projects/fca126f41e4347ceb324cc320360f462 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:52:04.859192 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58aa77-052a-44bf-93c1-fd346ef0c58f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:52:04.869428 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58aa77-052a-44bf-93c1-fd346ef0c58f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:52:04.873910 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f47f39-bc1a-41a3-9e46-611ab9e428ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:52:04.874785 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f47f39-bc1a-41a3-9e46-611ab9e428ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:04.875065 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f47f39-bc1a-41a3-9e46-611ab9e428ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:04.875337 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f47f39-bc1a-41a3-9e46-611ab9e428ee admin admin] PATH_INFO: `/v3/projects/fca126f41e4347ceb324cc320360f462/users/36c9d05ed48e4daf84e96d13362b9758/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:04.877792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f47f39-bc1a-41a3-9e46-611ab9e428ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=fca126f41e4347ceb324cc320360f462, user_id=36c9d05ed48e4daf84e96d13362b9758, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:52:04.882785 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f47f39-bc1a-41a3-9e46-611ab9e428ee admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:52:04.997081 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 585/1190] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:52:04 2022] PUT /identity/v3/projects/fca126f41e4347ceb324cc320360f462/users/36c9d05ed48e4daf84e96d13362b9758/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 16:52:07.275956 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb95be-9055-44ba-be2c-8a086e03366f None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:07.276538 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb95be-9055-44ba-be2c-8a086e03366f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:07.276538 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb95be-9055-44ba-be2c-8a086e03366f None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:07.278276 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 606/1191] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:52:07.283523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4765f51-0beb-46b4-ba19-dc1f02be0379 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:07.283952 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4765f51-0beb-46b4-ba19-dc1f02be0379 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:07.284069 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4765f51-0beb-46b4-ba19-dc1f02be0379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:07.301977 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-e4765f51-0beb-46b4-ba19-dc1f02be0379 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:52:07.303197 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e4765f51-0beb-46b4-ba19-dc1f02be0379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:52:07.358059 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 586/1192] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:52:07 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:52:07.382249 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb95be-9055-44ba-be2c-8a086e03366f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:52:07.394128 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb95be-9055-44ba-be2c-8a086e03366f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:52:07.399392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43b25e-ca3c-40d8-a666-9df9866af62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:52:07.400155 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43b25e-ca3c-40d8-a666-9df9866af62a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:07.400431 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43b25e-ca3c-40d8-a666-9df9866af62a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:07.400700 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43b25e-ca3c-40d8-a666-9df9866af62a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:07.411429 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43b25e-ca3c-40d8-a666-9df9866af62a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:52:07.418141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-8c43b25e-ca3c-40d8-a666-9df9866af62a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:52:07.419295 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 607/1193] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:52:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:52:07.424938 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4765f51-0beb-46b4-ba19-dc1f02be0379 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:52:07.433581 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4765f51-0beb-46b4-ba19-dc1f02be0379 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:52:07.438027 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015553c9-0341-40c6-847b-ca23fdf60357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:52:07.438671 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015553c9-0341-40c6-847b-ca23fdf60357 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:07.438960 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015553c9-0341-40c6-847b-ca23fdf60357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:07.439229 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015553c9-0341-40c6-847b-ca23fdf60357 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:07.439958 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015553c9-0341-40c6-847b-ca23fdf60357 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:52:07.440256 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015553c9-0341-40c6-847b-ca23fdf60357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:52:07.442112 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015553c9-0341-40c6-847b-ca23fdf60357 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:52:07.450225 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 587/1194] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:52:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:52:07.455887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43b25e-ca3c-40d8-a666-9df9866af62a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:52:07.466727 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43b25e-ca3c-40d8-a666-9df9866af62a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:52:07.471231 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f05f0b-2885-40cf-9266-20df11b26ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:52:07.472061 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f05f0b-2885-40cf-9266-20df11b26ebe admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:07.472340 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f05f0b-2885-40cf-9266-20df11b26ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:07.473251 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f05f0b-2885-40cf-9266-20df11b26ebe admin admin] PATH_INFO: `/v3/users/36c9d05ed48e4daf84e96d13362b9758` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:07.474691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f05f0b-2885-40cf-9266-20df11b26ebe admin admin] RBAC: Authorizing `identity:get_user(user_id=36c9d05ed48e4daf84e96d13362b9758)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:52:07.476786 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f05f0b-2885-40cf-9266-20df11b26ebe admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:52:07.478345 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 608/1195] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Feb 16 16:52:07 2022] GET /identity/v3/users/36c9d05ed48e4daf84e96d13362b9758 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:52:07.483895 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015553c9-0341-40c6-847b-ca23fdf60357 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:52:07.493042 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015553c9-0341-40c6-847b-ca23fdf60357 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:52:07.497429 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc16f8-b4f9-401b-a4e9-a1cde4af5f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:52:07.498032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc16f8-b4f9-401b-a4e9-a1cde4af5f98 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:07.498308 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc16f8-b4f9-401b-a4e9-a1cde4af5f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:07.498604 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc16f8-b4f9-401b-a4e9-a1cde4af5f98 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:07.506167 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc16f8-b4f9-401b-a4e9-a1cde4af5f98 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:52:07.508009 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc16f8-b4f9-401b-a4e9-a1cde4af5f98 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:52:07.516433 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 588/1196] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:52:07 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:52:07.522457 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f05f0b-2885-40cf-9266-20df11b26ebe admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:52:07.531983 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f05f0b-2885-40cf-9266-20df11b26ebe admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:52:07.536691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5777c88-d4bf-4045-a825-8d509de56b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:52:07.537515 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5777c88-d4bf-4045-a825-8d509de56b3b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:07.537790 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5777c88-d4bf-4045-a825-8d509de56b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:07.538059 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5777c88-d4bf-4045-a825-8d509de56b3b admin admin] PATH_INFO: `/v3/projects/fca126f41e4347ceb324cc320360f462` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:07.539257 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5777c88-d4bf-4045-a825-8d509de56b3b admin admin] RBAC: Authorizing `identity:get_project(project_id=fca126f41e4347ceb324cc320360f462)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:52:07.541289 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5777c88-d4bf-4045-a825-8d509de56b3b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:52:07.543012 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 609/1197] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Feb 16 16:52:07 2022] GET /identity/v3/projects/fca126f41e4347ceb324cc320360f462 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:52:07.548831 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc16f8-b4f9-401b-a4e9-a1cde4af5f98 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:52:07.558546 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc16f8-b4f9-401b-a4e9-a1cde4af5f98 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:52:07.563021 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7894630-a349-4131-ac6a-9ee755b7cd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:52:07.563635 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7894630-a349-4131-ac6a-9ee755b7cd81 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:52:07.563910 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7894630-a349-4131-ac6a-9ee755b7cd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:52:07.564179 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7894630-a349-4131-ac6a-9ee755b7cd81 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:52:07.564984 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7894630-a349-4131-ac6a-9ee755b7cd81 admin admin] RBAC: Adding query filter params (role.id=8263a29ceeed4576b3b6959c99964ed7, scope.project.id=fca126f41e4347ceb324cc320360f462, user.id=36c9d05ed48e4daf84e96d13362b9758) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:52:07.565286 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7894630-a349-4131-ac6a-9ee755b7cd81 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:52:07.567185 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7894630-a349-4131-ac6a-9ee755b7cd81 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:52:07.572828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 589/1198] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:52:07 2022] GET /identity/v3/role_assignments?user.id=36c9d05ed48e4daf84e96d13362b9758&scope.project.id=fca126f41e4347ceb324cc320360f462&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:53:29.857897 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467da79-0464-4789-a833-af5ec84bee99 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:29.858717 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467da79-0464-4789-a833-af5ec84bee99 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:29.858717 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467da79-0464-4789-a833-af5ec84bee99 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:29.860488 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 610/1199] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:53:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:53:29.866352 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef82ca-e833-44dc-ae3f-71fab0807435 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:29.866833 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef82ca-e833-44dc-ae3f-71fab0807435 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:29.866932 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef82ca-e833-44dc-ae3f-71fab0807435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:29.884972 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-38ef82ca-e833-44dc-ae3f-71fab0807435 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:53:29.886143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-38ef82ca-e833-44dc-ae3f-71fab0807435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:53:29.893887 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 590/1200] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:53:29 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:53:29.918753 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467da79-0464-4789-a833-af5ec84bee99 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:29.931702 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467da79-0464-4789-a833-af5ec84bee99 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:29.936277 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905e0fd-3614-416f-a699-b6e10debfc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:29.937067 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905e0fd-3614-416f-a699-b6e10debfc6f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:29.937349 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905e0fd-3614-416f-a699-b6e10debfc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:29.937624 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905e0fd-3614-416f-a699-b6e10debfc6f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:29.948558 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905e0fd-3614-416f-a699-b6e10debfc6f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:29.950426 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905e0fd-3614-416f-a699-b6e10debfc6f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:29.966914 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-a905e0fd-3614-416f-a699-b6e10debfc6f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:53:29.968085 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 611/1201] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:29.974186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef82ca-e833-44dc-ae3f-71fab0807435 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:29.983402 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef82ca-e833-44dc-ae3f-71fab0807435 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:29.989208 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948363b-d117-46e1-b34a-c7f5ed6c90b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:29.989853 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948363b-d117-46e1-b34a-c7f5ed6c90b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:29.990134 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948363b-d117-46e1-b34a-c7f5ed6c90b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:29.990412 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948363b-d117-46e1-b34a-c7f5ed6c90b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:29.991187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948363b-d117-46e1-b34a-c7f5ed6c90b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:30.004157 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948363b-d117-46e1-b34a-c7f5ed6c90b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:30.004157 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948363b-d117-46e1-b34a-c7f5ed6c90b0 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:30.005015 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 591/1202] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:30.010524 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905e0fd-3614-416f-a699-b6e10debfc6f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:30.020091 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905e0fd-3614-416f-a699-b6e10debfc6f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:30.024819 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173173d2-97ee-45e5-affc-8a099c7fbc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:30.025455 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173173d2-97ee-45e5-affc-8a099c7fbc04 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:30.025735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173173d2-97ee-45e5-affc-8a099c7fbc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:30.026009 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173173d2-97ee-45e5-affc-8a099c7fbc04 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:30.026744 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173173d2-97ee-45e5-affc-8a099c7fbc04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:30.028655 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173173d2-97ee-45e5-affc-8a099c7fbc04 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:30.132671 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 612/1203] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Feb 16 16:53:30 2022] POST /identity/v3/users => generated 251 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:53:32.480576 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c127b8c-b976-4ccb-9c83-120355065600 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:32.481108 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c127b8c-b976-4ccb-9c83-120355065600 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:32.481108 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c127b8c-b976-4ccb-9c83-120355065600 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:32.482904 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 592/1204] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:53:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:53:32.488939 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cc654-1186-447f-96a7-d5304635f857 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:32.489356 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cc654-1186-447f-96a7-d5304635f857 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:32.489482 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cc654-1186-447f-96a7-d5304635f857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:32.507063 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-909cc654-1186-447f-96a7-d5304635f857 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:53:32.508219 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-909cc654-1186-447f-96a7-d5304635f857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:53:32.515766 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 613/1205] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:53:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:53:32.539611 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c127b8c-b976-4ccb-9c83-120355065600 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:32.552142 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c127b8c-b976-4ccb-9c83-120355065600 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:32.556483 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780cbe9-f74d-472a-8284-121b6e9dc1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:32.557241 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780cbe9-f74d-472a-8284-121b6e9dc1cc admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:32.557515 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780cbe9-f74d-472a-8284-121b6e9dc1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:32.557782 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780cbe9-f74d-472a-8284-121b6e9dc1cc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:32.568155 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780cbe9-f74d-472a-8284-121b6e9dc1cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:53:32.574994 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-9780cbe9-f74d-472a-8284-121b6e9dc1cc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:53:32.576138 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 593/1206] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:53:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:32.582039 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cc654-1186-447f-96a7-d5304635f857 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:32.590845 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cc654-1186-447f-96a7-d5304635f857 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:32.595783 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807578f6-8c8b-4a3c-b9d3-80663e9a21b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:32.596497 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807578f6-8c8b-4a3c-b9d3-80663e9a21b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:32.596771 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807578f6-8c8b-4a3c-b9d3-80663e9a21b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:32.597037 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807578f6-8c8b-4a3c-b9d3-80663e9a21b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:32.597765 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807578f6-8c8b-4a3c-b9d3-80663e9a21b5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:32.598062 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807578f6-8c8b-4a3c-b9d3-80663e9a21b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:32.599661 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807578f6-8c8b-4a3c-b9d3-80663e9a21b5 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:32.607474 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 614/1207] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:53:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:32.614099 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780cbe9-f74d-472a-8284-121b6e9dc1cc admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:32.623425 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780cbe9-f74d-472a-8284-121b6e9dc1cc admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:32.627936 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f51f7c-b69d-482e-ac12-b16385feed64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:32.628776 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f51f7c-b69d-482e-ac12-b16385feed64 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:32.629052 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f51f7c-b69d-482e-ac12-b16385feed64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:32.629320 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f51f7c-b69d-482e-ac12-b16385feed64 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:32.639123 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f51f7c-b69d-482e-ac12-b16385feed64 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:32.640890 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f51f7c-b69d-482e-ac12-b16385feed64 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:32.657181 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-85f51f7c-b69d-482e-ac12-b16385feed64 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:53:32.659506 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 594/1208] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:32.665334 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807578f6-8c8b-4a3c-b9d3-80663e9a21b5 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:32.675824 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807578f6-8c8b-4a3c-b9d3-80663e9a21b5 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:32.680658 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fd23b-520f-4ab6-a26c-abefe2c46268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:32.681328 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fd23b-520f-4ab6-a26c-abefe2c46268 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:32.681607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fd23b-520f-4ab6-a26c-abefe2c46268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:32.681876 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fd23b-520f-4ab6-a26c-abefe2c46268 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:32.682584 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fd23b-520f-4ab6-a26c-abefe2c46268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:32.682927 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fd23b-520f-4ab6-a26c-abefe2c46268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:32.684492 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fd23b-520f-4ab6-a26c-abefe2c46268 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:32.696449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 615/1209] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:32.702012 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f51f7c-b69d-482e-ac12-b16385feed64 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:32.712593 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f51f7c-b69d-482e-ac12-b16385feed64 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:32.717178 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3b27f-b7d7-420a-b2de-3d0bc3a3730e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:32.717939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3b27f-b7d7-420a-b2de-3d0bc3a3730e admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:32.718211 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3b27f-b7d7-420a-b2de-3d0bc3a3730e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:32.718477 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3b27f-b7d7-420a-b2de-3d0bc3a3730e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:32.726187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3b27f-b7d7-420a-b2de-3d0bc3a3730e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:32.728174 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3b27f-b7d7-420a-b2de-3d0bc3a3730e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:32.745975 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-1bd3b27f-b7d7-420a-b2de-3d0bc3a3730e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 16:53:32.745975 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 595/1210] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:53:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:32.748783 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fd23b-520f-4ab6-a26c-abefe2c46268 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:32.758621 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fd23b-520f-4ab6-a26c-abefe2c46268 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:32.763838 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1af5e-adcb-41c8-ae9b-b915f05967ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:32.764476 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1af5e-adcb-41c8-ae9b-b915f05967ed admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:32.764756 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1af5e-adcb-41c8-ae9b-b915f05967ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:32.765026 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1af5e-adcb-41c8-ae9b-b915f05967ed admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:32.766036 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1af5e-adcb-41c8-ae9b-b915f05967ed admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:32.766340 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1af5e-adcb-41c8-ae9b-b915f05967ed admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:32.768907 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1af5e-adcb-41c8-ae9b-b915f05967ed admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:32.786911 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 616/1211] 10.222.0.42 () {56 vars in 1164 bytes} [Wed Feb 16 16:53:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:32.792536 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3b27f-b7d7-420a-b2de-3d0bc3a3730e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:32.802093 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3b27f-b7d7-420a-b2de-3d0bc3a3730e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:32.806512 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a460d-4c74-487a-8509-e0f666bc59e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:32.807168 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a460d-4c74-487a-8509-e0f666bc59e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:32.807444 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a460d-4c74-487a-8509-e0f666bc59e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:32.807713 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a460d-4c74-487a-8509-e0f666bc59e9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:32.815870 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a460d-4c74-487a-8509-e0f666bc59e9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:32.817876 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a460d-4c74-487a-8509-e0f666bc59e9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:32.827257 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 596/1212] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:53:32 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:53:32.833822 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1af5e-adcb-41c8-ae9b-b915f05967ed admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:32.843532 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1af5e-adcb-41c8-ae9b-b915f05967ed admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:32.849386 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c1927-670a-4b45-90f1-e07d2fcb120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:32.850152 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c1927-670a-4b45-90f1-e07d2fcb120e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:32.850558 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c1927-670a-4b45-90f1-e07d2fcb120e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:32.850878 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c1927-670a-4b45-90f1-e07d2fcb120e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:32.861814 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c1927-670a-4b45-90f1-e07d2fcb120e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:32.863792 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c1927-670a-4b45-90f1-e07d2fcb120e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:32.880786 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-3a1c1927-670a-4b45-90f1-e07d2fcb120e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:53:32.881981 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 617/1213] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:32.887788 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a460d-4c74-487a-8509-e0f666bc59e9 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:32.897527 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a460d-4c74-487a-8509-e0f666bc59e9 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:32.902257 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9aa5c-ba02-463e-a1d6-8fe340be6db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:32.906793 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9aa5c-ba02-463e-a1d6-8fe340be6db3 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:32.906793 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9aa5c-ba02-463e-a1d6-8fe340be6db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:32.906793 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9aa5c-ba02-463e-a1d6-8fe340be6db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:32.906793 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9aa5c-ba02-463e-a1d6-8fe340be6db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:32.906793 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9aa5c-ba02-463e-a1d6-8fe340be6db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:32.906793 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9aa5c-ba02-463e-a1d6-8fe340be6db3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:32.918205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 597/1214] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:32.923852 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c1927-670a-4b45-90f1-e07d2fcb120e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:32.933710 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c1927-670a-4b45-90f1-e07d2fcb120e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:32.938790 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff518e55-ca27-465a-9d8d-41da2b5ed23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:32.939620 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff518e55-ca27-465a-9d8d-41da2b5ed23f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:32.939899 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff518e55-ca27-465a-9d8d-41da2b5ed23f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:32.940172 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff518e55-ca27-465a-9d8d-41da2b5ed23f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:32.946988 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff518e55-ca27-465a-9d8d-41da2b5ed23f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:32.948964 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff518e55-ca27-465a-9d8d-41da2b5ed23f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:32.962359 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-ff518e55-ca27-465a-9d8d-41da2b5ed23f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:53:32.963499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 618/1215] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:53:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:32.969261 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9aa5c-ba02-463e-a1d6-8fe340be6db3 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:32.979463 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9aa5c-ba02-463e-a1d6-8fe340be6db3 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:32.984216 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c81d9-4311-4a1a-93e7-5ee58661bd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:32.987035 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c81d9-4311-4a1a-93e7-5ee58661bd2f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:32.987035 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c81d9-4311-4a1a-93e7-5ee58661bd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:32.987035 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c81d9-4311-4a1a-93e7-5ee58661bd2f admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:32.987035 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c81d9-4311-4a1a-93e7-5ee58661bd2f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:32.987035 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c81d9-4311-4a1a-93e7-5ee58661bd2f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:32.988378 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c81d9-4311-4a1a-93e7-5ee58661bd2f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:33.000069 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 598/1216] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:53:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:33.006061 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff518e55-ca27-465a-9d8d-41da2b5ed23f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:33.016298 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff518e55-ca27-465a-9d8d-41da2b5ed23f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:33.021610 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7e483-28d6-4403-a983-029cd0f57c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:33.022222 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7e483-28d6-4403-a983-029cd0f57c5b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:33.022499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7e483-28d6-4403-a983-029cd0f57c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:33.022803 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7e483-28d6-4403-a983-029cd0f57c5b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:33.023609 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7e483-28d6-4403-a983-029cd0f57c5b admin admin] RBAC: Adding query filter params (role.id=9209cdab986041f1a45283ada1ae297a, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=ae711b94b32a431ab880aa8f6068ff25) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:33.023912 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7e483-28d6-4403-a983-029cd0f57c5b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:33.025720 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7e483-28d6-4403-a983-029cd0f57c5b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:33.030979 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 619/1217] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:53:33 2022] GET /identity/v3/role_assignments?user.id=ae711b94b32a431ab880aa8f6068ff25&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=9209cdab986041f1a45283ada1ae297a => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:35.345886 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9734eae-f5e8-419f-8dd6-10a84c8b8793 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:35.346445 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9734eae-f5e8-419f-8dd6-10a84c8b8793 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:35.346445 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9734eae-f5e8-419f-8dd6-10a84c8b8793 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:35.348217 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 599/1218] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:53:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:53:35.353639 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6c469-89a9-491a-8825-37ddb928e71c None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:35.354061 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6c469-89a9-491a-8825-37ddb928e71c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:35.354238 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6c469-89a9-491a-8825-37ddb928e71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:35.372167 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-2fc6c469-89a9-491a-8825-37ddb928e71c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:53:35.373355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2fc6c469-89a9-491a-8825-37ddb928e71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:53:35.381799 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 620/1219] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:53:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:53:35.405525 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9734eae-f5e8-419f-8dd6-10a84c8b8793 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:35.417659 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9734eae-f5e8-419f-8dd6-10a84c8b8793 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:35.425334 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7e2d5-2d95-443f-aff2-f46e954b8530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:35.425334 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7e2d5-2d95-443f-aff2-f46e954b8530 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:35.425334 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7e2d5-2d95-443f-aff2-f46e954b8530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:35.425334 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7e2d5-2d95-443f-aff2-f46e954b8530 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:35.433081 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7e2d5-2d95-443f-aff2-f46e954b8530 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:53:35.440624 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-0ad7e2d5-2d95-443f-aff2-f46e954b8530 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:53:35.441731 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 600/1220] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:53:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:35.447393 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6c469-89a9-491a-8825-37ddb928e71c None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:35.457200 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6c469-89a9-491a-8825-37ddb928e71c None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:35.461692 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178f38d-196c-4d23-b6fd-ad23c5eb3436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:35.462333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178f38d-196c-4d23-b6fd-ad23c5eb3436 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:35.462612 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178f38d-196c-4d23-b6fd-ad23c5eb3436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:35.462920 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178f38d-196c-4d23-b6fd-ad23c5eb3436 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:35.463652 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178f38d-196c-4d23-b6fd-ad23c5eb3436 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:35.463957 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178f38d-196c-4d23-b6fd-ad23c5eb3436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:35.465525 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178f38d-196c-4d23-b6fd-ad23c5eb3436 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:35.473955 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 621/1221] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:53:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:35.479417 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7e2d5-2d95-443f-aff2-f46e954b8530 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:35.490275 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7e2d5-2d95-443f-aff2-f46e954b8530 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:35.495238 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911f403-1e8d-4cc9-a095-2ec5cf704681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:35.495992 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911f403-1e8d-4cc9-a095-2ec5cf704681 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:35.496268 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911f403-1e8d-4cc9-a095-2ec5cf704681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:35.496535 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911f403-1e8d-4cc9-a095-2ec5cf704681 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:35.507000 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911f403-1e8d-4cc9-a095-2ec5cf704681 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:35.508823 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911f403-1e8d-4cc9-a095-2ec5cf704681 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:35.525681 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-e911f403-1e8d-4cc9-a095-2ec5cf704681 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:53:35.526847 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 601/1222] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:35.532568 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178f38d-196c-4d23-b6fd-ad23c5eb3436 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:35.542106 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178f38d-196c-4d23-b6fd-ad23c5eb3436 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:35.546981 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff49f6a-2244-4ba6-b7a6-6414cae2a85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:35.547629 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff49f6a-2244-4ba6-b7a6-6414cae2a85b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:35.547977 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff49f6a-2244-4ba6-b7a6-6414cae2a85b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:35.548468 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff49f6a-2244-4ba6-b7a6-6414cae2a85b admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:35.549281 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff49f6a-2244-4ba6-b7a6-6414cae2a85b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:35.549586 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff49f6a-2244-4ba6-b7a6-6414cae2a85b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:35.551192 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff49f6a-2244-4ba6-b7a6-6414cae2a85b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:35.562738 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 622/1223] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:35.569642 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911f403-1e8d-4cc9-a095-2ec5cf704681 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:35.579768 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911f403-1e8d-4cc9-a095-2ec5cf704681 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:35.584431 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a94ed-63eb-4fe6-9be5-b45f1d685742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:35.585200 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a94ed-63eb-4fe6-9be5-b45f1d685742 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:35.585474 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a94ed-63eb-4fe6-9be5-b45f1d685742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:35.585743 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a94ed-63eb-4fe6-9be5-b45f1d685742 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:35.592910 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a94ed-63eb-4fe6-9be5-b45f1d685742 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:35.595035 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a94ed-63eb-4fe6-9be5-b45f1d685742 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:35.609716 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-1c8a94ed-63eb-4fe6-9be5-b45f1d685742 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 16:53:35.611039 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 602/1224] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:53:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:35.616905 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff49f6a-2244-4ba6-b7a6-6414cae2a85b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:35.627361 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff49f6a-2244-4ba6-b7a6-6414cae2a85b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:35.631948 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef1c2c-26a1-45ff-ad35-79454bb4ce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:35.634207 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef1c2c-26a1-45ff-ad35-79454bb4ce0e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:35.634207 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef1c2c-26a1-45ff-ad35-79454bb4ce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:35.634207 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef1c2c-26a1-45ff-ad35-79454bb4ce0e admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:35.634207 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef1c2c-26a1-45ff-ad35-79454bb4ce0e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:35.634207 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef1c2c-26a1-45ff-ad35-79454bb4ce0e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:35.636048 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef1c2c-26a1-45ff-ad35-79454bb4ce0e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:35.653844 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 623/1225] 10.222.0.42 () {56 vars in 1164 bytes} [Wed Feb 16 16:53:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:35.659403 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a94ed-63eb-4fe6-9be5-b45f1d685742 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:35.668817 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a94ed-63eb-4fe6-9be5-b45f1d685742 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:35.673267 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fd7e3-5d9e-41bc-b097-0b1fe035c098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:35.674049 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fd7e3-5d9e-41bc-b097-0b1fe035c098 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:35.674319 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fd7e3-5d9e-41bc-b097-0b1fe035c098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:35.674582 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fd7e3-5d9e-41bc-b097-0b1fe035c098 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:35.684453 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fd7e3-5d9e-41bc-b097-0b1fe035c098 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:35.686266 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fd7e3-5d9e-41bc-b097-0b1fe035c098 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:35.703131 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-496fd7e3-5d9e-41bc-b097-0b1fe035c098 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:53:35.704836 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 603/1226] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:35.710355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef1c2c-26a1-45ff-ad35-79454bb4ce0e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:35.720203 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef1c2c-26a1-45ff-ad35-79454bb4ce0e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:35.724746 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc168d0-3f4a-4627-8f25-bee5be456b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:35.725379 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc168d0-3f4a-4627-8f25-bee5be456b3d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:35.725659 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc168d0-3f4a-4627-8f25-bee5be456b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:35.725932 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc168d0-3f4a-4627-8f25-bee5be456b3d admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:35.726639 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc168d0-3f4a-4627-8f25-bee5be456b3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:35.726969 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc168d0-3f4a-4627-8f25-bee5be456b3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:35.728529 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc168d0-3f4a-4627-8f25-bee5be456b3d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:35.745942 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 624/1227] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:35.747229 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fd7e3-5d9e-41bc-b097-0b1fe035c098 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:35.757830 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fd7e3-5d9e-41bc-b097-0b1fe035c098 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:35.762382 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813b29d-cb3f-45ae-81fc-5060e4e84ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:35.763176 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b29d-cb3f-45ae-81fc-5060e4e84ceb admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:35.763455 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b29d-cb3f-45ae-81fc-5060e4e84ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:35.763727 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b29d-cb3f-45ae-81fc-5060e4e84ceb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:35.770777 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813b29d-cb3f-45ae-81fc-5060e4e84ceb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:35.772688 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813b29d-cb3f-45ae-81fc-5060e4e84ceb admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:35.785532 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-3813b29d-cb3f-45ae-81fc-5060e4e84ceb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:53:35.786663 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 604/1228] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:53:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:35.792313 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc168d0-3f4a-4627-8f25-bee5be456b3d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:35.802946 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc168d0-3f4a-4627-8f25-bee5be456b3d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:35.807475 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03f788-44d3-4900-921c-2d5c99b6ef44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:35.808110 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03f788-44d3-4900-921c-2d5c99b6ef44 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:35.808392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03f788-44d3-4900-921c-2d5c99b6ef44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:35.808670 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03f788-44d3-4900-921c-2d5c99b6ef44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:35.809442 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03f788-44d3-4900-921c-2d5c99b6ef44 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:35.809747 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03f788-44d3-4900-921c-2d5c99b6ef44 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:35.811603 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03f788-44d3-4900-921c-2d5c99b6ef44 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:35.824162 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 625/1229] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:53:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:35.829846 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813b29d-cb3f-45ae-81fc-5060e4e84ceb admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:35.839965 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813b29d-cb3f-45ae-81fc-5060e4e84ceb admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:35.844556 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd6bf4-afb9-4c68-9ec9-b039dc7b975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:35.845475 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd6bf4-afb9-4c68-9ec9-b039dc7b975f admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:35.845781 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd6bf4-afb9-4c68-9ec9-b039dc7b975f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:35.846057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd6bf4-afb9-4c68-9ec9-b039dc7b975f admin admin] PATH_INFO: `/v3/projects/6160f9606d06486b9a11a23ee717af79/users/ae711b94b32a431ab880aa8f6068ff25/roles/9209cdab986041f1a45283ada1ae297a` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:35.862464 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd6bf4-afb9-4c68-9ec9-b039dc7b975f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6160f9606d06486b9a11a23ee717af79, user_id=ae711b94b32a431ab880aa8f6068ff25, role_id=9209cdab986041f1a45283ada1ae297a)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:35.863944 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd6bf4-afb9-4c68-9ec9-b039dc7b975f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:36.018458 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 605/1230] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:53:35 2022] PUT /identity/v3/projects/6160f9606d06486b9a11a23ee717af79/users/ae711b94b32a431ab880aa8f6068ff25/roles/9209cdab986041f1a45283ada1ae297a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:53:38.325614 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a879277-9b28-47ad-9471-72e4d7506fd7 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:38.326231 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a879277-9b28-47ad-9471-72e4d7506fd7 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:38.326231 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a879277-9b28-47ad-9471-72e4d7506fd7 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:38.327966 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 626/1231] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:53:38.333232 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78003c6-99f2-4b4d-aded-28a62cc81600 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:38.333626 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78003c6-99f2-4b4d-aded-28a62cc81600 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:38.333816 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78003c6-99f2-4b4d-aded-28a62cc81600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:38.351954 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-c78003c6-99f2-4b4d-aded-28a62cc81600 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:53:38.353152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-c78003c6-99f2-4b4d-aded-28a62cc81600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:53:38.410144 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 606/1232] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:53:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 16:53:38.434884 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a879277-9b28-47ad-9471-72e4d7506fd7 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:38.447050 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a879277-9b28-47ad-9471-72e4d7506fd7 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:38.451326 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b07e42-75b4-4fa2-b944-abf9be8976b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:38.452084 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b07e42-75b4-4fa2-b944-abf9be8976b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:38.452360 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b07e42-75b4-4fa2-b944-abf9be8976b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:38.452628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b07e42-75b4-4fa2-b944-abf9be8976b6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:38.462520 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b07e42-75b4-4fa2-b944-abf9be8976b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:53:38.469232 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-d2b07e42-75b4-4fa2-b944-abf9be8976b6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 16:53:38.470891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 627/1233] 10.222.0.42 () {56 vars in 1123 bytes} [Wed Feb 16 16:53:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:38.476632 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78003c6-99f2-4b4d-aded-28a62cc81600 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:38.486397 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78003c6-99f2-4b4d-aded-28a62cc81600 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:38.490944 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddffe0-8e71-4267-bf4d-48f343ea3fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:38.491644 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddffe0-8e71-4267-bf4d-48f343ea3fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:38.491926 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddffe0-8e71-4267-bf4d-48f343ea3fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:38.492200 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddffe0-8e71-4267-bf4d-48f343ea3fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:38.492940 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddffe0-8e71-4267-bf4d-48f343ea3fe2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:38.493247 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddffe0-8e71-4267-bf4d-48f343ea3fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:38.494852 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddffe0-8e71-4267-bf4d-48f343ea3fe2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:38.503125 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 607/1234] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Feb 16 16:53:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:38.508752 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b07e42-75b4-4fa2-b944-abf9be8976b6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:38.518951 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b07e42-75b4-4fa2-b944-abf9be8976b6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:38.523605 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c32b4e-5157-412f-a387-f75be9e2f10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:38.524360 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c32b4e-5157-412f-a387-f75be9e2f10e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:38.524633 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c32b4e-5157-412f-a387-f75be9e2f10e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:38.524903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c32b4e-5157-412f-a387-f75be9e2f10e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:38.535735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c32b4e-5157-412f-a387-f75be9e2f10e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:38.537601 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c32b4e-5157-412f-a387-f75be9e2f10e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:38.555794 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-19c32b4e-5157-412f-a387-f75be9e2f10e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:53:38.556947 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 628/1235] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:38.562869 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddffe0-8e71-4267-bf4d-48f343ea3fe2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:38.572974 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddffe0-8e71-4267-bf4d-48f343ea3fe2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:38.577671 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af490e-b8fd-49f9-8299-1504f224da5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:38.578261 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af490e-b8fd-49f9-8299-1504f224da5e admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:38.578543 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af490e-b8fd-49f9-8299-1504f224da5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:38.578852 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af490e-b8fd-49f9-8299-1504f224da5e admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:38.579726 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af490e-b8fd-49f9-8299-1504f224da5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:38.580053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af490e-b8fd-49f9-8299-1504f224da5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:38.581633 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af490e-b8fd-49f9-8299-1504f224da5e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:38.593380 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 608/1236] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:38.599542 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c32b4e-5157-412f-a387-f75be9e2f10e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:38.609779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c32b4e-5157-412f-a387-f75be9e2f10e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:38.616616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c26228-00d1-4e24-9ccd-293f63434673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:38.617439 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c26228-00d1-4e24-9ccd-293f63434673 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:38.617722 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c26228-00d1-4e24-9ccd-293f63434673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:38.618003 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c26228-00d1-4e24-9ccd-293f63434673 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:38.625571 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c26228-00d1-4e24-9ccd-293f63434673 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:38.627745 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c26228-00d1-4e24-9ccd-293f63434673 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:38.641763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-54c26228-00d1-4e24-9ccd-293f63434673 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 16:53:38.643101 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 629/1237] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:53:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:38.648876 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af490e-b8fd-49f9-8299-1504f224da5e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:38.659609 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af490e-b8fd-49f9-8299-1504f224da5e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:38.664397 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727e492-fb4a-41b6-9ee2-72bb1f4a8228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:38.665065 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727e492-fb4a-41b6-9ee2-72bb1f4a8228 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:38.665347 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727e492-fb4a-41b6-9ee2-72bb1f4a8228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:38.665621 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727e492-fb4a-41b6-9ee2-72bb1f4a8228 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:38.675701 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727e492-fb4a-41b6-9ee2-72bb1f4a8228 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:38.675701 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727e492-fb4a-41b6-9ee2-72bb1f4a8228 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:38.675701 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727e492-fb4a-41b6-9ee2-72bb1f4a8228 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:38.686637 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 609/1238] 10.222.0.42 () {56 vars in 1164 bytes} [Wed Feb 16 16:53:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:38.692347 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c26228-00d1-4e24-9ccd-293f63434673 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:38.701848 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c26228-00d1-4e24-9ccd-293f63434673 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:38.707251 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e9b43-7985-4306-b691-22a3ec449753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:38.707875 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e9b43-7985-4306-b691-22a3ec449753 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:38.710358 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e9b43-7985-4306-b691-22a3ec449753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:38.710358 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e9b43-7985-4306-b691-22a3ec449753 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:38.716043 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e9b43-7985-4306-b691-22a3ec449753 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:38.717755 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e9b43-7985-4306-b691-22a3ec449753 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:38.727441 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 630/1239] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:53:38 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 16:53:38.733074 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727e492-fb4a-41b6-9ee2-72bb1f4a8228 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:38.742907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727e492-fb4a-41b6-9ee2-72bb1f4a8228 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:38.747400 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bb457-4356-42bc-84c9-135ba193ae65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:38.748162 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bb457-4356-42bc-84c9-135ba193ae65 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:38.748448 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bb457-4356-42bc-84c9-135ba193ae65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:38.748718 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bb457-4356-42bc-84c9-135ba193ae65 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:38.758822 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bb457-4356-42bc-84c9-135ba193ae65 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:38.760625 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bb457-4356-42bc-84c9-135ba193ae65 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:38.777485 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-a00bb457-4356-42bc-84c9-135ba193ae65 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:53:38.778619 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 610/1240] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:38.784779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e9b43-7985-4306-b691-22a3ec449753 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:38.793689 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e9b43-7985-4306-b691-22a3ec449753 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:38.799140 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdb73b-497c-4aab-b411-7ea1b00949b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:38.799801 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdb73b-497c-4aab-b411-7ea1b00949b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:38.800076 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdb73b-497c-4aab-b411-7ea1b00949b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:38.800352 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdb73b-497c-4aab-b411-7ea1b00949b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:38.801053 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdb73b-497c-4aab-b411-7ea1b00949b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:38.801354 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdb73b-497c-4aab-b411-7ea1b00949b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:38.803000 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdb73b-497c-4aab-b411-7ea1b00949b0 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:38.816388 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 631/1241] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:38.821747 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bb457-4356-42bc-84c9-135ba193ae65 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:38.831638 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bb457-4356-42bc-84c9-135ba193ae65 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:38.836139 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34329235-c6d4-4fdf-9937-25ce8f02c0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:38.836906 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34329235-c6d4-4fdf-9937-25ce8f02c0ba admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:38.837186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34329235-c6d4-4fdf-9937-25ce8f02c0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:38.837465 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34329235-c6d4-4fdf-9937-25ce8f02c0ba admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:38.844268 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34329235-c6d4-4fdf-9937-25ce8f02c0ba admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:38.846423 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34329235-c6d4-4fdf-9937-25ce8f02c0ba admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:38.859523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-34329235-c6d4-4fdf-9937-25ce8f02c0ba admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:53:38.861278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 611/1242] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:53:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:38.867063 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdb73b-497c-4aab-b411-7ea1b00949b0 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:38.877281 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdb73b-497c-4aab-b411-7ea1b00949b0 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:38.881802 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd90e0-166a-40f1-8892-940aa5dad3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:38.882433 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd90e0-166a-40f1-8892-940aa5dad3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:38.882745 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd90e0-166a-40f1-8892-940aa5dad3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:38.883015 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd90e0-166a-40f1-8892-940aa5dad3d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:38.883773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd90e0-166a-40f1-8892-940aa5dad3d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:38.884073 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd90e0-166a-40f1-8892-940aa5dad3d3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:38.885859 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd90e0-166a-40f1-8892-940aa5dad3d3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:38.898061 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 632/1243] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:53:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:38.903731 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34329235-c6d4-4fdf-9937-25ce8f02c0ba admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:38.913950 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34329235-c6d4-4fdf-9937-25ce8f02c0ba admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:38.918459 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfe32d-391f-4352-9d64-8c81cb76e4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:38.919105 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfe32d-391f-4352-9d64-8c81cb76e4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:38.919389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfe32d-391f-4352-9d64-8c81cb76e4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:38.919667 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfe32d-391f-4352-9d64-8c81cb76e4c0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:38.923737 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfe32d-391f-4352-9d64-8c81cb76e4c0 admin admin] RBAC: Adding query filter params (role.id=9209cdab986041f1a45283ada1ae297a, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=ae711b94b32a431ab880aa8f6068ff25) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:38.923737 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfe32d-391f-4352-9d64-8c81cb76e4c0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:38.923737 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfe32d-391f-4352-9d64-8c81cb76e4c0 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:38.928901 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 612/1244] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:53:38 2022] GET /identity/v3/role_assignments?user.id=ae711b94b32a431ab880aa8f6068ff25&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=9209cdab986041f1a45283ada1ae297a => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:41.315412 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd0d28-8c79-42aa-9c92-665439fa3e9e None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:41.315995 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd0d28-8c79-42aa-9c92-665439fa3e9e None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:41.315995 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd0d28-8c79-42aa-9c92-665439fa3e9e None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:41.317739 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 633/1245] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:53:41.323271 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d848e-5134-4379-865f-7e4749699eec None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:41.323705 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d848e-5134-4379-865f-7e4749699eec None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:41.323831 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d848e-5134-4379-865f-7e4749699eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:41.341844 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-604d848e-5134-4379-865f-7e4749699eec None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:53:41.343135 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-604d848e-5134-4379-865f-7e4749699eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:53:41.350969 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 613/1246] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:53:41 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:53:41.376494 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd0d28-8c79-42aa-9c92-665439fa3e9e None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:41.388915 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd0d28-8c79-42aa-9c92-665439fa3e9e None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:41.394233 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810f891-cc4b-4d50-b306-1ab50c8aadc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:41.395105 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810f891-cc4b-4d50-b306-1ab50c8aadc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:41.395333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810f891-cc4b-4d50-b306-1ab50c8aadc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:41.395773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810f891-cc4b-4d50-b306-1ab50c8aadc3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:41.405885 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810f891-cc4b-4d50-b306-1ab50c8aadc3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:53:41.415645 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-e810f891-cc4b-4d50-b306-1ab50c8aadc3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:53:41.417095 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 634/1247] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:53:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:41.423097 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d848e-5134-4379-865f-7e4749699eec None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:41.432270 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d848e-5134-4379-865f-7e4749699eec None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:41.436932 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0e760-ae8c-427e-8ccb-9aaf001cda45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:41.437574 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e760-ae8c-427e-8ccb-9aaf001cda45 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:41.437856 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e760-ae8c-427e-8ccb-9aaf001cda45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:41.438134 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e760-ae8c-427e-8ccb-9aaf001cda45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:41.439543 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0e760-ae8c-427e-8ccb-9aaf001cda45 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:41.439852 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0e760-ae8c-427e-8ccb-9aaf001cda45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:41.441468 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0e760-ae8c-427e-8ccb-9aaf001cda45 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:41.449663 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 614/1248] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:53:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:41.455794 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810f891-cc4b-4d50-b306-1ab50c8aadc3 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:41.465109 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810f891-cc4b-4d50-b306-1ab50c8aadc3 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:41.469698 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bce597-fec5-4ad7-9312-3fb74abb2a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:41.470458 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bce597-fec5-4ad7-9312-3fb74abb2a82 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:41.470771 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bce597-fec5-4ad7-9312-3fb74abb2a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:41.471042 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bce597-fec5-4ad7-9312-3fb74abb2a82 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:41.481306 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bce597-fec5-4ad7-9312-3fb74abb2a82 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:41.483143 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bce597-fec5-4ad7-9312-3fb74abb2a82 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:41.499241 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-a1bce597-fec5-4ad7-9312-3fb74abb2a82 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:53:41.500351 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 635/1249] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:41.506901 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0e760-ae8c-427e-8ccb-9aaf001cda45 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:41.516237 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0e760-ae8c-427e-8ccb-9aaf001cda45 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:41.521445 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0913cc-dda9-4874-b9c5-67e54cd2524d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:41.522071 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0913cc-dda9-4874-b9c5-67e54cd2524d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:41.522346 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0913cc-dda9-4874-b9c5-67e54cd2524d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:41.522617 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0913cc-dda9-4874-b9c5-67e54cd2524d admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:41.523378 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0913cc-dda9-4874-b9c5-67e54cd2524d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:41.523676 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0913cc-dda9-4874-b9c5-67e54cd2524d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:41.525233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0913cc-dda9-4874-b9c5-67e54cd2524d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:41.537368 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 615/1250] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:41.543145 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bce597-fec5-4ad7-9312-3fb74abb2a82 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:41.552941 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bce597-fec5-4ad7-9312-3fb74abb2a82 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:41.557457 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da9a86-4b6d-47a7-9fb1-fb9967aa1e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:41.558225 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da9a86-4b6d-47a7-9fb1-fb9967aa1e99 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:41.558503 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da9a86-4b6d-47a7-9fb1-fb9967aa1e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:41.558808 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da9a86-4b6d-47a7-9fb1-fb9967aa1e99 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:41.569038 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da9a86-4b6d-47a7-9fb1-fb9967aa1e99 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:41.569462 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da9a86-4b6d-47a7-9fb1-fb9967aa1e99 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:41.583703 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-09da9a86-4b6d-47a7-9fb1-fb9967aa1e99 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 16:53:41.584939 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 636/1251] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:53:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:41.590699 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0913cc-dda9-4874-b9c5-67e54cd2524d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:41.600564 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0913cc-dda9-4874-b9c5-67e54cd2524d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:41.605196 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6241b-dd0d-4d8f-8726-11f5cea12509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:41.609264 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6241b-dd0d-4d8f-8726-11f5cea12509 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:41.609264 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6241b-dd0d-4d8f-8726-11f5cea12509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:41.609264 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6241b-dd0d-4d8f-8726-11f5cea12509 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:41.609264 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6241b-dd0d-4d8f-8726-11f5cea12509 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:41.609264 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6241b-dd0d-4d8f-8726-11f5cea12509 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:41.609653 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6241b-dd0d-4d8f-8726-11f5cea12509 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:41.626787 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 616/1252] 10.222.0.42 () {56 vars in 1164 bytes} [Wed Feb 16 16:53:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:41.632477 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da9a86-4b6d-47a7-9fb1-fb9967aa1e99 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:41.643125 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da9a86-4b6d-47a7-9fb1-fb9967aa1e99 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:41.647760 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2a920-8478-4e0c-ba97-a7c95a94a557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:41.648383 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2a920-8478-4e0c-ba97-a7c95a94a557 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:41.648663 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2a920-8478-4e0c-ba97-a7c95a94a557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:41.648933 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2a920-8478-4e0c-ba97-a7c95a94a557 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:41.656769 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2a920-8478-4e0c-ba97-a7c95a94a557 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:41.658807 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2a920-8478-4e0c-ba97-a7c95a94a557 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:41.667915 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 637/1253] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:53:41 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:53:41.673836 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6241b-dd0d-4d8f-8726-11f5cea12509 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:41.684802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6241b-dd0d-4d8f-8726-11f5cea12509 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:41.690367 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4d44f-e360-4d74-ace2-f904feade583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:41.691167 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4d44f-e360-4d74-ace2-f904feade583 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:41.691450 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4d44f-e360-4d74-ace2-f904feade583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:41.691725 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4d44f-e360-4d74-ace2-f904feade583 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:41.701924 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4d44f-e360-4d74-ace2-f904feade583 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:41.703836 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4d44f-e360-4d74-ace2-f904feade583 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:41.726471 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-1bf4d44f-e360-4d74-ace2-f904feade583 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:53:41.727678 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 617/1254] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:41.733896 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2a920-8478-4e0c-ba97-a7c95a94a557 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:41.743231 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2a920-8478-4e0c-ba97-a7c95a94a557 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:41.747826 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da861956-3565-4ea3-9cd1-73f670277f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:41.748459 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da861956-3565-4ea3-9cd1-73f670277f06 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:41.748738 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da861956-3565-4ea3-9cd1-73f670277f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:41.749009 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da861956-3565-4ea3-9cd1-73f670277f06 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:41.749713 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da861956-3565-4ea3-9cd1-73f670277f06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:41.750013 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da861956-3565-4ea3-9cd1-73f670277f06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:41.752240 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da861956-3565-4ea3-9cd1-73f670277f06 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:41.764194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 638/1255] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:41.771012 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4d44f-e360-4d74-ace2-f904feade583 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:41.780663 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4d44f-e360-4d74-ace2-f904feade583 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:41.785286 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193451e-57c2-4263-a569-dc4294f97719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:41.786050 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193451e-57c2-4263-a569-dc4294f97719 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:41.786332 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193451e-57c2-4263-a569-dc4294f97719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:41.786607 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193451e-57c2-4263-a569-dc4294f97719 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:41.793333 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193451e-57c2-4263-a569-dc4294f97719 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:41.795416 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193451e-57c2-4263-a569-dc4294f97719 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:41.808804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-1193451e-57c2-4263-a569-dc4294f97719 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:53:41.809965 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 618/1256] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:53:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:53:41.816990 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da861956-3565-4ea3-9cd1-73f670277f06 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:41.829278 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da861956-3565-4ea3-9cd1-73f670277f06 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:41.831624 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64248ea5-4899-438d-9dfd-4b1571e517ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:41.832255 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64248ea5-4899-438d-9dfd-4b1571e517ce admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:41.832535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64248ea5-4899-438d-9dfd-4b1571e517ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:41.832803 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64248ea5-4899-438d-9dfd-4b1571e517ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:41.833569 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64248ea5-4899-438d-9dfd-4b1571e517ce admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:41.833866 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64248ea5-4899-438d-9dfd-4b1571e517ce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:41.835713 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64248ea5-4899-438d-9dfd-4b1571e517ce admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:41.847172 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 639/1257] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:53:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:41.853185 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193451e-57c2-4263-a569-dc4294f97719 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:41.864682 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193451e-57c2-4263-a569-dc4294f97719 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:41.869336 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab6cb3-f882-49d7-b35a-a25b21bea1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:41.869954 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab6cb3-f882-49d7-b35a-a25b21bea1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:41.870234 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab6cb3-f882-49d7-b35a-a25b21bea1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:41.870510 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab6cb3-f882-49d7-b35a-a25b21bea1c5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:41.871416 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab6cb3-f882-49d7-b35a-a25b21bea1c5 admin admin] RBAC: Adding query filter params (role.id=8263a29ceeed4576b3b6959c99964ed7, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=ae711b94b32a431ab880aa8f6068ff25) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:41.871724 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab6cb3-f882-49d7-b35a-a25b21bea1c5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:41.873535 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab6cb3-f882-49d7-b35a-a25b21bea1c5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:41.879745 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 619/1258] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:53:41 2022] GET /identity/v3/role_assignments?user.id=ae711b94b32a431ab880aa8f6068ff25&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:44.151186 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc929194-80fe-44f3-858b-b4b16329bb67 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:44.151734 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc929194-80fe-44f3-858b-b4b16329bb67 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:44.151734 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc929194-80fe-44f3-858b-b4b16329bb67 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:44.153483 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 640/1259] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:53:44.159621 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077eef9e-fd2d-4e1c-a5d5-ef0b73dd2872 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:44.160053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077eef9e-fd2d-4e1c-a5d5-ef0b73dd2872 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:44.160151 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077eef9e-fd2d-4e1c-a5d5-ef0b73dd2872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:44.177453 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-077eef9e-fd2d-4e1c-a5d5-ef0b73dd2872 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:53:44.178614 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-077eef9e-fd2d-4e1c-a5d5-ef0b73dd2872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:53:44.186189 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 620/1260] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:53:44 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:53:44.209070 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc929194-80fe-44f3-858b-b4b16329bb67 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:44.221821 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc929194-80fe-44f3-858b-b4b16329bb67 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:44.226235 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02c19d-fc24-4cbb-9059-4daf3e393e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:44.227039 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02c19d-fc24-4cbb-9059-4daf3e393e9e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:44.227349 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02c19d-fc24-4cbb-9059-4daf3e393e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:44.227632 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02c19d-fc24-4cbb-9059-4daf3e393e9e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:44.238194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02c19d-fc24-4cbb-9059-4daf3e393e9e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:53:44.245204 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-ac02c19d-fc24-4cbb-9059-4daf3e393e9e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:53:44.246386 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 641/1261] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:53:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:44.252300 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077eef9e-fd2d-4e1c-a5d5-ef0b73dd2872 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:44.261046 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077eef9e-fd2d-4e1c-a5d5-ef0b73dd2872 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:44.265577 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a74d0a-cbb7-40ca-aa2d-488858f24cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:44.266754 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a74d0a-cbb7-40ca-aa2d-488858f24cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:44.267183 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a74d0a-cbb7-40ca-aa2d-488858f24cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:44.267469 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a74d0a-cbb7-40ca-aa2d-488858f24cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:44.268208 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a74d0a-cbb7-40ca-aa2d-488858f24cf1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:44.268786 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a74d0a-cbb7-40ca-aa2d-488858f24cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:44.270058 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a74d0a-cbb7-40ca-aa2d-488858f24cf1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:44.278043 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 621/1262] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:53:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:53:44.284441 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02c19d-fc24-4cbb-9059-4daf3e393e9e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:44.294855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02c19d-fc24-4cbb-9059-4daf3e393e9e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:44.299526 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c6561-1e7c-4f92-88e6-261467b8a6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:44.300309 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c6561-1e7c-4f92-88e6-261467b8a6ea admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:44.300588 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c6561-1e7c-4f92-88e6-261467b8a6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:44.300859 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c6561-1e7c-4f92-88e6-261467b8a6ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:44.310989 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c6561-1e7c-4f92-88e6-261467b8a6ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:44.312868 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c6561-1e7c-4f92-88e6-261467b8a6ea admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:44.330950 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-cc7c6561-1e7c-4f92-88e6-261467b8a6ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:53:44.332116 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 642/1263] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:44.337694 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a74d0a-cbb7-40ca-aa2d-488858f24cf1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:44.347459 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a74d0a-cbb7-40ca-aa2d-488858f24cf1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:44.352136 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d6811-de74-4476-8b5f-df8faff6e781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:44.352766 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d6811-de74-4476-8b5f-df8faff6e781 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:44.353293 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d6811-de74-4476-8b5f-df8faff6e781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:44.353389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d6811-de74-4476-8b5f-df8faff6e781 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:44.354140 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d6811-de74-4476-8b5f-df8faff6e781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:44.354446 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d6811-de74-4476-8b5f-df8faff6e781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:44.356041 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d6811-de74-4476-8b5f-df8faff6e781 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:44.368218 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 622/1264] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:44.373736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c6561-1e7c-4f92-88e6-261467b8a6ea admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:44.383872 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c6561-1e7c-4f92-88e6-261467b8a6ea admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:44.388369 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837f948-c96c-4b92-a61a-2d5a5ac3c3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:44.389131 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837f948-c96c-4b92-a61a-2d5a5ac3c3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:44.389409 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837f948-c96c-4b92-a61a-2d5a5ac3c3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:44.389676 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837f948-c96c-4b92-a61a-2d5a5ac3c3c4 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:44.397558 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837f948-c96c-4b92-a61a-2d5a5ac3c3c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:44.399580 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837f948-c96c-4b92-a61a-2d5a5ac3c3c4 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:44.413923 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-7837f948-c96c-4b92-a61a-2d5a5ac3c3c4 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 16:53:44.415013 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 643/1265] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:53:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:44.420726 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d6811-de74-4476-8b5f-df8faff6e781 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:44.430815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d6811-de74-4476-8b5f-df8faff6e781 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:44.435382 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700035b-2610-4f5a-ae0e-412e1308ac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:44.436023 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700035b-2610-4f5a-ae0e-412e1308ac26 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:44.436301 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700035b-2610-4f5a-ae0e-412e1308ac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:44.436575 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700035b-2610-4f5a-ae0e-412e1308ac26 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:44.437395 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700035b-2610-4f5a-ae0e-412e1308ac26 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:44.437700 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700035b-2610-4f5a-ae0e-412e1308ac26 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:44.440397 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700035b-2610-4f5a-ae0e-412e1308ac26 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:44.457703 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 623/1266] 10.222.0.42 () {56 vars in 1164 bytes} [Wed Feb 16 16:53:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:53:44.463200 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837f948-c96c-4b92-a61a-2d5a5ac3c3c4 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:44.472669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837f948-c96c-4b92-a61a-2d5a5ac3c3c4 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:44.477207 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43894351-b1d5-42a5-ba78-388d92768987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:44.477962 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43894351-b1d5-42a5-ba78-388d92768987 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:44.478244 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43894351-b1d5-42a5-ba78-388d92768987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:44.478518 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43894351-b1d5-42a5-ba78-388d92768987 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:44.488992 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43894351-b1d5-42a5-ba78-388d92768987 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:44.490833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43894351-b1d5-42a5-ba78-388d92768987 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:44.507961 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-43894351-b1d5-42a5-ba78-388d92768987 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:53:44.509074 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 644/1267] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:44.514719 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700035b-2610-4f5a-ae0e-412e1308ac26 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:44.524985 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700035b-2610-4f5a-ae0e-412e1308ac26 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:44.529532 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167d318-4163-4812-8f32-aa17812ea9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:44.530170 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167d318-4163-4812-8f32-aa17812ea9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:44.530449 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167d318-4163-4812-8f32-aa17812ea9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:44.530748 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167d318-4163-4812-8f32-aa17812ea9c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:44.531462 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167d318-4163-4812-8f32-aa17812ea9c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:44.531765 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167d318-4163-4812-8f32-aa17812ea9c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:44.533666 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167d318-4163-4812-8f32-aa17812ea9c7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:44.544985 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 624/1268] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:53:44.550759 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43894351-b1d5-42a5-ba78-388d92768987 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:44.561060 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43894351-b1d5-42a5-ba78-388d92768987 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:44.566333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1cd34-de18-40be-b9cc-9a48caf9e4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:44.568318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1cd34-de18-40be-b9cc-9a48caf9e4ba admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:44.568318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1cd34-de18-40be-b9cc-9a48caf9e4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:44.568318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1cd34-de18-40be-b9cc-9a48caf9e4ba admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:44.574882 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1cd34-de18-40be-b9cc-9a48caf9e4ba admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:44.576933 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1cd34-de18-40be-b9cc-9a48caf9e4ba admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:44.591002 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-95d1cd34-de18-40be-b9cc-9a48caf9e4ba admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:53:44.592208 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 645/1269] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:53:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:44.597894 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167d318-4163-4812-8f32-aa17812ea9c7 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:44.607651 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167d318-4163-4812-8f32-aa17812ea9c7 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:44.612677 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6e4ef-2c70-48a6-a526-a08855d298d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:44.613313 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6e4ef-2c70-48a6-a526-a08855d298d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:44.613595 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6e4ef-2c70-48a6-a526-a08855d298d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:44.613871 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6e4ef-2c70-48a6-a526-a08855d298d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:44.614662 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6e4ef-2c70-48a6-a526-a08855d298d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:44.614976 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6e4ef-2c70-48a6-a526-a08855d298d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:44.616935 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6e4ef-2c70-48a6-a526-a08855d298d5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:44.629320 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 625/1270] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:53:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:44.635005 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1cd34-de18-40be-b9cc-9a48caf9e4ba admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:44.645828 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1cd34-de18-40be-b9cc-9a48caf9e4ba admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:44.650380 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0aba85-7bfa-4b4b-ae48-a72fb4cbb3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:44.651271 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aba85-7bfa-4b4b-ae48-a72fb4cbb3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:44.651552 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aba85-7bfa-4b4b-ae48-a72fb4cbb3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:44.651827 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aba85-7bfa-4b4b-ae48-a72fb4cbb3ca admin admin] PATH_INFO: `/v3/projects/6160f9606d06486b9a11a23ee717af79/users/ae711b94b32a431ab880aa8f6068ff25/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:44.653773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0aba85-7bfa-4b4b-ae48-a72fb4cbb3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=6160f9606d06486b9a11a23ee717af79, user_id=ae711b94b32a431ab880aa8f6068ff25, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:44.656423 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0aba85-7bfa-4b4b-ae48-a72fb4cbb3ca admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:44.812863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 646/1271] 10.222.0.42 () {58 vars in 1460 bytes} [Wed Feb 16 16:53:44 2022] PUT /identity/v3/projects/6160f9606d06486b9a11a23ee717af79/users/ae711b94b32a431ab880aa8f6068ff25/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 16:53:47.119066 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a8efb-23d8-4997-8205-15b9871b3efc None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:47.119614 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a8efb-23d8-4997-8205-15b9871b3efc None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:47.119614 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a8efb-23d8-4997-8205-15b9871b3efc None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:47.121419 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 626/1272] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:53:47.126828 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70538ba4-9e90-4116-8674-ccc3b4de1a93 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:47.127199 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70538ba4-9e90-4116-8674-ccc3b4de1a93 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:47.127377 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70538ba4-9e90-4116-8674-ccc3b4de1a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:47.145203 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-70538ba4-9e90-4116-8674-ccc3b4de1a93 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:53:47.146376 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-70538ba4-9e90-4116-8674-ccc3b4de1a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:53:47.202202 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 647/1273] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:53:47 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:53:47.226677 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a8efb-23d8-4997-8205-15b9871b3efc None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:47.239338 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a8efb-23d8-4997-8205-15b9871b3efc None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:47.243732 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28345f-96d0-4b45-ae91-30d73b2d1bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:47.244493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28345f-96d0-4b45-ae91-30d73b2d1bbd admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:47.244773 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28345f-96d0-4b45-ae91-30d73b2d1bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:47.245049 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28345f-96d0-4b45-ae91-30d73b2d1bbd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:47.255127 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28345f-96d0-4b45-ae91-30d73b2d1bbd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 16:53:47.261841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-7c28345f-96d0-4b45-ae91-30d73b2d1bbd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 16:53:47.263049 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 627/1274] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Feb 16 16:53:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:47.269301 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70538ba4-9e90-4116-8674-ccc3b4de1a93 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:47.278205 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70538ba4-9e90-4116-8674-ccc3b4de1a93 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:47.283358 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb296b-082a-4744-9c02-5ae2e9855dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:47.287035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb296b-082a-4744-9c02-5ae2e9855dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:47.287035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb296b-082a-4744-9c02-5ae2e9855dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:47.287035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb296b-082a-4744-9c02-5ae2e9855dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:47.287035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb296b-082a-4744-9c02-5ae2e9855dd2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:47.287035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb296b-082a-4744-9c02-5ae2e9855dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:47.287430 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb296b-082a-4744-9c02-5ae2e9855dd2 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:47.295195 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 648/1275] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Feb 16 16:53:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:47.301201 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28345f-96d0-4b45-ae91-30d73b2d1bbd admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:47.311337 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28345f-96d0-4b45-ae91-30d73b2d1bbd admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:47.316478 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca036a-42e6-461a-8c4b-a297c8476d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:47.317223 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca036a-42e6-461a-8c4b-a297c8476d0f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:47.317500 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca036a-42e6-461a-8c4b-a297c8476d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:47.317772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca036a-42e6-461a-8c4b-a297c8476d0f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:47.327663 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca036a-42e6-461a-8c4b-a297c8476d0f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:47.330052 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca036a-42e6-461a-8c4b-a297c8476d0f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:47.346744 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-d9ca036a-42e6-461a-8c4b-a297c8476d0f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:53:47.347873 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 628/1276] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:53:47.353676 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb296b-082a-4744-9c02-5ae2e9855dd2 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:47.363481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb296b-082a-4744-9c02-5ae2e9855dd2 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:47.367960 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d5ed2-2b72-4394-9f9d-134396c90d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:47.368585 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d5ed2-2b72-4394-9f9d-134396c90d30 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:47.368861 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d5ed2-2b72-4394-9f9d-134396c90d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:47.369180 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d5ed2-2b72-4394-9f9d-134396c90d30 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:47.369833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d5ed2-2b72-4394-9f9d-134396c90d30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:47.370129 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d5ed2-2b72-4394-9f9d-134396c90d30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:47.371743 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d5ed2-2b72-4394-9f9d-134396c90d30 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:47.384572 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 649/1277] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 16:53:47.390133 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca036a-42e6-461a-8c4b-a297c8476d0f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:47.400444 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca036a-42e6-461a-8c4b-a297c8476d0f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:47.404924 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6099e35-a01c-4758-8f3d-57bad9036cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:47.405801 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6099e35-a01c-4758-8f3d-57bad9036cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:47.406007 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6099e35-a01c-4758-8f3d-57bad9036cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:47.406276 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6099e35-a01c-4758-8f3d-57bad9036cd3 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:47.413758 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6099e35-a01c-4758-8f3d-57bad9036cd3 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:47.418986 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6099e35-a01c-4758-8f3d-57bad9036cd3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:47.429754 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-b6099e35-a01c-4758-8f3d-57bad9036cd3 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 16:53:47.430920 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 629/1278] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:53:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:47.436716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d5ed2-2b72-4394-9f9d-134396c90d30 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:47.447335 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d5ed2-2b72-4394-9f9d-134396c90d30 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:47.452106 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665f980-00ff-4f9d-ba26-dd6b7ca40a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:47.452750 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665f980-00ff-4f9d-ba26-dd6b7ca40a72 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:47.453025 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665f980-00ff-4f9d-ba26-dd6b7ca40a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:47.453295 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665f980-00ff-4f9d-ba26-dd6b7ca40a72 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:47.455163 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665f980-00ff-4f9d-ba26-dd6b7ca40a72 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:47.455472 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665f980-00ff-4f9d-ba26-dd6b7ca40a72 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:47.457314 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665f980-00ff-4f9d-ba26-dd6b7ca40a72 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:47.474229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 650/1279] 10.222.0.42 () {56 vars in 1164 bytes} [Wed Feb 16 16:53:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:47.480031 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6099e35-a01c-4758-8f3d-57bad9036cd3 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:47.489885 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6099e35-a01c-4758-8f3d-57bad9036cd3 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:47.494422 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f8b02-024d-4b19-ae13-099d69e75a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:47.495085 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f8b02-024d-4b19-ae13-099d69e75a54 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:47.495369 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f8b02-024d-4b19-ae13-099d69e75a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:47.495647 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f8b02-024d-4b19-ae13-099d69e75a54 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:47.503772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f8b02-024d-4b19-ae13-099d69e75a54 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:47.505494 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f8b02-024d-4b19-ae13-099d69e75a54 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:47.514160 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 630/1280] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Feb 16 16:53:47 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 16:53:47.520702 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665f980-00ff-4f9d-ba26-dd6b7ca40a72 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:47.530408 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665f980-00ff-4f9d-ba26-dd6b7ca40a72 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:47.535315 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574df94-02ee-4572-8412-f95d82a439a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:47.536110 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574df94-02ee-4572-8412-f95d82a439a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:47.536394 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574df94-02ee-4572-8412-f95d82a439a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:47.536664 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574df94-02ee-4572-8412-f95d82a439a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:47.546666 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574df94-02ee-4572-8412-f95d82a439a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:47.548704 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574df94-02ee-4572-8412-f95d82a439a6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:47.565587 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-5574df94-02ee-4572-8412-f95d82a439a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 16:53:47.566733 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 651/1281] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Feb 16 16:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:47.572373 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f8b02-024d-4b19-ae13-099d69e75a54 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:47.582019 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f8b02-024d-4b19-ae13-099d69e75a54 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:47.586966 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c4c32-8970-44ae-9f96-f4863092b1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:47.587634 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c4c32-8970-44ae-9f96-f4863092b1da admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:47.587918 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c4c32-8970-44ae-9f96-f4863092b1da admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:47.588341 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c4c32-8970-44ae-9f96-f4863092b1da admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:47.588964 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c4c32-8970-44ae-9f96-f4863092b1da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:47.589270 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c4c32-8970-44ae-9f96-f4863092b1da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:47.590893 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c4c32-8970-44ae-9f96-f4863092b1da admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:47.602378 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 631/1282] 10.222.0.42 () {56 vars in 1130 bytes} [Wed Feb 16 16:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:47.607855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574df94-02ee-4572-8412-f95d82a439a6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:47.617910 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574df94-02ee-4572-8412-f95d82a439a6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:47.622423 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8ba1c-8657-43cd-ad39-453bf7b93d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:47.623164 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8ba1c-8657-43cd-ad39-453bf7b93d9c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:47.623442 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8ba1c-8657-43cd-ad39-453bf7b93d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:47.623750 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8ba1c-8657-43cd-ad39-453bf7b93d9c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:47.630973 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8ba1c-8657-43cd-ad39-453bf7b93d9c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:47.632938 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8ba1c-8657-43cd-ad39-453bf7b93d9c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:47.646105 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING keystone.server.flask.application [None req-e7a8ba1c-8657-43cd-ad39-453bf7b93d9c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 16:53:47.647233 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 652/1283] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Feb 16 16:53:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:47.652790 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c4c32-8970-44ae-9f96-f4863092b1da admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:47.662341 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c4c32-8970-44ae-9f96-f4863092b1da admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:47.666777 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee512f9-1252-4d19-89f4-bb740eef4cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:47.667400 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee512f9-1252-4d19-89f4-bb740eef4cca admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:47.667678 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee512f9-1252-4d19-89f4-bb740eef4cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:47.667952 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee512f9-1252-4d19-89f4-bb740eef4cca admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:47.668713 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee512f9-1252-4d19-89f4-bb740eef4cca admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:47.669014 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee512f9-1252-4d19-89f4-bb740eef4cca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:47.670887 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee512f9-1252-4d19-89f4-bb740eef4cca admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:47.682566 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 632/1284] 10.222.0.42 () {56 vars in 1169 bytes} [Wed Feb 16 16:53:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:47.688927 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8ba1c-8657-43cd-ad39-453bf7b93d9c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:47.699114 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8ba1c-8657-43cd-ad39-453bf7b93d9c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:47.704401 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe642c79-8feb-4d56-837f-0661e548c13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:47.705026 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe642c79-8feb-4d56-837f-0661e548c13f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:47.705305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe642c79-8feb-4d56-837f-0661e548c13f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:47.705577 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe642c79-8feb-4d56-837f-0661e548c13f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:47.706382 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe642c79-8feb-4d56-837f-0661e548c13f admin admin] RBAC: Adding query filter params (role.id=8263a29ceeed4576b3b6959c99964ed7, scope.project.id=6160f9606d06486b9a11a23ee717af79, user.id=ae711b94b32a431ab880aa8f6068ff25) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:47.706756 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe642c79-8feb-4d56-837f-0661e548c13f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:47.708590 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe642c79-8feb-4d56-837f-0661e548c13f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:47.714191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 653/1285] 10.222.0.42 () {56 vars in 1395 bytes} [Wed Feb 16 16:53:47 2022] GET /identity/v3/role_assignments?user.id=ae711b94b32a431ab880aa8f6068ff25&scope.project.id=6160f9606d06486b9a11a23ee717af79&role.id=8263a29ceeed4576b3b6959c99964ed7 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:50.040512 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b54c2-5030-4f86-b703-6aef18f89949 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:50.041032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b54c2-5030-4f86-b703-6aef18f89949 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:50.041032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b54c2-5030-4f86-b703-6aef18f89949 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:50.042830 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 633/1286] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:53:50.048517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b985c-f7d7-4feb-9586-39c508c6ace4 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:50.048905 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b985c-f7d7-4feb-9586-39c508c6ace4 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:50.049069 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b985c-f7d7-4feb-9586-39c508c6ace4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:50.067610 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-2e3b985c-f7d7-4feb-9586-39c508c6ace4 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:53:50.068839 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2e3b985c-f7d7-4feb-9586-39c508c6ace4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:53:50.076526 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 654/1287] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:53:50 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:53:50.099628 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b54c2-5030-4f86-b703-6aef18f89949 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:50.113533 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b54c2-5030-4f86-b703-6aef18f89949 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:50.117900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0c391-cbd8-43a6-873d-b4ced72050ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:50.118686 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0c391-cbd8-43a6-873d-b4ced72050ba admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:50.118969 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0c391-cbd8-43a6-873d-b4ced72050ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:50.119243 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0c391-cbd8-43a6-873d-b4ced72050ba admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:50.119928 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0c391-cbd8-43a6-873d-b4ced72050ba admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:50.121492 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0c391-cbd8-43a6-873d-b4ced72050ba admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:50.133382 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-c1e0c391-cbd8-43a6-873d-b4ced72050ba admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 16 16:53:50.134486 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 634/1288] 10.222.0.42 () {56 vars in 1138 bytes} [Wed Feb 16 16:53:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:50.140405 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b985c-f7d7-4feb-9586-39c508c6ace4 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:50.149809 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b985c-f7d7-4feb-9586-39c508c6ace4 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:50.154353 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a8c9e-5728-43ae-b135-1fc54d6ff34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:50.155021 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a8c9e-5728-43ae-b135-1fc54d6ff34f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:50.156078 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a8c9e-5728-43ae-b135-1fc54d6ff34f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:50.156078 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a8c9e-5728-43ae-b135-1fc54d6ff34f admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:50.156429 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a8c9e-5728-43ae-b135-1fc54d6ff34f admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:50.156554 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a8c9e-5728-43ae-b135-1fc54d6ff34f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:50.158089 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a8c9e-5728-43ae-b135-1fc54d6ff34f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:50.162787 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 655/1289] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Feb 16 16:53:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:50.168282 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0c391-cbd8-43a6-873d-b4ced72050ba admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:50.178344 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0c391-cbd8-43a6-873d-b4ced72050ba admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:50.182987 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4df20c-3aff-44c9-af16-23a917999142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:50.183610 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4df20c-3aff-44c9-af16-23a917999142 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:50.183887 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4df20c-3aff-44c9-af16-23a917999142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:50.184160 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4df20c-3aff-44c9-af16-23a917999142 admin admin] PATH_INFO: `/v3/services` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:50.184852 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4df20c-3aff-44c9-af16-23a917999142 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:50.185155 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4df20c-3aff-44c9-af16-23a917999142 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:50.186713 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4df20c-3aff-44c9-af16-23a917999142 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:50.192124 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 635/1290] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Feb 16 16:53:50 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:52.482992 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3f38e-2cc1-4337-bbc6-6e90177f44d3 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:52.483770 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3f38e-2cc1-4337-bbc6-6e90177f44d3 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:52.483770 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3f38e-2cc1-4337-bbc6-6e90177f44d3 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:52.486185 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 656/1291] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:53:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:53:52.491546 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af3000-6210-43e3-bc0a-2f13eccaf3ec None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:52.491978 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af3000-6210-43e3-bc0a-2f13eccaf3ec None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:52.492070 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af3000-6210-43e3-bc0a-2f13eccaf3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:52.509971 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-48af3000-6210-43e3-bc0a-2f13eccaf3ec None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:53:52.511242 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-48af3000-6210-43e3-bc0a-2f13eccaf3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:53:52.519041 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 636/1292] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:53:52 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 16:53:52.541632 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3f38e-2cc1-4337-bbc6-6e90177f44d3 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:52.554524 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3f38e-2cc1-4337-bbc6-6e90177f44d3 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:52.559086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68093bb-5f88-428a-a5fc-5b87d00ea5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:52.559767 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68093bb-5f88-428a-a5fc-5b87d00ea5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:52.560048 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68093bb-5f88-428a-a5fc-5b87d00ea5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:52.560321 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68093bb-5f88-428a-a5fc-5b87d00ea5a5 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:52.561034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68093bb-5f88-428a-a5fc-5b87d00ea5a5 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:52.562597 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68093bb-5f88-428a-a5fc-5b87d00ea5a5 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:52.710064 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 657/1293] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Feb 16 16:53:52 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 16:53:54.982956 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeddd7f-9f74-4e7f-8297-2e280975e7e0 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:54.983757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeddd7f-9f74-4e7f-8297-2e280975e7e0 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:54.983757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeddd7f-9f74-4e7f-8297-2e280975e7e0 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:54.986910 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 637/1294] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:53:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:53:54.992283 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74f90d-e4b1-4a42-9282-96242c9318ea None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:54.992674 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74f90d-e4b1-4a42-9282-96242c9318ea None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:54.992833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74f90d-e4b1-4a42-9282-96242c9318ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:55.010169 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-2c74f90d-e4b1-4a42-9282-96242c9318ea None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:53:55.011382 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2c74f90d-e4b1-4a42-9282-96242c9318ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:53:55.027698 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 658/1295] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:53:54 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:53:55.052057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeddd7f-9f74-4e7f-8297-2e280975e7e0 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:55.064971 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeddd7f-9f74-4e7f-8297-2e280975e7e0 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:55.069482 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f7504-a789-45c4-9729-5ac19dfb528e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:55.070255 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f7504-a789-45c4-9729-5ac19dfb528e admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:55.070535 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f7504-a789-45c4-9729-5ac19dfb528e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:55.070841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f7504-a789-45c4-9729-5ac19dfb528e admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:55.071485 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f7504-a789-45c4-9729-5ac19dfb528e admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:55.073054 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f7504-a789-45c4-9729-5ac19dfb528e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:55.084431 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-7c3f7504-a789-45c4-9729-5ac19dfb528e admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 16 16:53:55.085594 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 638/1296] 10.222.0.42 () {56 vars in 1138 bytes} [Wed Feb 16 16:53:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 16:53:55.091470 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74f90d-e4b1-4a42-9282-96242c9318ea None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:55.100814 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74f90d-e4b1-4a42-9282-96242c9318ea None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:55.105344 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e954457-c52d-47dd-aed6-6614923002e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:55.105976 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e954457-c52d-47dd-aed6-6614923002e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:55.106250 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e954457-c52d-47dd-aed6-6614923002e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:55.106518 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e954457-c52d-47dd-aed6-6614923002e7 admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:55.107238 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e954457-c52d-47dd-aed6-6614923002e7 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:55.107540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e954457-c52d-47dd-aed6-6614923002e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:55.109397 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e954457-c52d-47dd-aed6-6614923002e7 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:55.115589 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 659/1297] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Feb 16 16:53:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:55.120540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f7504-a789-45c4-9729-5ac19dfb528e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:55.130264 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f7504-a789-45c4-9729-5ac19dfb528e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:55.135037 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022d2a3-1423-46ab-a58e-e41142ea4fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:55.135652 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022d2a3-1423-46ab-a58e-e41142ea4fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:55.135931 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022d2a3-1423-46ab-a58e-e41142ea4fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:55.136202 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022d2a3-1423-46ab-a58e-e41142ea4fa9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:55.137014 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022d2a3-1423-46ab-a58e-e41142ea4fa9 admin admin] RBAC: Adding query filter params (interface=public, service_id=403a48b506574f608fd54d52e829186c, region_id=RegionOne) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:55.137320 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022d2a3-1423-46ab-a58e-e41142ea4fa9 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:55.138877 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022d2a3-1423-46ab-a58e-e41142ea4fa9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:55.144437 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 639/1298] 10.222.0.42 () {56 vars in 1272 bytes} [Wed Feb 16 16:53:55 2022] GET /identity/v3/endpoints?service_id=403a48b506574f608fd54d52e829186c&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:55.149669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e954457-c52d-47dd-aed6-6614923002e7 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:55.159629 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e954457-c52d-47dd-aed6-6614923002e7 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:55.164134 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26417dfd-b1cd-4a78-9b46-2816796ca41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:55.164776 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26417dfd-b1cd-4a78-9b46-2816796ca41f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:55.165055 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26417dfd-b1cd-4a78-9b46-2816796ca41f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:55.165330 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26417dfd-b1cd-4a78-9b46-2816796ca41f admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:55.166003 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26417dfd-b1cd-4a78-9b46-2816796ca41f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:55.167604 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26417dfd-b1cd-4a78-9b46-2816796ca41f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:55.175194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 660/1299] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Feb 16 16:53:55 2022] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 16:53:57.609257 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f09d1f-472e-432e-9701-df86f691e6e5 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:57.610303 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f09d1f-472e-432e-9701-df86f691e6e5 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:57.610303 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f09d1f-472e-432e-9701-df86f691e6e5 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:57.612099 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 640/1300] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 16:53:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 16:53:57.618588 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d1774-3889-40ec-934f-0be560f8c051 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:57.619093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d1774-3889-40ec-934f-0be560f8c051 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:57.619555 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d1774-3889-40ec-934f-0be560f8c051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:57.639352 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-e37d1774-3889-40ec-934f-0be560f8c051 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 16:53:57.640570 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e37d1774-3889-40ec-934f-0be560f8c051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 16:53:57.649439 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 661/1301] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 16:53:57 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 16:53:57.674248 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f09d1f-472e-432e-9701-df86f691e6e5 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:57.686895 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f09d1f-472e-432e-9701-df86f691e6e5 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:57.692917 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17a24b-78c4-432a-948a-d23fbb1a89c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:57.693697 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17a24b-78c4-432a-948a-d23fbb1a89c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:57.693979 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17a24b-78c4-432a-948a-d23fbb1a89c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:57.694252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17a24b-78c4-432a-948a-d23fbb1a89c1 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:57.694930 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17a24b-78c4-432a-948a-d23fbb1a89c1 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:57.696522 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17a24b-78c4-432a-948a-d23fbb1a89c1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:57.711718 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING keystone.server.flask.application [None req-8a17a24b-78c4-432a-948a-d23fbb1a89c1 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 16 16:53:57.713209 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 641/1302] 10.222.0.42 () {56 vars in 1138 bytes} [Wed Feb 16 16:53:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 16:53:57.719533 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d1774-3889-40ec-934f-0be560f8c051 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:57.728992 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d1774-3889-40ec-934f-0be560f8c051 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:57.734303 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805296f-1415-43fb-928a-b82b752ae7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:57.735500 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805296f-1415-43fb-928a-b82b752ae7be admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:57.735778 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805296f-1415-43fb-928a-b82b752ae7be admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:57.736049 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805296f-1415-43fb-928a-b82b752ae7be admin admin] PATH_INFO: `/v3/services` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:57.736747 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805296f-1415-43fb-928a-b82b752ae7be admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 16:53:57.737044 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805296f-1415-43fb-928a-b82b752ae7be admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:57.738621 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805296f-1415-43fb-928a-b82b752ae7be admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:57.744107 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 662/1303] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Feb 16 16:53:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 16:53:57.749822 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17a24b-78c4-432a-948a-d23fbb1a89c1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 16:53:57.760886 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17a24b-78c4-432a-948a-d23fbb1a89c1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 16:53:57.767098 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db608b-888c-4b03-9e07-bd4735ea550a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 16:53:57.767735 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db608b-888c-4b03-9e07-bd4735ea550a admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 16:53:57.768014 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db608b-888c-4b03-9e07-bd4735ea550a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 16:53:57.768291 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db608b-888c-4b03-9e07-bd4735ea550a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 16:53:57.769026 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db608b-888c-4b03-9e07-bd4735ea550a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 16:53:57.770578 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db608b-888c-4b03-9e07-bd4735ea550a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 16:53:57.967520 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 642/1304] 10.222.0.42 () {60 vars in 1165 bytes} [Wed Feb 16 16:53:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:01:02.040009 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e55a4-9f04-4ab1-b2b8-b147ecaee84f None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:02.041117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e55a4-9f04-4ab1-b2b8-b147ecaee84f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:02.041610 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e55a4-9f04-4ab1-b2b8-b147ecaee84f None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:02.049040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32720226-37da-4c4e-ab63-3b309ad1f3e0 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:02.049885 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32720226-37da-4c4e-ab63-3b309ad1f3e0 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:02.050374 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32720226-37da-4c4e-ab63-3b309ad1f3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:02.054016 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 663/1305] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:01:02 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:01:02.146282 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-32720226-37da-4c4e-ab63-3b309ad1f3e0 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:01:02.148234 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-32720226-37da-4c4e-ab63-3b309ad1f3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:02.302423 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 643/1306] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:01:02.325226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e55a4-9f04-4ab1-b2b8-b147ecaee84f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:01:02.327019 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-9d6e55a4-9f04-4ab1-b2b8-b147ecaee84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:02.486152 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e55a4-9f04-4ab1-b2b8-b147ecaee84f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:01:02.593833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2a960-f6e1-4a28-8697-68d6cea32836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:01:02.594585 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2a960-f6e1-4a28-8697-68d6cea32836 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:02.595087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2a960-f6e1-4a28-8697-68d6cea32836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:02.595358 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2a960-f6e1-4a28-8697-68d6cea32836 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:02.596078 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2a960-f6e1-4a28-8697-68d6cea32836 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:01:02.597919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2a960-f6e1-4a28-8697-68d6cea32836 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:01:02.616568 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 664/1307] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Feb 16 17:01:02 2022] GET /identity/v3/projects => generated 2553 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:01:05.133708 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d025f7-3324-44ff-b937-b0f444a9585b None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:05.134291 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d025f7-3324-44ff-b937-b0f444a9585b None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:05.134291 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d025f7-3324-44ff-b937-b0f444a9585b None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:05.136245 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 644/1308] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:01:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:01:05.141285 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2348c57-5f5e-4358-af1b-ee8dbdbccd35 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:05.141686 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2348c57-5f5e-4358-af1b-ee8dbdbccd35 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:05.141816 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2348c57-5f5e-4358-af1b-ee8dbdbccd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:05.216449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-d2348c57-5f5e-4358-af1b-ee8dbdbccd35 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:01:05.217667 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d2348c57-5f5e-4358-af1b-ee8dbdbccd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:05.319315 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 665/1309] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:01:05.370581 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0652ecb-4df9-479c-b6cc-b31976a09000 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:05.370904 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0652ecb-4df9-479c-b6cc-b31976a09000 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:05.371184 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0652ecb-4df9-479c-b6cc-b31976a09000 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:05.372960 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 645/1310] 10.222.0.42 () {54 vars in 964 bytes} [Wed Feb 16 17:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:01:05.379533 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9865a6d-6b97-4265-af11-bd5b70c85ba1 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:05.379840 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9865a6d-6b97-4265-af11-bd5b70c85ba1 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:05.380122 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9865a6d-6b97-4265-af11-bd5b70c85ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:05.479350 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-a9865a6d-6b97-4265-af11-bd5b70c85ba1 None None] MFA Rules not processed for user `f6db9534cc094e8281b0aa34e2cb4b46`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:01:05.481878 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a9865a6d-6b97-4265-af11-bd5b70c85ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:05.594912 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 666/1311] 10.222.0.42 () {58 vars in 1061 bytes} [Wed Feb 16 17:01:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:01:05.610478 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0652ecb-4df9-479c-b6cc-b31976a09000 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:01:05.612540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f0652ecb-4df9-479c-b6cc-b31976a09000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:05.731799 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0652ecb-4df9-479c-b6cc-b31976a09000 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:01:05.816398 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3017a-fa81-4ef3-80a9-607dd2a73966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:01:05.817057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3017a-fa81-4ef3-80a9-607dd2a73966 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:05.817337 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3017a-fa81-4ef3-80a9-607dd2a73966 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:05.817612 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3017a-fa81-4ef3-80a9-607dd2a73966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:05.819539 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-5dd3017a-fa81-4ef3-80a9-607dd2a73966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:05.936791 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3017a-fa81-4ef3-80a9-607dd2a73966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:01:05.938223 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3017a-fa81-4ef3-80a9-607dd2a73966 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:01:05.956918 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 646/1312] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:01:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:01:08.598741 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66fae6-52fd-4e01-8339-bb8b6acc55cd None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:08.599249 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66fae6-52fd-4e01-8339-bb8b6acc55cd None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:08.599370 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66fae6-52fd-4e01-8339-bb8b6acc55cd None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:08.601069 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 667/1313] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:01:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:01:08.606963 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd882a-1652-4b59-ae6b-edd46785087c None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:08.607396 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd882a-1652-4b59-ae6b-edd46785087c None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:08.607554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd882a-1652-4b59-ae6b-edd46785087c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:08.676419 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-2ddd882a-1652-4b59-ae6b-edd46785087c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:01:08.677625 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-2ddd882a-1652-4b59-ae6b-edd46785087c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:08.769640 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 647/1314] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:01:08.808954 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66fae6-52fd-4e01-8339-bb8b6acc55cd None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:01:08.810493 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-1a66fae6-52fd-4e01-8339-bb8b6acc55cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:08.910616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66fae6-52fd-4e01-8339-bb8b6acc55cd None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:01:08.983442 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554fda8-7d0c-4584-93c8-ffeff2b1d03e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:01:08.984104 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554fda8-7d0c-4584-93c8-ffeff2b1d03e service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:08.984429 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554fda8-7d0c-4584-93c8-ffeff2b1d03e service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:08.984740 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554fda8-7d0c-4584-93c8-ffeff2b1d03e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:08.986381 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8554fda8-7d0c-4584-93c8-ffeff2b1d03e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:09.092363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554fda8-7d0c-4584-93c8-ffeff2b1d03e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:01:09.093714 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554fda8-7d0c-4584-93c8-ffeff2b1d03e service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:01:09.111466 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 668/1315] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:01:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:01:12.065463 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed57d1-63d4-42a4-b610-d04d9c088569 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:12.065992 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed57d1-63d4-42a4-b610-d04d9c088569 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:12.065992 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed57d1-63d4-42a4-b610-d04d9c088569 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:12.067803 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 648/1316] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:01:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:01:12.073956 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27c5d1-2174-4ca8-bd34-1d51105663fa None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:12.074366 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27c5d1-2174-4ca8-bd34-1d51105663fa None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:12.074517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27c5d1-2174-4ca8-bd34-1d51105663fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:12.139931 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-2c27c5d1-2174-4ca8-bd34-1d51105663fa None None] MFA Rules not processed for user `8a2a549f61b94b47956e72c5b6640148`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:01:12.141108 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2c27c5d1-2174-4ca8-bd34-1d51105663fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:12.232162 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 669/1317] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:01:12 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:01:12.273585 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed57d1-63d4-42a4-b610-d04d9c088569 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:01:12.275140 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6bed57d1-63d4-42a4-b610-d04d9c088569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:12.375694 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed57d1-63d4-42a4-b610-d04d9c088569 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:01:12.447697 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165060f3-1d99-436b-acb0-dc7619deee7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:01:12.448325 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165060f3-1d99-436b-acb0-dc7619deee7b service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:12.448605 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165060f3-1d99-436b-acb0-dc7619deee7b service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:12.449122 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165060f3-1d99-436b-acb0-dc7619deee7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:12.450749 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-165060f3-1d99-436b-acb0-dc7619deee7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:12.557121 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165060f3-1d99-436b-acb0-dc7619deee7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:01:12.558542 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165060f3-1d99-436b-acb0-dc7619deee7b service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:01:12.577301 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 649/1318] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:01:12 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:01:15.704954 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bae54-2031-44e9-81f7-01d950bfe9c7 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:15.705470 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bae54-2031-44e9-81f7-01d950bfe9c7 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:15.705561 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bae54-2031-44e9-81f7-01d950bfe9c7 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:15.707386 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 670/1319] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 17:01:15.713357 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b97337-79d2-4bcf-b0df-e9034abcee43 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:15.713777 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b97337-79d2-4bcf-b0df-e9034abcee43 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:15.713904 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b97337-79d2-4bcf-b0df-e9034abcee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:15.779648 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-84b97337-79d2-4bcf-b0df-e9034abcee43 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:01:15.780761 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-84b97337-79d2-4bcf-b0df-e9034abcee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:15.872625 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 650/1320] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:01:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:01:15.928742 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc7f26-f8a4-421a-a407-d4d3ec81aa29 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:15.929028 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc7f26-f8a4-421a-a407-d4d3ec81aa29 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:15.929305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc7f26-f8a4-421a-a407-d4d3ec81aa29 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:15.931131 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 671/1321] 10.222.0.42 () {54 vars in 964 bytes} [Wed Feb 16 17:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:01:15.937208 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de13526-b04b-49b6-9435-58dbaf9f05eb None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:15.937497 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de13526-b04b-49b6-9435-58dbaf9f05eb None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:15.937775 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de13526-b04b-49b6-9435-58dbaf9f05eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:16.011868 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-2de13526-b04b-49b6-9435-58dbaf9f05eb None None] MFA Rules not processed for user `f6db9534cc094e8281b0aa34e2cb4b46`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:01:16.013094 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-2de13526-b04b-49b6-9435-58dbaf9f05eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:16.084870 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 651/1322] 10.222.0.42 () {58 vars in 1061 bytes} [Wed Feb 16 17:01:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:01:16.094861 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc7f26-f8a4-421a-a407-d4d3ec81aa29 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:01:16.096388 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2ddc7f26-f8a4-421a-a407-d4d3ec81aa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:16.199011 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc7f26-f8a4-421a-a407-d4d3ec81aa29 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:01:16.269566 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6bee3-b7f6-4b58-8c81-ebe79cea0f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:01:16.270203 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6bee3-b7f6-4b58-8c81-ebe79cea0f4a service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:16.270482 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6bee3-b7f6-4b58-8c81-ebe79cea0f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:16.270781 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6bee3-b7f6-4b58-8c81-ebe79cea0f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:16.272410 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a6f6bee3-b7f6-4b58-8c81-ebe79cea0f4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:16.379841 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6bee3-b7f6-4b58-8c81-ebe79cea0f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:01:16.381171 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6bee3-b7f6-4b58-8c81-ebe79cea0f4a service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:01:16.399241 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 672/1323] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:01:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:01:20.244295 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a0b64-3d32-4220-8a07-7f3b4c93a094 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:20.244815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a0b64-3d32-4220-8a07-7f3b4c93a094 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:20.244905 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a0b64-3d32-4220-8a07-7f3b4c93a094 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:20.246668 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 652/1324] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:01:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:01:20.251988 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf0159-2638-44e8-a862-f040322bbeaf None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:20.252416 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf0159-2638-44e8-a862-f040322bbeaf None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:20.252545 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf0159-2638-44e8-a862-f040322bbeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:20.316353 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-8eaf0159-2638-44e8-a862-f040322bbeaf None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:01:20.317554 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8eaf0159-2638-44e8-a862-f040322bbeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:20.411255 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 673/1325] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:01:20.447656 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a0b64-3d32-4220-8a07-7f3b4c93a094 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:01:20.450697 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-072a0b64-3d32-4220-8a07-7f3b4c93a094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:20.550035 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a0b64-3d32-4220-8a07-7f3b4c93a094 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:01:20.622465 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6370b-2df4-4c37-b8b3-0455f644ecff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:01:20.623157 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6370b-2df4-4c37-b8b3-0455f644ecff service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:20.623438 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6370b-2df4-4c37-b8b3-0455f644ecff service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:20.623717 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6370b-2df4-4c37-b8b3-0455f644ecff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:20.625339 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-2bc6370b-2df4-4c37-b8b3-0455f644ecff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:20.734721 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6370b-2df4-4c37-b8b3-0455f644ecff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:01:20.736057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6370b-2df4-4c37-b8b3-0455f644ecff service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:01:20.753869 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 653/1326] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:01:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:01:23.182189 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bdcc1-0177-4097-a29c-80e79a652be7 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:23.182841 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bdcc1-0177-4097-a29c-80e79a652be7 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:23.182841 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bdcc1-0177-4097-a29c-80e79a652be7 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:23.184524 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 674/1327] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:01:23.189853 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb9d54-5016-4652-abf0-73bacb606456 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:23.190297 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb9d54-5016-4652-abf0-73bacb606456 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:23.190478 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb9d54-5016-4652-abf0-73bacb606456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:23.255221 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-e6fb9d54-5016-4652-abf0-73bacb606456 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:01:23.256439 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e6fb9d54-5016-4652-abf0-73bacb606456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:23.352464 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 654/1328] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:01:23.389851 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bdcc1-0177-4097-a29c-80e79a652be7 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:01:23.395217 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e69bdcc1-0177-4097-a29c-80e79a652be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:23.495590 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bdcc1-0177-4097-a29c-80e79a652be7 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:01:23.568784 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e56e6e-0dd9-4d5b-892a-1c131e75f4c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:01:23.569464 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e56e6e-0dd9-4d5b-892a-1c131e75f4c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:23.569749 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e56e6e-0dd9-4d5b-892a-1c131e75f4c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:23.570021 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e56e6e-0dd9-4d5b-892a-1c131e75f4c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:23.571753 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-c5e56e6e-0dd9-4d5b-892a-1c131e75f4c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:23.677324 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e56e6e-0dd9-4d5b-892a-1c131e75f4c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:01:23.678840 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e56e6e-0dd9-4d5b-892a-1c131e75f4c9 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:01:23.696372 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 675/1329] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:01:26.048315 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b6f81-a70a-41b5-83f5-9d6f58ed22ef None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:26.048874 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b6f81-a70a-41b5-83f5-9d6f58ed22ef None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:26.048874 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b6f81-a70a-41b5-83f5-9d6f58ed22ef None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:26.050718 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 655/1330] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:01:26.056708 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010decf-289f-44d2-a956-74fa1bef4d7e None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:26.057159 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010decf-289f-44d2-a956-74fa1bef4d7e None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:26.057406 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010decf-289f-44d2-a956-74fa1bef4d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:26.124026 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-e010decf-289f-44d2-a956-74fa1bef4d7e None None] MFA Rules not processed for user `8a2a549f61b94b47956e72c5b6640148`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:01:26.125153 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e010decf-289f-44d2-a956-74fa1bef4d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:26.219007 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 676/1331] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:01:26 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:01:26.256554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b6f81-a70a-41b5-83f5-9d6f58ed22ef None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:01:26.258616 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-767b6f81-a70a-41b5-83f5-9d6f58ed22ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:26.363540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b6f81-a70a-41b5-83f5-9d6f58ed22ef None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:01:26.441661 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f66b5-f60b-45ef-83e1-05c035b35f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:01:26.442304 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f66b5-f60b-45ef-83e1-05c035b35f18 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:26.442584 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f66b5-f60b-45ef-83e1-05c035b35f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:26.442885 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f66b5-f60b-45ef-83e1-05c035b35f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:26.445168 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-af2f66b5-f60b-45ef-83e1-05c035b35f18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:26.554795 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f66b5-f60b-45ef-83e1-05c035b35f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:01:26.556220 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f66b5-f60b-45ef-83e1-05c035b35f18 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:01:26.574813 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 656/1332] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:01:26 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:01:29.420726 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9205a-92a3-4c18-812a-4129b6112f4b None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:29.421268 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9205a-92a3-4c18-812a-4129b6112f4b None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:29.421268 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9205a-92a3-4c18-812a-4129b6112f4b None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:29.423084 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 677/1333] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:01:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:01:29.428346 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c056c-44be-468f-a731-52e15c266e21 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:29.429496 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c056c-44be-468f-a731-52e15c266e21 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:29.429784 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c056c-44be-468f-a731-52e15c266e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:29.496340 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-831c056c-44be-468f-a731-52e15c266e21 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:01:29.497522 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-831c056c-44be-468f-a731-52e15c266e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:29.591432 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 657/1334] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:01:29.628529 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9205a-92a3-4c18-812a-4129b6112f4b None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:01:29.630048 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-65b9205a-92a3-4c18-812a-4129b6112f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:29.734434 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9205a-92a3-4c18-812a-4129b6112f4b None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:01:29.810593 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b07f1-7ce6-4d24-8c44-4b86be9f019d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:01:29.811267 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b07f1-7ce6-4d24-8c44-4b86be9f019d service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:29.811545 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b07f1-7ce6-4d24-8c44-4b86be9f019d service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:29.811816 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b07f1-7ce6-4d24-8c44-4b86be9f019d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:29.813442 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f08b07f1-7ce6-4d24-8c44-4b86be9f019d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:29.926736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b07f1-7ce6-4d24-8c44-4b86be9f019d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:01:29.927945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b07f1-7ce6-4d24-8c44-4b86be9f019d service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:01:29.946232 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 678/1335] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:01:32.320790 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebe53f-c14a-4222-a7f8-ca821cd0ba69 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:32.321318 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebe53f-c14a-4222-a7f8-ca821cd0ba69 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:32.321318 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebe53f-c14a-4222-a7f8-ca821cd0ba69 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:32.323116 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 658/1336] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:01:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:01:32.328357 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020e550-b96a-4509-88f4-436fdd929761 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:32.328805 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020e550-b96a-4509-88f4-436fdd929761 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:32.328900 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020e550-b96a-4509-88f4-436fdd929761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:32.401848 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-0020e550-b96a-4509-88f4-436fdd929761 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:01:32.403081 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0020e550-b96a-4509-88f4-436fdd929761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:32.506131 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 679/1337] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:01:32.547343 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebe53f-c14a-4222-a7f8-ca821cd0ba69 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:01:32.549465 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e7ebe53f-c14a-4222-a7f8-ca821cd0ba69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:32.644797 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebe53f-c14a-4222-a7f8-ca821cd0ba69 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:01:32.649207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5def33-5899-468a-b594-c93b9ae7ec85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:01:32.649845 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5def33-5899-468a-b594-c93b9ae7ec85 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:32.650129 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5def33-5899-468a-b594-c93b9ae7ec85 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:32.650406 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5def33-5899-468a-b594-c93b9ae7ec85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:32.659237 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5def33-5899-468a-b594-c93b9ae7ec85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:01:32.660654 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5def33-5899-468a-b594-c93b9ae7ec85 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:01:32.670729 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 659/1338] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:01:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:01:35.675646 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233dbfe-5ffc-499c-a2b9-d7a193487079 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:35.676194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233dbfe-5ffc-499c-a2b9-d7a193487079 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:35.676194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233dbfe-5ffc-499c-a2b9-d7a193487079 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:35.677992 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 680/1339] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:01:35.683862 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f9fb9-49d0-460f-8430-60ec5250f7f2 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:35.684301 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f9fb9-49d0-460f-8430-60ec5250f7f2 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:35.684418 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f9fb9-49d0-460f-8430-60ec5250f7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:35.712341 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-834f9fb9-49d0-460f-8430-60ec5250f7f2 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:01:35.713523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-834f9fb9-49d0-460f-8430-60ec5250f7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:35.787976 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 660/1340] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:01:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:01:35.825186 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233dbfe-5ffc-499c-a2b9-d7a193487079 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:01:35.836117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233dbfe-5ffc-499c-a2b9-d7a193487079 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:01:35.839622 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85a306-d922-402e-a3b5-e547c6f8687a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:01:35.840244 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85a306-d922-402e-a3b5-e547c6f8687a service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:35.840521 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85a306-d922-402e-a3b5-e547c6f8687a service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:35.840791 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85a306-d922-402e-a3b5-e547c6f8687a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:35.849475 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85a306-d922-402e-a3b5-e547c6f8687a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:01:35.851262 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85a306-d922-402e-a3b5-e547c6f8687a service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:01:35.860345 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 681/1341] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:01:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:01:40.778369 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ef938-18bf-49b9-9de6-97bb93d947e2 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:40.778900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ef938-18bf-49b9-9de6-97bb93d947e2 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:40.778990 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ef938-18bf-49b9-9de6-97bb93d947e2 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:40.780771 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 661/1342] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:01:40.786225 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5d9bc-7643-4b77-8ff8-93fd25dcb04f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:40.786685 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5d9bc-7643-4b77-8ff8-93fd25dcb04f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:40.786810 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5d9bc-7643-4b77-8ff8-93fd25dcb04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:40.806963 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-25e5d9bc-7643-4b77-8ff8-93fd25dcb04f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:01:40.808162 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-25e5d9bc-7643-4b77-8ff8-93fd25dcb04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:40.815869 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 682/1343] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:01:40.855300 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ef938-18bf-49b9-9de6-97bb93d947e2 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:01:40.866739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ef938-18bf-49b9-9de6-97bb93d947e2 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:01:40.870517 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680b928-33ad-47a7-abac-dfb4040f440d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:01:40.871185 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680b928-33ad-47a7-abac-dfb4040f440d service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:40.871458 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680b928-33ad-47a7-abac-dfb4040f440d service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:40.871728 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680b928-33ad-47a7-abac-dfb4040f440d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:40.882723 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680b928-33ad-47a7-abac-dfb4040f440d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:01:40.884152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680b928-33ad-47a7-abac-dfb4040f440d service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:01:40.894489 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 662/1344] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:01:44.262012 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fa1f8-ded2-4e4d-8c08-b2d59b557403 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:44.262557 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fa1f8-ded2-4e4d-8c08-b2d59b557403 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:44.262557 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fa1f8-ded2-4e4d-8c08-b2d59b557403 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:44.264377 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 683/1345] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:01:44.269874 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26a7b3-0fc6-4c70-961d-542f33429f82 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:44.270288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26a7b3-0fc6-4c70-961d-542f33429f82 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:44.270427 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26a7b3-0fc6-4c70-961d-542f33429f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:44.289205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-ae26a7b3-0fc6-4c70-961d-542f33429f82 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:01:44.290391 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-ae26a7b3-0fc6-4c70-961d-542f33429f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:44.298393 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 663/1346] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:01:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:01:44.337489 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fa1f8-ded2-4e4d-8c08-b2d59b557403 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:01:44.348305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fa1f8-ded2-4e4d-8c08-b2d59b557403 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:01:44.352481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304bb34-5e89-43b9-9b02-589d36341cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:01:44.353118 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304bb34-5e89-43b9-9b02-589d36341cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:44.353400 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304bb34-5e89-43b9-9b02-589d36341cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:44.353671 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304bb34-5e89-43b9-9b02-589d36341cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:44.363131 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304bb34-5e89-43b9-9b02-589d36341cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:01:44.364551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304bb34-5e89-43b9-9b02-589d36341cf8 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:01:44.374421 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 684/1347] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:01:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:01:49.250820 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10092ffc-8747-4102-986a-40a884cbe213 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:49.251378 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10092ffc-8747-4102-986a-40a884cbe213 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:49.251378 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10092ffc-8747-4102-986a-40a884cbe213 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:49.253175 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 664/1348] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:01:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:01:49.259093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6ab1a-daa3-42ff-aec8-3160e02e75de None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:49.259642 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6ab1a-daa3-42ff-aec8-3160e02e75de None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:49.259735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6ab1a-daa3-42ff-aec8-3160e02e75de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:49.277954 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-adc6ab1a-daa3-42ff-aec8-3160e02e75de None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:01:49.279172 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-adc6ab1a-daa3-42ff-aec8-3160e02e75de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:49.286931 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 685/1349] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:01:49.324288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10092ffc-8747-4102-986a-40a884cbe213 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:01:49.336213 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10092ffc-8747-4102-986a-40a884cbe213 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:01:49.339823 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04913a-36f8-4319-a6d5-6e69b68157b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:01:49.340472 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04913a-36f8-4319-a6d5-6e69b68157b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:49.340750 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04913a-36f8-4319-a6d5-6e69b68157b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:49.341025 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04913a-36f8-4319-a6d5-6e69b68157b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:49.351391 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04913a-36f8-4319-a6d5-6e69b68157b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:01:49.352844 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04913a-36f8-4319-a6d5-6e69b68157b8 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:01:49.362906 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 665/1350] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:01:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:01:54.658739 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb060f42-1cd4-4ad8-9232-139d0775f869 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:54.659728 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb060f42-1cd4-4ad8-9232-139d0775f869 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:54.660164 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb060f42-1cd4-4ad8-9232-139d0775f869 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:54.670822 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 686/1351] 10.222.0.42 () {54 vars in 921 bytes} [Wed Feb 16 17:01:54 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:01:54.676433 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecab220-df36-41b5-808d-91f53540cfa9 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:54.676955 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecab220-df36-41b5-808d-91f53540cfa9 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:54.676955 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecab220-df36-41b5-808d-91f53540cfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:54.771307 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-aecab220-df36-41b5-808d-91f53540cfa9 None None] MFA Rules not processed for user `ae711b94b32a431ab880aa8f6068ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:01:54.772787 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-aecab220-df36-41b5-808d-91f53540cfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:54.852985 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 666/1352] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Feb 16 17:01:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:01:59.311001 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce088e-1a95-472f-b67f-f75b780025c9 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:59.311541 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce088e-1a95-472f-b67f-f75b780025c9 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:59.311541 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce088e-1a95-472f-b67f-f75b780025c9 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:59.313313 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 687/1353] 10.222.0.42 () {54 vars in 921 bytes} [Wed Feb 16 17:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:01:59.319697 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fdfe8-8bfc-46a0-99e5-8bee22721b08 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:01:59.320565 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fdfe8-8bfc-46a0-99e5-8bee22721b08 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:01:59.320906 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fdfe8-8bfc-46a0-99e5-8bee22721b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:01:59.340828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-919fdfe8-8bfc-46a0-99e5-8bee22721b08 None None] MFA Rules not processed for user `ae711b94b32a431ab880aa8f6068ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:01:59.342025 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-919fdfe8-8bfc-46a0-99e5-8bee22721b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:01:59.355415 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 667/1354] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Feb 16 17:01:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:00.787515 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00859d9a-23b9-41b8-a71a-6d37e0a5d39c None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:00.788023 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00859d9a-23b9-41b8-a71a-6d37e0a5d39c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:00.788111 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00859d9a-23b9-41b8-a71a-6d37e0a5d39c None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:00.790037 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 688/1355] 10.222.0.42 () {54 vars in 921 bytes} [Wed Feb 16 17:02:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:00.796607 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da3544-b5db-4d3e-b09b-9f1699e3a20a None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:00.797189 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da3544-b5db-4d3e-b09b-9f1699e3a20a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:00.797189 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da3544-b5db-4d3e-b09b-9f1699e3a20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:00.825211 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-21da3544-b5db-4d3e-b09b-9f1699e3a20a None None] MFA Rules not processed for user `ae711b94b32a431ab880aa8f6068ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:00.826405 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-21da3544-b5db-4d3e-b09b-9f1699e3a20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:00.835926 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 668/1356] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Feb 16 17:02:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:04.863255 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb4256-ca25-438b-8a97-6b7cbc2367d5 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:04.863769 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb4256-ca25-438b-8a97-6b7cbc2367d5 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:04.863974 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb4256-ca25-438b-8a97-6b7cbc2367d5 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:04.870436 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 689/1357] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:02:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:04.872051 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696319ca-3a57-41a1-874c-f151d9ce5559 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:04.873468 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696319ca-3a57-41a1-874c-f151d9ce5559 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:04.873958 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696319ca-3a57-41a1-874c-f151d9ce5559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:04.892333 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-696319ca-3a57-41a1-874c-f151d9ce5559 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:04.901333 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-696319ca-3a57-41a1-874c-f151d9ce5559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:04.901895 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 669/1358] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:02:04.949349 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e16e9-2231-48b4-a17d-96139a7c7766 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:04.949770 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e16e9-2231-48b4-a17d-96139a7c7766 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:04.950147 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e16e9-2231-48b4-a17d-96139a7c7766 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:04.952403 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 690/1359] 10.222.0.42 () {54 vars in 961 bytes} [Wed Feb 16 17:02:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:04.958155 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60d5c6-4fcb-4d8d-b7a9-adb282212316 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:04.959398 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60d5c6-4fcb-4d8d-b7a9-adb282212316 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:04.959731 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60d5c6-4fcb-4d8d-b7a9-adb282212316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:05.010857 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-6b60d5c6-4fcb-4d8d-b7a9-adb282212316 None None] MFA Rules not processed for user `9a30603a236e4681a7702eec7029e9db`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:05.012055 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6b60d5c6-4fcb-4d8d-b7a9-adb282212316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:05.110017 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 670/1360] 10.222.0.42 () {58 vars in 1058 bytes} [Wed Feb 16 17:02:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:05.120725 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e16e9-2231-48b4-a17d-96139a7c7766 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:02:05.137307 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e16e9-2231-48b4-a17d-96139a7c7766 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:02:05.146324 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a9de7-7623-4bea-9b33-2c7b42a07ece service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:02:05.147318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a9de7-7623-4bea-9b33-2c7b42a07ece service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:05.147844 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a9de7-7623-4bea-9b33-2c7b42a07ece service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:05.148342 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a9de7-7623-4bea-9b33-2c7b42a07ece service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:05.157574 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a9de7-7623-4bea-9b33-2c7b42a07ece service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:02:05.159546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a9de7-7623-4bea-9b33-2c7b42a07ece service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:02:05.171085 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 691/1361] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:02:07.739418 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1d2e1-14f3-4317-823b-183372bed2d4 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:07.740493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1d2e1-14f3-4317-823b-183372bed2d4 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:07.740712 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1d2e1-14f3-4317-823b-183372bed2d4 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:07.742588 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 671/1362] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:02:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:07.747770 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaadf2-5d61-4163-828e-e4d770df9115 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:07.748168 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaadf2-5d61-4163-828e-e4d770df9115 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:07.748326 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaadf2-5d61-4163-828e-e4d770df9115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:07.766723 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-67aaadf2-5d61-4163-828e-e4d770df9115 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:07.767895 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-67aaadf2-5d61-4163-828e-e4d770df9115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:07.776575 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 692/1363] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:07.822030 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1d2e1-14f3-4317-823b-183372bed2d4 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:02:07.837025 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1d2e1-14f3-4317-823b-183372bed2d4 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:02:07.842530 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5b3b4-9597-40a8-a590-2bf5f565a702 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:02:07.843285 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5b3b4-9597-40a8-a590-2bf5f565a702 service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:07.843731 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5b3b4-9597-40a8-a590-2bf5f565a702 service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:07.844077 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5b3b4-9597-40a8-a590-2bf5f565a702 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:07.853049 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5b3b4-9597-40a8-a590-2bf5f565a702 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:02:07.855020 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5b3b4-9597-40a8-a590-2bf5f565a702 service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:02:07.866822 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 672/1364] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:02:10.707653 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ae0db-64ae-47ec-8b71-9cf0f8345262 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:10.708298 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ae0db-64ae-47ec-8b71-9cf0f8345262 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:10.708945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ae0db-64ae-47ec-8b71-9cf0f8345262 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:10.710746 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 693/1365] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:10.715932 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0012b7b-d6aa-443b-a0fe-3c0e5fd05454 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:10.716374 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0012b7b-d6aa-443b-a0fe-3c0e5fd05454 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:10.716467 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0012b7b-d6aa-443b-a0fe-3c0e5fd05454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:10.736759 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-f0012b7b-d6aa-443b-a0fe-3c0e5fd05454 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:10.738219 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f0012b7b-d6aa-443b-a0fe-3c0e5fd05454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:10.748217 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 673/1366] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:10.794869 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64555b-6fbe-40b8-8b61-1e497eb3d74a None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:10.795536 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64555b-6fbe-40b8-8b61-1e497eb3d74a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:10.795818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64555b-6fbe-40b8-8b61-1e497eb3d74a None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:10.797575 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 694/1367] 10.222.0.42 () {54 vars in 961 bytes} [Wed Feb 16 17:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:10.803651 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfb15f-e60b-406a-80f7-64df2fe1b828 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:10.804142 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfb15f-e60b-406a-80f7-64df2fe1b828 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:10.804580 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfb15f-e60b-406a-80f7-64df2fe1b828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:10.824903 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-fbcfb15f-e60b-406a-80f7-64df2fe1b828 None None] MFA Rules not processed for user `9a30603a236e4681a7702eec7029e9db`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:10.826075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-fbcfb15f-e60b-406a-80f7-64df2fe1b828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:10.837233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 674/1368] 10.222.0.42 () {58 vars in 1058 bytes} [Wed Feb 16 17:02:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:10.846310 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64555b-6fbe-40b8-8b61-1e497eb3d74a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:02:10.867522 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64555b-6fbe-40b8-8b61-1e497eb3d74a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:02:10.875092 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0aa14-0271-4abd-94cb-77e1187fd921 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:02:10.875799 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0aa14-0271-4abd-94cb-77e1187fd921 service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:10.876078 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0aa14-0271-4abd-94cb-77e1187fd921 service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:10.876553 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0aa14-0271-4abd-94cb-77e1187fd921 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:10.889931 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0aa14-0271-4abd-94cb-77e1187fd921 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:02:10.891708 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0aa14-0271-4abd-94cb-77e1187fd921 service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:02:10.903213 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 695/1369] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:02:13.167788 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d67a9-8818-4be1-9172-e812ed2da147 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:13.168314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d67a9-8818-4be1-9172-e812ed2da147 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:13.168314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d67a9-8818-4be1-9172-e812ed2da147 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:13.170104 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 675/1370] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:13.175503 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e547a36-d65d-453b-9615-7853a35e5b6c None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:13.175954 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e547a36-d65d-453b-9615-7853a35e5b6c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:13.176043 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e547a36-d65d-453b-9615-7853a35e5b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:13.195157 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-8e547a36-d65d-453b-9615-7853a35e5b6c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:13.196340 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8e547a36-d65d-453b-9615-7853a35e5b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:13.204441 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 696/1371] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:13.470577 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da8fd2-1f0e-4100-bb87-9b9ccc3ca1d6 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:13.471043 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da8fd2-1f0e-4100-bb87-9b9ccc3ca1d6 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:13.471289 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da8fd2-1f0e-4100-bb87-9b9ccc3ca1d6 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:13.473189 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 676/1372] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:02:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:13.476465 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c5162-8605-4297-b832-83d72f2b4c68 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:13.476755 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c5162-8605-4297-b832-83d72f2b4c68 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:13.477218 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c5162-8605-4297-b832-83d72f2b4c68 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:13.478285 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338f118-829e-4bd4-b790-d66933796d9f None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:13.478572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338f118-829e-4bd4-b790-d66933796d9f None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:13.478894 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338f118-829e-4bd4-b790-d66933796d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:13.479054 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 697/1373] 10.222.0.42 () {54 vars in 963 bytes} [Wed Feb 16 17:02:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:13.483855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71fa8e-21df-412b-a98c-46e2eb26a66b None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:13.484286 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71fa8e-21df-412b-a98c-46e2eb26a66b None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:13.484709 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71fa8e-21df-412b-a98c-46e2eb26a66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:13.497776 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-2338f118-829e-4bd4-b790-d66933796d9f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:13.498564 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-2338f118-829e-4bd4-b790-d66933796d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:13.507335 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 677/1374] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:13.543859 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-1c71fa8e-21df-412b-a98c-46e2eb26a66b None None] MFA Rules not processed for user `07ca3e2a770f463a95dfb045ffd51dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:13.545244 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-1c71fa8e-21df-412b-a98c-46e2eb26a66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:13.553337 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338f118-829e-4bd4-b790-d66933796d9f None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:02:13.566402 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338f118-829e-4bd4-b790-d66933796d9f None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:02:13.573363 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc22b17-97f2-48f6-b1d5-583342933980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:02:13.574044 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc22b17-97f2-48f6-b1d5-583342933980 service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:13.577620 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc22b17-97f2-48f6-b1d5-583342933980 service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:13.577904 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc22b17-97f2-48f6-b1d5-583342933980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:13.592383 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc22b17-97f2-48f6-b1d5-583342933980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:02:13.594200 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc22b17-97f2-48f6-b1d5-583342933980 service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:02:13.604776 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 678/1375] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:02:13.609996 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 698/1376] 10.222.0.42 () {58 vars in 1060 bytes} [Wed Feb 16 17:02:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:13.618746 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc22b17-97f2-48f6-b1d5-583342933980 service nova] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:02:13.627849 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc22b17-97f2-48f6-b1d5-583342933980 service nova] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:02:13.632391 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508b54d-965f-4eb7-b323-cf252e9c9f49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:02:13.633016 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508b54d-965f-4eb7-b323-cf252e9c9f49 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:13.633290 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508b54d-965f-4eb7-b323-cf252e9c9f49 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:13.633562 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508b54d-965f-4eb7-b323-cf252e9c9f49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:13.642612 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508b54d-965f-4eb7-b323-cf252e9c9f49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:02:13.644074 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508b54d-965f-4eb7-b323-cf252e9c9f49 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:02:13.654400 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 679/1377] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:02:16.113990 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d73fdb-7d90-4274-9d54-33f453c2587e None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:16.114590 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d73fdb-7d90-4274-9d54-33f453c2587e None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:16.114766 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d73fdb-7d90-4274-9d54-33f453c2587e None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:16.116551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 699/1378] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:16.121736 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8a45e-3b16-446b-bc0a-61f5f78f5242 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:16.122169 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8a45e-3b16-446b-bc0a-61f5f78f5242 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:16.122327 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8a45e-3b16-446b-bc0a-61f5f78f5242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:16.140252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-4ab8a45e-3b16-446b-bc0a-61f5f78f5242 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:16.141415 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-4ab8a45e-3b16-446b-bc0a-61f5f78f5242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:16.149899 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 680/1379] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:16.193576 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d73fdb-7d90-4274-9d54-33f453c2587e None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:02:16.209212 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d73fdb-7d90-4274-9d54-33f453c2587e None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:02:16.215074 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b2493-39b1-49df-a2e9-6c168e444684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:02:16.215714 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b2493-39b1-49df-a2e9-6c168e444684 service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:16.215994 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b2493-39b1-49df-a2e9-6c168e444684 service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:16.216385 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b2493-39b1-49df-a2e9-6c168e444684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:16.225630 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b2493-39b1-49df-a2e9-6c168e444684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:02:16.227340 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b2493-39b1-49df-a2e9-6c168e444684 service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:02:16.237063 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 700/1380] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:02:18.754526 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506eb19-5cf1-43ea-b1d7-4db0de3a71d3 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:18.755671 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506eb19-5cf1-43ea-b1d7-4db0de3a71d3 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:18.755912 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506eb19-5cf1-43ea-b1d7-4db0de3a71d3 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:18.757871 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 681/1381] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:18.763649 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cbc52-9560-41df-93c2-72266123c094 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:18.764088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cbc52-9560-41df-93c2-72266123c094 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:18.764229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cbc52-9560-41df-93c2-72266123c094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:18.784350 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-356cbc52-9560-41df-93c2-72266123c094 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:18.785452 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-356cbc52-9560-41df-93c2-72266123c094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:18.794743 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 701/1382] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:18.841877 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506eb19-5cf1-43ea-b1d7-4db0de3a71d3 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:02:18.857185 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506eb19-5cf1-43ea-b1d7-4db0de3a71d3 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:02:18.863069 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53c881-8f8f-49d9-b7a3-3124da05bb09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:02:18.863824 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53c881-8f8f-49d9-b7a3-3124da05bb09 service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:18.864361 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53c881-8f8f-49d9-b7a3-3124da05bb09 service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:18.864761 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53c881-8f8f-49d9-b7a3-3124da05bb09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:18.873461 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53c881-8f8f-49d9-b7a3-3124da05bb09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:02:18.875156 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53c881-8f8f-49d9-b7a3-3124da05bb09 service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:02:18.885450 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 682/1383] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:02:21.461721 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef3f5e-5266-4f9e-ab4a-dd06f887d1f1 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:21.462528 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef3f5e-5266-4f9e-ab4a-dd06f887d1f1 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:21.462739 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef3f5e-5266-4f9e-ab4a-dd06f887d1f1 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:21.465466 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 702/1384] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:02:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:21.471718 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317b0d9-b1aa-4544-9020-8db9d16da5ca None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:21.472299 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317b0d9-b1aa-4544-9020-8db9d16da5ca None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:21.472426 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317b0d9-b1aa-4544-9020-8db9d16da5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:21.491305 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-7317b0d9-b1aa-4544-9020-8db9d16da5ca None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:21.492502 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-7317b0d9-b1aa-4544-9020-8db9d16da5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:21.500616 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 683/1385] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:21.544514 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef3f5e-5266-4f9e-ab4a-dd06f887d1f1 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:02:21.560195 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef3f5e-5266-4f9e-ab4a-dd06f887d1f1 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:02:21.566183 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118ac38-343c-4328-b976-9252df36d02b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:02:21.566926 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118ac38-343c-4328-b976-9252df36d02b service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:21.567242 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118ac38-343c-4328-b976-9252df36d02b service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:21.567522 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118ac38-343c-4328-b976-9252df36d02b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:21.576657 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118ac38-343c-4328-b976-9252df36d02b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:02:21.578255 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118ac38-343c-4328-b976-9252df36d02b service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:02:21.592484 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 703/1386] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:02:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:02:24.735518 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b07b37-7746-4674-9c39-79dcc16284f7 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:24.736262 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b07b37-7746-4674-9c39-79dcc16284f7 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:24.736262 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b07b37-7746-4674-9c39-79dcc16284f7 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:24.738032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 684/1387] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:02:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:24.744514 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d255e-4b06-405f-a2f6-6b5fbc6ef615 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:24.745054 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d255e-4b06-405f-a2f6-6b5fbc6ef615 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:24.745054 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d255e-4b06-405f-a2f6-6b5fbc6ef615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:24.764000 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-754d255e-4b06-405f-a2f6-6b5fbc6ef615 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:24.765259 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-754d255e-4b06-405f-a2f6-6b5fbc6ef615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:24.774013 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 704/1388] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:02:24.821467 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b07b37-7746-4674-9c39-79dcc16284f7 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:02:24.836633 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b07b37-7746-4674-9c39-79dcc16284f7 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:02:24.842130 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c051a-b504-487f-9d41-f6b10a0629d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:02:24.842792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c051a-b504-487f-9d41-f6b10a0629d1 service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:24.843067 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c051a-b504-487f-9d41-f6b10a0629d1 service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:24.843373 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c051a-b504-487f-9d41-f6b10a0629d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:24.852097 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c051a-b504-487f-9d41-f6b10a0629d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:02:24.853663 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c051a-b504-487f-9d41-f6b10a0629d1 service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:02:24.863260 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 685/1389] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:02:27.512356 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28844b0a-0dad-43da-955f-75f58a8a1b2a None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:27.512999 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28844b0a-0dad-43da-955f-75f58a8a1b2a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:27.512999 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28844b0a-0dad-43da-955f-75f58a8a1b2a None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:27.514864 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 705/1390] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:27.520718 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2089804-05e2-4e2b-8b41-c1002988eb7d None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:27.533696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2089804-05e2-4e2b-8b41-c1002988eb7d None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:27.533696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2089804-05e2-4e2b-8b41-c1002988eb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:27.542995 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-c2089804-05e2-4e2b-8b41-c1002988eb7d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:27.544265 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-c2089804-05e2-4e2b-8b41-c1002988eb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:27.552237 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 686/1391] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:27.596823 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28844b0a-0dad-43da-955f-75f58a8a1b2a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:02:27.611937 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28844b0a-0dad-43da-955f-75f58a8a1b2a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:02:27.617835 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c558c8-b2c2-4159-84d0-3a0ac30c24ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:02:27.618464 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c558c8-b2c2-4159-84d0-3a0ac30c24ad service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:27.618774 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c558c8-b2c2-4159-84d0-3a0ac30c24ad service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:27.619054 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c558c8-b2c2-4159-84d0-3a0ac30c24ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:27.627165 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c558c8-b2c2-4159-84d0-3a0ac30c24ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:02:27.628736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c558c8-b2c2-4159-84d0-3a0ac30c24ad service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:02:27.638460 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 706/1392] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:02:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:02:29.405709 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab93d08-0c38-4cf4-815a-4e34be11d1ed None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:29.406288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab93d08-0c38-4cf4-815a-4e34be11d1ed None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:29.406288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab93d08-0c38-4cf4-815a-4e34be11d1ed None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:29.408086 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 687/1393] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:29.414130 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4b28e-45d0-494f-a760-04b3fbabd1ec None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:29.414569 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4b28e-45d0-494f-a760-04b3fbabd1ec None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:29.414760 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4b28e-45d0-494f-a760-04b3fbabd1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:29.433158 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-f1f4b28e-45d0-494f-a760-04b3fbabd1ec None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:29.434344 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f1f4b28e-45d0-494f-a760-04b3fbabd1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:29.442377 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 707/1394] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:29.499429 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd5d90-c2aa-4ea6-b965-fd53dcdb3b56 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:29.499829 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd5d90-c2aa-4ea6-b965-fd53dcdb3b56 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:29.500114 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd5d90-c2aa-4ea6-b965-fd53dcdb3b56 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:29.501920 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 688/1395] 10.222.0.42 () {54 vars in 962 bytes} [Wed Feb 16 17:02:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:29.508258 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6c76f-d761-409d-9c97-6067e488a58f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:29.508567 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6c76f-d761-409d-9c97-6067e488a58f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:29.508846 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6c76f-d761-409d-9c97-6067e488a58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:29.558977 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-57c6c76f-d761-409d-9c97-6067e488a58f None None] MFA Rules not processed for user `c7b2c52a60aa499e82129ef29f8907ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:29.560156 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-57c6c76f-d761-409d-9c97-6067e488a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:29.620355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 708/1396] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Feb 16 17:02:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:29.628137 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd5d90-c2aa-4ea6-b965-fd53dcdb3b56 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:02:29.639264 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd5d90-c2aa-4ea6-b965-fd53dcdb3b56 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:02:29.642760 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc466d2f-41fa-4f3d-8bf7-3b678fedafea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b2c52a60aa499e82129ef29f8907ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:02:29.643381 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc466d2f-41fa-4f3d-8bf7-3b678fedafea service glance] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:29.643658 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc466d2f-41fa-4f3d-8bf7-3b678fedafea service glance] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:29.643933 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc466d2f-41fa-4f3d-8bf7-3b678fedafea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:29.653388 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc466d2f-41fa-4f3d-8bf7-3b678fedafea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:02:29.654826 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc466d2f-41fa-4f3d-8bf7-3b678fedafea service glance] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:02:29.664219 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 689/1397] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:02:30.163450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b94c0d-c7b8-4e5c-9717-8240afd18b37 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:30.163718 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b94c0d-c7b8-4e5c-9717-8240afd18b37 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:30.163992 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b94c0d-c7b8-4e5c-9717-8240afd18b37 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:30.165767 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 709/1398] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:30.171187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfa6e4-9ed6-45d9-a1aa-669b2a44f26c None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:30.171705 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfa6e4-9ed6-45d9-a1aa-669b2a44f26c None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:30.171990 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfa6e4-9ed6-45d9-a1aa-669b2a44f26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:30.191117 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-1fbfa6e4-9ed6-45d9-a1aa-669b2a44f26c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:30.193317 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-1fbfa6e4-9ed6-45d9-a1aa-669b2a44f26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:30.201423 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 690/1399] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:30.216768 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68a692-9bf3-4103-927c-52b8952f5525 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:30.217117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68a692-9bf3-4103-927c-52b8952f5525 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:30.217490 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68a692-9bf3-4103-927c-52b8952f5525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:30.247399 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfa6e4-9ed6-45d9-a1aa-669b2a44f26c None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:02:30.260150 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfa6e4-9ed6-45d9-a1aa-669b2a44f26c None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:02:30.265748 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd491f-d8b6-48b2-9c71-069f9cf6bb7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:02:30.265970 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-ad68a692-9bf3-4103-927c-52b8952f5525 None None] MFA Rules not processed for user `fa9ea7738c634318a532ebca2e564745`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:30.266487 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd491f-d8b6-48b2-9c71-069f9cf6bb7a service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:30.266800 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd491f-d8b6-48b2-9c71-069f9cf6bb7a service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:30.267077 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd491f-d8b6-48b2-9c71-069f9cf6bb7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:30.267177 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-ad68a692-9bf3-4103-927c-52b8952f5525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:30.276330 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd491f-d8b6-48b2-9c71-069f9cf6bb7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:02:30.277900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd491f-d8b6-48b2-9c71-069f9cf6bb7a service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:02:30.287668 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 691/1400] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:02:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:02:30.328973 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 710/1401] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Feb 16 17:02:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:30.371898 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2eae19-87a8-4e36-89b5-d8de0c56ef02 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:30.372186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2eae19-87a8-4e36-89b5-d8de0c56ef02 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:30.372484 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2eae19-87a8-4e36-89b5-d8de0c56ef02 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:30.374280 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 692/1402] 10.222.0.42 () {54 vars in 942 bytes} [Wed Feb 16 17:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:30.381112 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6cae4-7cc2-4023-9387-df3e284797f4 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:30.381399 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6cae4-7cc2-4023-9387-df3e284797f4 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:30.381671 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6cae4-7cc2-4023-9387-df3e284797f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:30.431930 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-fdb6cae4-7cc2-4023-9387-df3e284797f4 None None] MFA Rules not processed for user `fc59cb98783b4353a405b8b9a3a9d592`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:30.433126 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-fdb6cae4-7cc2-4023-9387-df3e284797f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:30.504917 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 711/1403] 10.222.0.42 () {58 vars in 1039 bytes} [Wed Feb 16 17:02:30 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:30.514460 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2eae19-87a8-4e36-89b5-d8de0c56ef02 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:02:30.531965 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2eae19-87a8-4e36-89b5-d8de0c56ef02 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:02:30.538154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c9123-2a8c-4d31-83a7-38375e3cb9e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc59cb98783b4353a405b8b9a3a9d592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:02:30.539077 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c9123-2a8c-4d31-83a7-38375e3cb9e7 service swift] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:30.539366 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c9123-2a8c-4d31-83a7-38375e3cb9e7 service swift] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:30.539648 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c9123-2a8c-4d31-83a7-38375e3cb9e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:30.548789 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c9123-2a8c-4d31-83a7-38375e3cb9e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:02:30.550422 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c9123-2a8c-4d31-83a7-38375e3cb9e7 service swift] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:02:30.560664 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 693/1404] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Feb 16 17:02:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 17:02:32.800406 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b9e47-999f-4fc9-8083-e418da27c2ac None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:32.801939 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b9e47-999f-4fc9-8083-e418da27c2ac None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:32.802762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b9e47-999f-4fc9-8083-e418da27c2ac None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:32.810084 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 712/1405] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:02:32 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:32.812139 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbc072-0842-4d9a-8d68-9cd18f493394 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:32.812661 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbc072-0842-4d9a-8d68-9cd18f493394 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:32.812836 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbc072-0842-4d9a-8d68-9cd18f493394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:32.837235 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-44bbc072-0842-4d9a-8d68-9cd18f493394 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:32.838427 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-44bbc072-0842-4d9a-8d68-9cd18f493394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:32.846507 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 694/1406] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:32.899420 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b9e47-999f-4fc9-8083-e418da27c2ac None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:02:32.919786 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b9e47-999f-4fc9-8083-e418da27c2ac None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:02:32.925800 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf8308-d8a2-4eea-8a8a-9a4074333f91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:02:32.927138 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf8308-d8a2-4eea-8a8a-9a4074333f91 service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:32.927496 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf8308-d8a2-4eea-8a8a-9a4074333f91 service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:32.927847 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf8308-d8a2-4eea-8a8a-9a4074333f91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:32.936625 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf8308-d8a2-4eea-8a8a-9a4074333f91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:02:32.938284 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf8308-d8a2-4eea-8a8a-9a4074333f91 service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:02:32.948945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 713/1407] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:02:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:02:36.015520 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a584597-d298-4245-a6b1-bc757146bddc None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:36.016109 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a584597-d298-4245-a6b1-bc757146bddc None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:36.016109 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a584597-d298-4245-a6b1-bc757146bddc None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:36.019062 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 695/1408] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:36.024601 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a8362-2121-4c17-9b46-cfd1eaa3290b None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:36.025083 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a8362-2121-4c17-9b46-cfd1eaa3290b None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:36.025165 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a8362-2121-4c17-9b46-cfd1eaa3290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:36.045101 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-fa2a8362-2121-4c17-9b46-cfd1eaa3290b None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:36.046297 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-fa2a8362-2121-4c17-9b46-cfd1eaa3290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:36.070680 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 714/1409] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:02:36.100365 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a584597-d298-4245-a6b1-bc757146bddc None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:02:36.116715 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a584597-d298-4245-a6b1-bc757146bddc None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:02:36.122495 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3898070-37f3-44da-b75b-445cb4a43d86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:02:36.123162 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3898070-37f3-44da-b75b-445cb4a43d86 service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:36.123448 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3898070-37f3-44da-b75b-445cb4a43d86 service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:36.123722 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3898070-37f3-44da-b75b-445cb4a43d86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:36.132143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3898070-37f3-44da-b75b-445cb4a43d86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:02:36.133713 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3898070-37f3-44da-b75b-445cb4a43d86 service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:02:36.154064 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 696/1410] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:02:55.802268 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53e99d-baec-4cff-a4bb-60af368f18f7 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:55.802887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53e99d-baec-4cff-a4bb-60af368f18f7 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:55.802887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53e99d-baec-4cff-a4bb-60af368f18f7 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:55.804549 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 715/1411] 10.222.0.42 () {54 vars in 918 bytes} [Wed Feb 16 17:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:55.809792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703502b-1f83-41b0-9b9e-da14c96c0dbe None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:55.810263 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703502b-1f83-41b0-9b9e-da14c96c0dbe None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:55.810363 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703502b-1f83-41b0-9b9e-da14c96c0dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:55.828466 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-0703502b-1f83-41b0-9b9e-da14c96c0dbe None None] MFA Rules not processed for user `ae711b94b32a431ab880aa8f6068ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:55.829757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-0703502b-1f83-41b0-9b9e-da14c96c0dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:55.838959 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 697/1412] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Feb 16 17:02:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:55.852973 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f99c3d-8e00-4262-834f-7aaf2a0e965b None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:55.853285 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f99c3d-8e00-4262-834f-7aaf2a0e965b None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:55.853562 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f99c3d-8e00-4262-834f-7aaf2a0e965b None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:55.855409 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 716/1413] 10.222.0.42 () {54 vars in 918 bytes} [Wed Feb 16 17:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:55.859932 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9af1d-627f-469a-880b-2370455f7984 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:55.860215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9af1d-627f-469a-880b-2370455f7984 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:55.860514 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9af1d-627f-469a-880b-2370455f7984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:55.879790 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-2cb9af1d-627f-469a-880b-2370455f7984 None None] MFA Rules not processed for user `9a30603a236e4681a7702eec7029e9db`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:55.880978 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-2cb9af1d-627f-469a-880b-2370455f7984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:55.889804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 698/1414] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Feb 16 17:02:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:58.659558 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a8e95-d81d-4ea7-b11d-10acc804abd6 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:58.660123 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a8e95-d81d-4ea7-b11d-10acc804abd6 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:58.660123 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a8e95-d81d-4ea7-b11d-10acc804abd6 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:58.661920 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 717/1415] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 17:02:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:02:58.667271 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4185e-273a-4a5c-b1d5-5f04dafb18c1 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:58.667679 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4185e-273a-4a5c-b1d5-5f04dafb18c1 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:58.667816 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4185e-273a-4a5c-b1d5-5f04dafb18c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:58.685379 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-d6c4185e-273a-4a5c-b1d5-5f04dafb18c1 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:02:58.686573 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d6c4185e-273a-4a5c-b1d5-5f04dafb18c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:02:58.694905 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 699/1416] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 17:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:02:58.738777 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a8e95-d81d-4ea7-b11d-10acc804abd6 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:02:58.752798 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a8e95-d81d-4ea7-b11d-10acc804abd6 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:02:58.758687 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fb83c-40d4-451a-9248-22ffef434f8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:02:58.759321 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fb83c-40d4-451a-9248-22ffef434f8b service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:02:58.759602 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fb83c-40d4-451a-9248-22ffef434f8b service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:02:58.759881 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fb83c-40d4-451a-9248-22ffef434f8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:02:58.767828 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fb83c-40d4-451a-9248-22ffef434f8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:02:58.770171 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fb83c-40d4-451a-9248-22ffef434f8b service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:02:58.779415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 718/1417] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:03:00.149973 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221a114-efb3-4c59-b5bf-3205e39bfca4 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:00.150551 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221a114-efb3-4c59-b5bf-3205e39bfca4 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:00.150756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221a114-efb3-4c59-b5bf-3205e39bfca4 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:00.152693 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 700/1418] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 17:03:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:00.157819 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220a0c5-d4e6-4178-8fe2-b72f84192208 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:00.158240 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220a0c5-d4e6-4178-8fe2-b72f84192208 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:00.158350 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220a0c5-d4e6-4178-8fe2-b72f84192208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:00.177128 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-6220a0c5-d4e6-4178-8fe2-b72f84192208 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:00.178308 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-6220a0c5-d4e6-4178-8fe2-b72f84192208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:00.186156 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 719/1419] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 17:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:00.363689 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221a114-efb3-4c59-b5bf-3205e39bfca4 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:03:00.377886 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221a114-efb3-4c59-b5bf-3205e39bfca4 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:03:00.383459 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be90b50-3bc7-4a8c-8718-9b23b2834b25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:03:00.384117 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be90b50-3bc7-4a8c-8718-9b23b2834b25 service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:00.384398 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be90b50-3bc7-4a8c-8718-9b23b2834b25 service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:00.384675 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be90b50-3bc7-4a8c-8718-9b23b2834b25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:00.392636 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be90b50-3bc7-4a8c-8718-9b23b2834b25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:03:00.394890 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be90b50-3bc7-4a8c-8718-9b23b2834b25 service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:03:00.404146 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 701/1420] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:03:01.746784 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7eb2f0-2244-420c-8633-c98a93aa025a None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:01.747342 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7eb2f0-2244-420c-8633-c98a93aa025a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:01.747342 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7eb2f0-2244-420c-8633-c98a93aa025a None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:01.749089 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 720/1421] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 17:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:01.754744 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66995a58-937e-4b2f-b053-7b6584d1765e None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:01.755358 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66995a58-937e-4b2f-b053-7b6584d1765e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:01.755358 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66995a58-937e-4b2f-b053-7b6584d1765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:01.774175 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-66995a58-937e-4b2f-b053-7b6584d1765e None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:01.775398 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-66995a58-937e-4b2f-b053-7b6584d1765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:01.783330 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 702/1422] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 17:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:01.934365 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7eb2f0-2244-420c-8633-c98a93aa025a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:03:01.949101 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7eb2f0-2244-420c-8633-c98a93aa025a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:03:01.954552 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757952e-3d7d-4056-9946-47ce64445c82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:03:01.955205 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757952e-3d7d-4056-9946-47ce64445c82 service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:01.955488 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757952e-3d7d-4056-9946-47ce64445c82 service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:01.955765 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757952e-3d7d-4056-9946-47ce64445c82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:01.963896 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757952e-3d7d-4056-9946-47ce64445c82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:03:01.965465 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757952e-3d7d-4056-9946-47ce64445c82 service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:03:01.974935 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 721/1423] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:03:03.296896 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e8fdb-34db-422d-ab31-ff79472f2de8 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:03.297429 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e8fdb-34db-422d-ab31-ff79472f2de8 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:03.297429 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e8fdb-34db-422d-ab31-ff79472f2de8 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:03.299304 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 703/1424] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 17:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:03.305172 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc10d0-016d-4977-9046-f1ced2b22370 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:03.305589 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc10d0-016d-4977-9046-f1ced2b22370 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:03.305735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc10d0-016d-4977-9046-f1ced2b22370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:03.323434 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-aefc10d0-016d-4977-9046-f1ced2b22370 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:03.324656 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-aefc10d0-016d-4977-9046-f1ced2b22370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:03.332594 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 722/1425] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 17:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:03.481964 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e8fdb-34db-422d-ab31-ff79472f2de8 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:03:03.496433 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e8fdb-34db-422d-ab31-ff79472f2de8 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:03:03.501799 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcb2ee-6f47-4378-b642-4afda48b53c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:03:03.502420 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcb2ee-6f47-4378-b642-4afda48b53c1 service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:03.502737 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcb2ee-6f47-4378-b642-4afda48b53c1 service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:03.503168 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcb2ee-6f47-4378-b642-4afda48b53c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:03.511141 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcb2ee-6f47-4378-b642-4afda48b53c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:03:03.512711 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcb2ee-6f47-4378-b642-4afda48b53c1 service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:03:03.522693 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 704/1426] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:03:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:03:04.870744 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc81af1-0f2c-4ce6-b6c9-eb388061da61 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:04.871274 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc81af1-0f2c-4ce6-b6c9-eb388061da61 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:04.871274 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc81af1-0f2c-4ce6-b6c9-eb388061da61 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:04.873052 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 723/1427] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 17:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:04.878936 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e3711-0286-43a4-9da4-d2bb20cdccd7 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:04.879489 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e3711-0286-43a4-9da4-d2bb20cdccd7 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:04.879841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e3711-0286-43a4-9da4-d2bb20cdccd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:04.898890 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-889e3711-0286-43a4-9da4-d2bb20cdccd7 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:04.900075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-889e3711-0286-43a4-9da4-d2bb20cdccd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:04.908622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 705/1428] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 17:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:05.063496 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc81af1-0f2c-4ce6-b6c9-eb388061da61 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:03:05.078058 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc81af1-0f2c-4ce6-b6c9-eb388061da61 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:03:05.084375 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d4ee5-057f-4ab3-b334-3760d1d5ca3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:03:05.085044 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d4ee5-057f-4ab3-b334-3760d1d5ca3a service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:05.085329 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d4ee5-057f-4ab3-b334-3760d1d5ca3a service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:05.085605 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d4ee5-057f-4ab3-b334-3760d1d5ca3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:05.094064 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d4ee5-057f-4ab3-b334-3760d1d5ca3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:03:05.096237 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d4ee5-057f-4ab3-b334-3760d1d5ca3a service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:03:05.106450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 724/1429] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:03:06.509808 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ced02f-d59c-467d-8077-53fdca0e2b9e None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:06.510358 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ced02f-d59c-467d-8077-53fdca0e2b9e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:06.510358 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ced02f-d59c-467d-8077-53fdca0e2b9e None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:06.512111 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 706/1430] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 17:03:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:06.517064 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91574041-c5b3-4706-92be-00e61c995f60 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:06.517504 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91574041-c5b3-4706-92be-00e61c995f60 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:06.517609 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91574041-c5b3-4706-92be-00e61c995f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:06.537244 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-91574041-c5b3-4706-92be-00e61c995f60 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:06.541527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-91574041-c5b3-4706-92be-00e61c995f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:06.546376 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 725/1431] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 17:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:06.699925 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ced02f-d59c-467d-8077-53fdca0e2b9e None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:03:06.714631 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ced02f-d59c-467d-8077-53fdca0e2b9e None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:03:06.720433 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274645f4-63f9-4cee-8a82-522c4419ff4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:03:06.721061 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274645f4-63f9-4cee-8a82-522c4419ff4f service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:06.721371 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274645f4-63f9-4cee-8a82-522c4419ff4f service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:06.722350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274645f4-63f9-4cee-8a82-522c4419ff4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:06.730445 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274645f4-63f9-4cee-8a82-522c4419ff4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:03:06.732125 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274645f4-63f9-4cee-8a82-522c4419ff4f service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:03:06.741737 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 707/1432] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:03:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:03:08.063520 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e516a2-5c6d-484c-8845-daaa0d6bbb90 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:08.064093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e516a2-5c6d-484c-8845-daaa0d6bbb90 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:08.064093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e516a2-5c6d-484c-8845-daaa0d6bbb90 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:08.066616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 726/1433] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 17:03:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:08.071645 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076fe96-a02b-4077-be00-b8e151e16dfa None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:08.072058 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076fe96-a02b-4077-be00-b8e151e16dfa None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:08.072208 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076fe96-a02b-4077-be00-b8e151e16dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:08.090326 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-5076fe96-a02b-4077-be00-b8e151e16dfa None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:08.091536 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-5076fe96-a02b-4077-be00-b8e151e16dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:08.099305 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 708/1434] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 17:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:08.251674 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e516a2-5c6d-484c-8845-daaa0d6bbb90 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:03:08.265668 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e516a2-5c6d-484c-8845-daaa0d6bbb90 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:03:08.271011 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03927cf8-5f3a-43ad-b19d-da16d4a47c75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:03:08.271630 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03927cf8-5f3a-43ad-b19d-da16d4a47c75 service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:08.271905 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03927cf8-5f3a-43ad-b19d-da16d4a47c75 service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:08.272174 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03927cf8-5f3a-43ad-b19d-da16d4a47c75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:08.280059 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03927cf8-5f3a-43ad-b19d-da16d4a47c75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:03:08.281600 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03927cf8-5f3a-43ad-b19d-da16d4a47c75 service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:03:08.291305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 727/1435] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:03:09.618571 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b6cf1-26d2-43a4-95e0-29777134d766 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:09.619122 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b6cf1-26d2-43a4-95e0-29777134d766 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:09.619216 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b6cf1-26d2-43a4-95e0-29777134d766 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:09.620913 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 709/1436] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 17:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:09.625928 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142aff5-414b-42c8-8ed5-f4f4e53e2958 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:09.626387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142aff5-414b-42c8-8ed5-f4f4e53e2958 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:09.626493 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142aff5-414b-42c8-8ed5-f4f4e53e2958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:09.646013 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-9142aff5-414b-42c8-8ed5-f4f4e53e2958 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:09.647243 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-9142aff5-414b-42c8-8ed5-f4f4e53e2958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:09.654968 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 728/1437] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 17:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:09.805161 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b6cf1-26d2-43a4-95e0-29777134d766 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:03:09.819570 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b6cf1-26d2-43a4-95e0-29777134d766 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:03:09.824823 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a12aa1-95c5-474f-aeb3-c310934add81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:03:09.825437 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a12aa1-95c5-474f-aeb3-c310934add81 service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:09.825713 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a12aa1-95c5-474f-aeb3-c310934add81 service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:09.825986 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a12aa1-95c5-474f-aeb3-c310934add81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:09.834346 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a12aa1-95c5-474f-aeb3-c310934add81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:03:09.835917 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a12aa1-95c5-474f-aeb3-c310934add81 service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:03:09.844825 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 710/1438] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:03:11.201506 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbed551-e36d-4fa2-aff9-cb7a6154535d None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:11.202043 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbed551-e36d-4fa2-aff9-cb7a6154535d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:11.202043 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbed551-e36d-4fa2-aff9-cb7a6154535d None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:11.203896 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 729/1439] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 17:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:11.208964 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81b168-79b0-4bba-a7fd-46ced3eb6c4e None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:11.209391 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81b168-79b0-4bba-a7fd-46ced3eb6c4e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:11.209527 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81b168-79b0-4bba-a7fd-46ced3eb6c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:11.227707 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-8b81b168-79b0-4bba-a7fd-46ced3eb6c4e None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:11.228884 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-8b81b168-79b0-4bba-a7fd-46ced3eb6c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:11.236557 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 711/1440] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 17:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:11.394943 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbed551-e36d-4fa2-aff9-cb7a6154535d None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:03:11.410146 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbed551-e36d-4fa2-aff9-cb7a6154535d None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:03:11.415560 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35da4c-5321-4d12-97be-b21a8aee8004 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:03:11.416192 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35da4c-5321-4d12-97be-b21a8aee8004 service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:11.416475 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35da4c-5321-4d12-97be-b21a8aee8004 service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:11.416749 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35da4c-5321-4d12-97be-b21a8aee8004 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:11.425434 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35da4c-5321-4d12-97be-b21a8aee8004 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:03:11.427124 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35da4c-5321-4d12-97be-b21a8aee8004 service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:03:11.436234 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 730/1441] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:03:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:03:13.632704 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2089244-a3bc-4b1c-80b5-13546a8cfd44 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:13.633231 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2089244-a3bc-4b1c-80b5-13546a8cfd44 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:13.633350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2089244-a3bc-4b1c-80b5-13546a8cfd44 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:13.635118 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 712/1442] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 17:03:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:13.640370 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad31d8d-5960-49b3-b7f9-c64cf5d00da7 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:13.640762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad31d8d-5960-49b3-b7f9-c64cf5d00da7 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:13.640991 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad31d8d-5960-49b3-b7f9-c64cf5d00da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:13.662054 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-dad31d8d-5960-49b3-b7f9-c64cf5d00da7 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:13.663254 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-dad31d8d-5960-49b3-b7f9-c64cf5d00da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:13.670890 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 731/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 17:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:13.711903 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2089244-a3bc-4b1c-80b5-13546a8cfd44 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:03:13.722366 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2089244-a3bc-4b1c-80b5-13546a8cfd44 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:03:13.725918 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4aa5f-78c2-4f7e-b3f9-958e3d3f289a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:03:13.726546 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4aa5f-78c2-4f7e-b3f9-958e3d3f289a service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:13.726855 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4aa5f-78c2-4f7e-b3f9-958e3d3f289a service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:13.727151 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4aa5f-78c2-4f7e-b3f9-958e3d3f289a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:13.735857 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4aa5f-78c2-4f7e-b3f9-958e3d3f289a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:03:13.737425 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4aa5f-78c2-4f7e-b3f9-958e3d3f289a service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:03:13.746813 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 713/1444] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:03:16.207226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85086322-9f78-48cd-9d89-26e3eb7766e8 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:16.207871 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85086322-9f78-48cd-9d89-26e3eb7766e8 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:16.207871 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85086322-9f78-48cd-9d89-26e3eb7766e8 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:16.209584 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 732/1445] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 17:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:16.215030 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3a418-9210-4f76-8c8c-f101c1d9c715 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:16.215503 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3a418-9210-4f76-8c8c-f101c1d9c715 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:16.215606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3a418-9210-4f76-8c8c-f101c1d9c715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:16.233760 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-5be3a418-9210-4f76-8c8c-f101c1d9c715 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:16.234981 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-5be3a418-9210-4f76-8c8c-f101c1d9c715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:16.243873 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 714/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 17:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:16.281851 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85086322-9f78-48cd-9d89-26e3eb7766e8 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:03:16.293171 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85086322-9f78-48cd-9d89-26e3eb7766e8 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:03:16.296710 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ea63c-4e0c-4f24-bcbe-1219882374fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:03:16.297355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ea63c-4e0c-4f24-bcbe-1219882374fd service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:16.297637 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ea63c-4e0c-4f24-bcbe-1219882374fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:16.297915 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ea63c-4e0c-4f24-bcbe-1219882374fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:16.306717 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ea63c-4e0c-4f24-bcbe-1219882374fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:03:16.308134 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ea63c-4e0c-4f24-bcbe-1219882374fd service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:03:16.317546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 733/1447] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:03:19.003431 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541dd49-b985-4a9e-a8f1-8290d38a37a2 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:19.004042 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541dd49-b985-4a9e-a8f1-8290d38a37a2 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:19.004042 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541dd49-b985-4a9e-a8f1-8290d38a37a2 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:19.005795 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 715/1448] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 17:03:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:19.011412 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65708df1-bf4d-47d3-8f6d-eb5f657875d2 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:19.011850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65708df1-bf4d-47d3-8f6d-eb5f657875d2 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:19.011972 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65708df1-bf4d-47d3-8f6d-eb5f657875d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:19.030007 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-65708df1-bf4d-47d3-8f6d-eb5f657875d2 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:19.031230 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-65708df1-bf4d-47d3-8f6d-eb5f657875d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:19.039199 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 734/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 17:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:19.080116 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541dd49-b985-4a9e-a8f1-8290d38a37a2 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:03:19.091148 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541dd49-b985-4a9e-a8f1-8290d38a37a2 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:03:19.094602 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c73f90-79fc-409c-8540-f26071ec08f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:03:19.095253 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c73f90-79fc-409c-8540-f26071ec08f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:19.095530 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c73f90-79fc-409c-8540-f26071ec08f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:19.095807 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c73f90-79fc-409c-8540-f26071ec08f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:19.105003 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c73f90-79fc-409c-8540-f26071ec08f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:03:19.106408 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c73f90-79fc-409c-8540-f26071ec08f6 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:03:19.116517 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 716/1450] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:03:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:03:21.557207 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d9aa7-0dee-4e11-bff6-a6ddf8dbbee3 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:21.557782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d9aa7-0dee-4e11-bff6-a6ddf8dbbee3 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:21.557782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d9aa7-0dee-4e11-bff6-a6ddf8dbbee3 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:21.559571 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 735/1451] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 17:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:21.564785 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e30c7-e88d-40e9-a658-e2795c846268 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:21.565311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e30c7-e88d-40e9-a658-e2795c846268 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:21.566831 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e30c7-e88d-40e9-a658-e2795c846268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:21.584090 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-724e30c7-e88d-40e9-a658-e2795c846268 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:21.585375 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-724e30c7-e88d-40e9-a658-e2795c846268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:21.593207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 717/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 17:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:21.631983 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d9aa7-0dee-4e11-bff6-a6ddf8dbbee3 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:03:21.642570 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d9aa7-0dee-4e11-bff6-a6ddf8dbbee3 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:03:21.647094 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f048e1-eb51-454c-aee3-ed97e9a14e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:03:21.647735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f048e1-eb51-454c-aee3-ed97e9a14e2b service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:21.648033 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f048e1-eb51-454c-aee3-ed97e9a14e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:21.648305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f048e1-eb51-454c-aee3-ed97e9a14e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:21.657062 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f048e1-eb51-454c-aee3-ed97e9a14e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:03:21.659091 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f048e1-eb51-454c-aee3-ed97e9a14e2b service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:03:21.668589 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 736/1453] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:03:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:03:24.090188 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c101a15-5661-4d40-9e3e-6932fa04ed54 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:24.090772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c101a15-5661-4d40-9e3e-6932fa04ed54 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:24.090891 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c101a15-5661-4d40-9e3e-6932fa04ed54 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:24.092662 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 718/1454] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 17:03:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:24.098717 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b37d57-d700-40c1-9062-0ba9789a032f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:24.099192 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b37d57-d700-40c1-9062-0ba9789a032f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:24.099290 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b37d57-d700-40c1-9062-0ba9789a032f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:24.118076 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-c6b37d57-d700-40c1-9062-0ba9789a032f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:24.119285 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-c6b37d57-d700-40c1-9062-0ba9789a032f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:24.126942 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 737/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 17:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:24.165135 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c101a15-5661-4d40-9e3e-6932fa04ed54 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:03:24.176113 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c101a15-5661-4d40-9e3e-6932fa04ed54 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:03:24.179603 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0fc26-c319-4001-8c68-ed13e60de02a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:03:24.180219 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0fc26-c319-4001-8c68-ed13e60de02a service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:24.180492 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0fc26-c319-4001-8c68-ed13e60de02a service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:24.180759 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0fc26-c319-4001-8c68-ed13e60de02a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:24.189439 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0fc26-c319-4001-8c68-ed13e60de02a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:03:24.191582 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0fc26-c319-4001-8c68-ed13e60de02a service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:03:24.201355 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 719/1456] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:03:26.560906 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea10bd3-4402-4055-80ae-4f0fc79a6d4f None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:26.561887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea10bd3-4402-4055-80ae-4f0fc79a6d4f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:26.561887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea10bd3-4402-4055-80ae-4f0fc79a6d4f None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:26.563342 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 738/1457] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 17:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:26.568897 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d449e9-2cd3-41eb-ad64-ace8e9e33605 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:26.569330 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d449e9-2cd3-41eb-ad64-ace8e9e33605 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:26.569505 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d449e9-2cd3-41eb-ad64-ace8e9e33605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:26.587838 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-99d449e9-2cd3-41eb-ad64-ace8e9e33605 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:26.590441 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-99d449e9-2cd3-41eb-ad64-ace8e9e33605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:26.597527 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 720/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 17:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:26.636321 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea10bd3-4402-4055-80ae-4f0fc79a6d4f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:03:26.647653 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea10bd3-4402-4055-80ae-4f0fc79a6d4f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:03:26.651328 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b411b3-330e-454c-9bdb-5263f9e8d018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:03:26.651930 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b411b3-330e-454c-9bdb-5263f9e8d018 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:26.652214 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b411b3-330e-454c-9bdb-5263f9e8d018 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:26.652488 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b411b3-330e-454c-9bdb-5263f9e8d018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:26.662062 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b411b3-330e-454c-9bdb-5263f9e8d018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:03:26.663516 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b411b3-330e-454c-9bdb-5263f9e8d018 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:03:26.672755 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 739/1459] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:03:29.020038 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fd91f-6e51-4172-a33f-f6bf6dfdeef5 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:29.020613 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fd91f-6e51-4172-a33f-f6bf6dfdeef5 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:29.020613 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fd91f-6e51-4172-a33f-f6bf6dfdeef5 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:29.022344 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 721/1460] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 17:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:29.027748 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4fffc-6892-47fd-83a9-9a2a13e9826d None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:29.028169 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4fffc-6892-47fd-83a9-9a2a13e9826d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:29.028301 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4fffc-6892-47fd-83a9-9a2a13e9826d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:29.045665 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-a2e4fffc-6892-47fd-83a9-9a2a13e9826d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:29.046947 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a2e4fffc-6892-47fd-83a9-9a2a13e9826d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:29.055435 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 740/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 17:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:29.093091 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fd91f-6e51-4172-a33f-f6bf6dfdeef5 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:03:29.103639 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fd91f-6e51-4172-a33f-f6bf6dfdeef5 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:03:29.107153 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72794f8-1d9e-4a34-bd15-f4c3d53113c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:03:29.107776 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72794f8-1d9e-4a34-bd15-f4c3d53113c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:29.108051 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72794f8-1d9e-4a34-bd15-f4c3d53113c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:29.108321 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72794f8-1d9e-4a34-bd15-f4c3d53113c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:29.117963 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72794f8-1d9e-4a34-bd15-f4c3d53113c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:03:29.119736 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72794f8-1d9e-4a34-bd15-f4c3d53113c4 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:03:29.129870 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 722/1462] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:03:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:03:31.459404 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc4577-e288-4fcf-b8b1-01babb85652a None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:31.459969 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc4577-e288-4fcf-b8b1-01babb85652a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:31.459969 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc4577-e288-4fcf-b8b1-01babb85652a None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:31.461781 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 741/1463] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 17:03:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:31.467166 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7091c5-2694-47f3-89c3-881a1724fa5a None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:31.467615 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7091c5-2694-47f3-89c3-881a1724fa5a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:31.467721 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7091c5-2694-47f3-89c3-881a1724fa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:31.486216 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-5f7091c5-2694-47f3-89c3-881a1724fa5a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:31.488237 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-5f7091c5-2694-47f3-89c3-881a1724fa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:31.495892 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 723/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 17:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:31.536005 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc4577-e288-4fcf-b8b1-01babb85652a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:03:31.546675 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc4577-e288-4fcf-b8b1-01babb85652a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:03:31.550743 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872e102-dd35-42cc-b2d7-a103520ba858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:03:31.551373 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872e102-dd35-42cc-b2d7-a103520ba858 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:31.561510 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872e102-dd35-42cc-b2d7-a103520ba858 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:31.561510 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872e102-dd35-42cc-b2d7-a103520ba858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:31.561510 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872e102-dd35-42cc-b2d7-a103520ba858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:03:31.562397 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872e102-dd35-42cc-b2d7-a103520ba858 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:03:31.572585 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 742/1465] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:03:33.906224 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224e5c3-5eaa-460b-a51c-35372a847b7b None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:33.906801 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224e5c3-5eaa-460b-a51c-35372a847b7b None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:33.906801 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224e5c3-5eaa-460b-a51c-35372a847b7b None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:33.909106 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 724/1466] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 17:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:33.914398 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8e469-1261-496f-a15f-9b80aa5cca70 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:33.914835 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8e469-1261-496f-a15f-9b80aa5cca70 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:33.914981 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8e469-1261-496f-a15f-9b80aa5cca70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:33.933404 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-5af8e469-1261-496f-a15f-9b80aa5cca70 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:33.934612 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5af8e469-1261-496f-a15f-9b80aa5cca70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:33.942608 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 743/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 17:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:33.979734 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224e5c3-5eaa-460b-a51c-35372a847b7b None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:03:33.991329 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224e5c3-5eaa-460b-a51c-35372a847b7b None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:03:33.994907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0ab31-6537-4b17-83d3-eea6a3c96fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:03:33.995530 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0ab31-6537-4b17-83d3-eea6a3c96fde service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:33.995810 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0ab31-6537-4b17-83d3-eea6a3c96fde service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:33.996081 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0ab31-6537-4b17-83d3-eea6a3c96fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:34.004814 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0ab31-6537-4b17-83d3-eea6a3c96fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:03:34.006215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0ab31-6537-4b17-83d3-eea6a3c96fde service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:03:34.015336 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 725/1468] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:03:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:03:36.313102 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88a86a-ce3f-404f-988b-10a646f005e2 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:36.313646 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88a86a-ce3f-404f-988b-10a646f005e2 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:36.313646 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88a86a-ce3f-404f-988b-10a646f005e2 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:36.316129 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 744/1469] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 17:03:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:36.321424 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84a706-1af1-42a4-a894-10645a774de9 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:36.321807 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84a706-1af1-42a4-a894-10645a774de9 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:36.321968 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84a706-1af1-42a4-a894-10645a774de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:36.340608 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-ed84a706-1af1-42a4-a894-10645a774de9 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:36.341784 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-ed84a706-1af1-42a4-a894-10645a774de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:36.349964 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 726/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 17:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:36.386400 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88a86a-ce3f-404f-988b-10a646f005e2 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:03:36.396847 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88a86a-ce3f-404f-988b-10a646f005e2 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:03:36.400358 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65beea93-323d-40bf-a127-2d2e384c64bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:03:36.400987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65beea93-323d-40bf-a127-2d2e384c64bd service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:36.401265 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65beea93-323d-40bf-a127-2d2e384c64bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:36.401537 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65beea93-323d-40bf-a127-2d2e384c64bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:36.414398 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65beea93-323d-40bf-a127-2d2e384c64bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:03:36.415894 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65beea93-323d-40bf-a127-2d2e384c64bd service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:03:36.425980 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 745/1471] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:03:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:03:57.459326 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bf74d-a5ed-49a2-a55c-27eb4e0c535d None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:57.459927 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bf74d-a5ed-49a2-a55c-27eb4e0c535d None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:57.459927 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bf74d-a5ed-49a2-a55c-27eb4e0c535d None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:57.461671 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 727/1472] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:57.466985 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5668cf-ee57-46bf-95d7-ed61d38d1e81 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:57.467449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5668cf-ee57-46bf-95d7-ed61d38d1e81 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:57.467554 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5668cf-ee57-46bf-95d7-ed61d38d1e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:57.486230 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-5e5668cf-ee57-46bf-95d7-ed61d38d1e81 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:57.487450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5e5668cf-ee57-46bf-95d7-ed61d38d1e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:57.495399 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 746/1473] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:57.543146 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3656c-1f54-467f-a23f-9551ca035f05 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:57.543430 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3656c-1f54-467f-a23f-9551ca035f05 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:57.543710 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3656c-1f54-467f-a23f-9551ca035f05 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:57.545431 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 728/1474] 10.222.0.42 () {54 vars in 962 bytes} [Wed Feb 16 17:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:03:57.550272 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd06f7-5b2a-4bac-9a4b-c3e7efdf038d None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:57.550563 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd06f7-5b2a-4bac-9a4b-c3e7efdf038d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:57.550874 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd06f7-5b2a-4bac-9a4b-c3e7efdf038d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:57.569230 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-28bd06f7-5b2a-4bac-9a4b-c3e7efdf038d None None] MFA Rules not processed for user `c7b2c52a60aa499e82129ef29f8907ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:03:57.572653 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-28bd06f7-5b2a-4bac-9a4b-c3e7efdf038d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:03:57.577081 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 747/1475] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Feb 16 17:03:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:03:57.584923 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3656c-1f54-467f-a23f-9551ca035f05 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:03:57.596211 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3656c-1f54-467f-a23f-9551ca035f05 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:03:57.599708 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47774b-a8f6-41bf-a20f-b33cca144b5f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b2c52a60aa499e82129ef29f8907ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:03:57.600322 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47774b-a8f6-41bf-a20f-b33cca144b5f service glance] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:03:57.600596 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47774b-a8f6-41bf-a20f-b33cca144b5f service glance] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:03:57.600864 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47774b-a8f6-41bf-a20f-b33cca144b5f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:03:57.609542 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47774b-a8f6-41bf-a20f-b33cca144b5f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:03:57.611025 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47774b-a8f6-41bf-a20f-b33cca144b5f service glance] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:03:57.620231 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 729/1476] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:04:00.005042 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59d2f8-982f-4303-9c36-f9f4206fc6d7 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:04:00.005609 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59d2f8-982f-4303-9c36-f9f4206fc6d7 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:04:00.005609 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59d2f8-982f-4303-9c36-f9f4206fc6d7 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:04:00.007485 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 748/1477] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:04:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:04:00.012844 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e0975-639a-4584-8c01-ac654243e6fe None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:04:00.013276 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e0975-639a-4584-8c01-ac654243e6fe None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:04:00.013382 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e0975-639a-4584-8c01-ac654243e6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:04:00.031410 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-951e0975-639a-4584-8c01-ac654243e6fe None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:04:00.032803 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-951e0975-639a-4584-8c01-ac654243e6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:04:00.040590 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 730/1478] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:04:00.065178 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59d2f8-982f-4303-9c36-f9f4206fc6d7 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:04:00.077295 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59d2f8-982f-4303-9c36-f9f4206fc6d7 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:04:00.082485 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf23520-7579-43b8-bebd-2771cbba4c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:04:00.083142 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf23520-7579-43b8-bebd-2771cbba4c29 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:04:00.083419 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf23520-7579-43b8-bebd-2771cbba4c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:04:00.083687 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf23520-7579-43b8-bebd-2771cbba4c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:04:00.084396 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf23520-7579-43b8-bebd-2771cbba4c29 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:04:00.086211 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf23520-7579-43b8-bebd-2771cbba4c29 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:04:00.099622 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 749/1479] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Feb 16 17:04:00 2022] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:04:02.468899 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccff6b3-5ea5-45d7-a093-9ed627e989fa None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:04:02.469968 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccff6b3-5ea5-45d7-a093-9ed627e989fa None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:04:02.469968 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccff6b3-5ea5-45d7-a093-9ed627e989fa None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:04:02.472194 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 731/1480] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:04:02.477501 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a24c0-4910-4ca9-a7ad-ca6bf1b1cb20 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:04:02.477919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a24c0-4910-4ca9-a7ad-ca6bf1b1cb20 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:04:02.478090 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a24c0-4910-4ca9-a7ad-ca6bf1b1cb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:04:02.496458 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-8c7a24c0-4910-4ca9-a7ad-ca6bf1b1cb20 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:04:02.497641 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8c7a24c0-4910-4ca9-a7ad-ca6bf1b1cb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:04:02.506324 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 750/1481] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:04:02.552407 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccff6b3-5ea5-45d7-a093-9ed627e989fa None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:04:02.566957 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccff6b3-5ea5-45d7-a093-9ed627e989fa None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:04:02.572310 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59494d-814e-49d0-a9b5-fa87ead76e2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:04:02.579467 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59494d-814e-49d0-a9b5-fa87ead76e2f service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:04:02.579467 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59494d-814e-49d0-a9b5-fa87ead76e2f service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:04:02.579467 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59494d-814e-49d0-a9b5-fa87ead76e2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:04:02.582529 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59494d-814e-49d0-a9b5-fa87ead76e2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:04:02.584133 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59494d-814e-49d0-a9b5-fa87ead76e2f service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:04:02.593374 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 732/1482] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:04:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:04:05.057844 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103a61e-6c84-44b5-bd07-474c167a56e9 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:04:05.058418 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103a61e-6c84-44b5-bd07-474c167a56e9 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:04:05.058418 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103a61e-6c84-44b5-bd07-474c167a56e9 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:04:05.060245 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 751/1483] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:04:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:04:05.066462 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf502b06-f16c-4c3c-96fd-10d8e0507e5f None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:04:05.066939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf502b06-f16c-4c3c-96fd-10d8e0507e5f None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:04:05.067270 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf502b06-f16c-4c3c-96fd-10d8e0507e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:04:05.086999 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-bf502b06-f16c-4c3c-96fd-10d8e0507e5f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:04:05.088190 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-bf502b06-f16c-4c3c-96fd-10d8e0507e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:04:05.095876 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 733/1484] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:04:05.135297 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103a61e-6c84-44b5-bd07-474c167a56e9 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:04:05.136947 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-3103a61e-6c84-44b5-bd07-474c167a56e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:04:05.150244 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103a61e-6c84-44b5-bd07-474c167a56e9 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:04:05.154210 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3d646-19f4-44bf-a36d-b4f67ee51504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:04:05.154871 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3d646-19f4-44bf-a36d-b4f67ee51504 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:04:05.155148 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3d646-19f4-44bf-a36d-b4f67ee51504 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:04:05.155417 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3d646-19f4-44bf-a36d-b4f67ee51504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:04:05.164531 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3d646-19f4-44bf-a36d-b4f67ee51504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:04:05.166248 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3d646-19f4-44bf-a36d-b4f67ee51504 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:04:05.176313 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 752/1485] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:04:07.718661 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877bec6-76f9-4575-847b-60ac62fa0ae4 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:04:07.719742 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877bec6-76f9-4575-847b-60ac62fa0ae4 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:04:07.719965 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877bec6-76f9-4575-847b-60ac62fa0ae4 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:04:07.721904 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 734/1486] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:04:07.727161 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef038570-00c8-4985-aadf-e36f7717fcf6 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:04:07.727604 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef038570-00c8-4985-aadf-e36f7717fcf6 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:04:07.727788 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef038570-00c8-4985-aadf-e36f7717fcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:04:07.746284 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-ef038570-00c8-4985-aadf-e36f7717fcf6 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:04:07.747519 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-ef038570-00c8-4985-aadf-e36f7717fcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:04:07.755489 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 753/1487] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:04:07.793416 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877bec6-76f9-4575-847b-60ac62fa0ae4 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:04:07.804814 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877bec6-76f9-4575-847b-60ac62fa0ae4 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:04:07.808426 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38170718-06ad-4d4b-8b6c-e6eef99dbdd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:04:07.809048 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38170718-06ad-4d4b-8b6c-e6eef99dbdd7 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:04:07.809328 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38170718-06ad-4d4b-8b6c-e6eef99dbdd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:04:07.809603 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38170718-06ad-4d4b-8b6c-e6eef99dbdd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:04:07.818344 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38170718-06ad-4d4b-8b6c-e6eef99dbdd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:04:07.819796 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38170718-06ad-4d4b-8b6c-e6eef99dbdd7 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:04:07.828845 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 735/1488] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:04:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:04:10.303855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dc87f-a0b3-4a72-9650-d7d98f51e70c None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:04:10.304369 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dc87f-a0b3-4a72-9650-d7d98f51e70c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:04:10.304499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dc87f-a0b3-4a72-9650-d7d98f51e70c None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:04:10.306197 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 754/1489] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:04:10.311446 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f2e48-0313-459a-bd2d-f4e7ea1503b7 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:04:10.311884 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f2e48-0313-459a-bd2d-f4e7ea1503b7 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:04:10.311979 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f2e48-0313-459a-bd2d-f4e7ea1503b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:04:10.330865 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-683f2e48-0313-459a-bd2d-f4e7ea1503b7 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:04:10.332043 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-683f2e48-0313-459a-bd2d-f4e7ea1503b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:04:10.339840 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 736/1490] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:04:10.380904 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dc87f-a0b3-4a72-9650-d7d98f51e70c None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:04:10.392020 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dc87f-a0b3-4a72-9650-d7d98f51e70c None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:04:10.395543 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd72574-4b98-4e02-b6fa-110f33c50c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:04:10.396169 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd72574-4b98-4e02-b6fa-110f33c50c0a service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:04:10.396450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd72574-4b98-4e02-b6fa-110f33c50c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:04:10.396726 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd72574-4b98-4e02-b6fa-110f33c50c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:04:10.405509 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd72574-4b98-4e02-b6fa-110f33c50c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:04:10.407721 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd72574-4b98-4e02-b6fa-110f33c50c0a service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:04:10.416878 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 755/1491] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:04:13.316670 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940dbb6-478c-4bf5-bd83-45afc44ae6c2 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:04:13.317208 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940dbb6-478c-4bf5-bd83-45afc44ae6c2 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:04:13.317208 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940dbb6-478c-4bf5-bd83-45afc44ae6c2 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:04:13.319047 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 737/1492] 10.222.0.42 () {54 vars in 926 bytes} [Wed Feb 16 17:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:04:13.324142 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748876b6-50d1-46b1-972f-727e8afad1ae None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:04:13.324570 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748876b6-50d1-46b1-972f-727e8afad1ae None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:04:13.324700 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748876b6-50d1-46b1-972f-727e8afad1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:04:13.342797 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-748876b6-50d1-46b1-972f-727e8afad1ae None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:04:13.344620 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-748876b6-50d1-46b1-972f-727e8afad1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:04:13.352624 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 756/1493] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Feb 16 17:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:04:13.392403 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940dbb6-478c-4bf5-bd83-45afc44ae6c2 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:04:13.402945 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940dbb6-478c-4bf5-bd83-45afc44ae6c2 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:04:13.407099 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6bf22f-2946-4cf0-ad4c-ab2acf1bb0a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:04:13.407810 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bf22f-2946-4cf0-ad4c-ab2acf1bb0a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:04:13.408096 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bf22f-2946-4cf0-ad4c-ab2acf1bb0a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:04:13.408370 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bf22f-2946-4cf0-ad4c-ab2acf1bb0a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:04:13.417263 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bf22f-2946-4cf0-ad4c-ab2acf1bb0a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:04:13.418720 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bf22f-2946-4cf0-ad4c-ab2acf1bb0a5 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:04:13.428286 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 738/1494] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:04:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:05:54.677863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f305c6c-f267-4ffb-8ff1-3234c1c4f9b4 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:05:54.678445 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f305c6c-f267-4ffb-8ff1-3234c1c4f9b4 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:05:54.678445 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f305c6c-f267-4ffb-8ff1-3234c1c4f9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:05:54.695961 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-0f305c6c-f267-4ffb-8ff1-3234c1c4f9b4 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:05:54.697145 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0f305c6c-f267-4ffb-8ff1-3234c1c4f9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:05:54.704905 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 757/1495] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:05:54.712743 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82b47a-3d6e-471c-b4d1-e58698764215 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:05:54.713252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82b47a-3d6e-471c-b4d1-e58698764215 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:05:54.713357 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82b47a-3d6e-471c-b4d1-e58698764215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:05:54.731218 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-0a82b47a-3d6e-471c-b4d1-e58698764215 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:05:54.732374 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-0a82b47a-3d6e-471c-b4d1-e58698764215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:05:54.741488 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 739/1496] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:05:54.746014 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f305c6c-f267-4ffb-8ff1-3234c1c4f9b4 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:05:54.755409 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f305c6c-f267-4ffb-8ff1-3234c1c4f9b4 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:05:54.759889 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3240f-6e50-4f93-939c-28fdcca6735b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:05:54.760537 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3240f-6e50-4f93-939c-28fdcca6735b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:05:54.760816 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3240f-6e50-4f93-939c-28fdcca6735b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:05:54.761092 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3240f-6e50-4f93-939c-28fdcca6735b admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:05:54.761808 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3240f-6e50-4f93-939c-28fdcca6735b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:05:54.762115 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3240f-6e50-4f93-939c-28fdcca6735b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:05:54.763739 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3240f-6e50-4f93-939c-28fdcca6735b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:05:54.775106 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 758/1497] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 17:05:54.783607 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82b47a-3d6e-471c-b4d1-e58698764215 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:05:54.792640 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82b47a-3d6e-471c-b4d1-e58698764215 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:05:54.800441 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd406c61-58f8-44bd-840a-170d92a4aa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:05:54.800441 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd406c61-58f8-44bd-840a-170d92a4aa81 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:05:54.800441 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd406c61-58f8-44bd-840a-170d92a4aa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:05:54.800441 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd406c61-58f8-44bd-840a-170d92a4aa81 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:05:54.800867 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd406c61-58f8-44bd-840a-170d92a4aa81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:05:54.801827 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd406c61-58f8-44bd-840a-170d92a4aa81 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:05:54.897208 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 740/1498] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:05:54 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:05:54.901615 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3240f-6e50-4f93-939c-28fdcca6735b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:05:54.912884 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3240f-6e50-4f93-939c-28fdcca6735b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:05:54.969350 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd3d20-cb93-4983-9149-14658b0150a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:05:54.969983 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd3d20-cb93-4983-9149-14658b0150a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:05:54.970263 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd3d20-cb93-4983-9149-14658b0150a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:05:54.970537 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd3d20-cb93-4983-9149-14658b0150a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:05:54.971317 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd3d20-cb93-4983-9149-14658b0150a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:05:54.973234 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd3d20-cb93-4983-9149-14658b0150a8 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:05:55.058923 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 759/1499] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:05:54 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:05:55.063373 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd406c61-58f8-44bd-840a-170d92a4aa81 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:05:55.073454 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd406c61-58f8-44bd-840a-170d92a4aa81 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:05:55.077975 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb836c7-99db-4023-91c5-ea70d03a1845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:05:55.079179 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb836c7-99db-4023-91c5-ea70d03a1845 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:05:55.079448 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb836c7-99db-4023-91c5-ea70d03a1845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:05:55.079721 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb836c7-99db-4023-91c5-ea70d03a1845 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:05:55.080437 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb836c7-99db-4023-91c5-ea70d03a1845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:05:55.081992 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb836c7-99db-4023-91c5-ea70d03a1845 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:05:55.094984 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 741/1500] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:05:55.099065 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd3d20-cb93-4983-9149-14658b0150a8 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:05:55.108806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd3d20-cb93-4983-9149-14658b0150a8 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:05:55.113493 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722714e-87af-4a4d-b2dc-6ebeadab3c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:05:55.114450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722714e-87af-4a4d-b2dc-6ebeadab3c92 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:05:55.114762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722714e-87af-4a4d-b2dc-6ebeadab3c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:05:55.115036 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722714e-87af-4a4d-b2dc-6ebeadab3c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:05:55.115752 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722714e-87af-4a4d-b2dc-6ebeadab3c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:05:55.117329 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722714e-87af-4a4d-b2dc-6ebeadab3c92 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:05:55.130499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 760/1501] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:05:55.134400 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb836c7-99db-4023-91c5-ea70d03a1845 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:05:55.144722 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb836c7-99db-4023-91c5-ea70d03a1845 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:05:55.149204 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919f0c9-1c9a-4336-a958-74b487fce441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:05:55.150059 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919f0c9-1c9a-4336-a958-74b487fce441 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:05:55.150339 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919f0c9-1c9a-4336-a958-74b487fce441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:05:55.150613 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919f0c9-1c9a-4336-a958-74b487fce441 admin admin] PATH_INFO: `/v3/projects/31c1d8bb1a36437a970c2e2fd971b004/users/219cfc19cc544a1484fb45654cc09cc7/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:05:55.165560 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919f0c9-1c9a-4336-a958-74b487fce441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c1d8bb1a36437a970c2e2fd971b004, user_id=219cfc19cc544a1484fb45654cc09cc7, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:05:55.168205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919f0c9-1c9a-4336-a958-74b487fce441 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:05:55.252702 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 742/1502] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:05:55 2022] PUT /identity/v3/projects/31c1d8bb1a36437a970c2e2fd971b004/users/219cfc19cc544a1484fb45654cc09cc7/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:05:55.264911 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9065ef0-a719-4add-a12b-f92e65199589 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:05:55.265194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9065ef0-a719-4add-a12b-f92e65199589 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:05:55.265474 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9065ef0-a719-4add-a12b-f92e65199589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:05:55.292008 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-e9065ef0-a719-4add-a12b-f92e65199589 None None] MFA Rules not processed for user `219cfc19cc544a1484fb45654cc09cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:05:55.293209 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e9065ef0-a719-4add-a12b-f92e65199589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:05:55.354182 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 761/1503] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:05:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:05:55.366015 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919f0c9-1c9a-4336-a958-74b487fce441 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:05:55.433432 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919f0c9-1c9a-4336-a958-74b487fce441 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:05:55.439752 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a300ea-5feb-4aad-8e5e-7daada932af1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:05:55.440413 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a300ea-5feb-4aad-8e5e-7daada932af1 service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:05:55.440696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a300ea-5feb-4aad-8e5e-7daada932af1 service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:05:55.440973 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a300ea-5feb-4aad-8e5e-7daada932af1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:05:55.448882 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a300ea-5feb-4aad-8e5e-7daada932af1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:05:55.450456 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a300ea-5feb-4aad-8e5e-7daada932af1 service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:05:55.459720 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 743/1504] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:05:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:05:55.528952 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dd1e3-6119-4663-90a5-5d2cd1894b01 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:05:55.528952 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dd1e3-6119-4663-90a5-5d2cd1894b01 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:05:55.529158 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dd1e3-6119-4663-90a5-5d2cd1894b01 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:05:55.530746 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 762/1505] 10.222.0.42 () {52 vars in 829 bytes} [Wed Feb 16 17:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:05:55.534535 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a300ea-5feb-4aad-8e5e-7daada932af1 service nova] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:05:55.594980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a300ea-5feb-4aad-8e5e-7daada932af1 service nova] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:05:55.599541 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ab9f4-b106-43b7-b631-2e6c017839f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:05:55.600385 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ab9f4-b106-43b7-b631-2e6c017839f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:05:55.600660 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ab9f4-b106-43b7-b631-2e6c017839f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:05:55.600929 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ab9f4-b106-43b7-b631-2e6c017839f4 admin admin] PATH_INFO: `/v3/users/219cfc19cc544a1484fb45654cc09cc7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:05:55.602098 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ab9f4-b106-43b7-b631-2e6c017839f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=219cfc19cc544a1484fb45654cc09cc7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:05:55.603145 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING py.warnings [None req-171ab9f4-b106-43b7-b631-2e6c017839f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 17:05:55.603145 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: warnings.warn(msg) Feb 16 17:05:55.603145 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: Feb 16 17:05:55.604340 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ab9f4-b106-43b7-b631-2e6c017839f4 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:05:55.816852 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-171ab9f4-b106-43b7-b631-2e6c017839f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '219cfc19cc544a1484fb45654cc09cc7'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:05:55.817457 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-171ab9f4-b106-43b7-b631-2e6c017839f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '219cfc19cc544a1484fb45654cc09cc7'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:05:55.835656 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-171ab9f4-b106-43b7-b631-2e6c017839f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '219cfc19cc544a1484fb45654cc09cc7'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:05:55.849250 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-171ab9f4-b106-43b7-b631-2e6c017839f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '219cfc19cc544a1484fb45654cc09cc7'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:05:55.921278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-171ab9f4-b106-43b7-b631-2e6c017839f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '219cfc19cc544a1484fb45654cc09cc7'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:05:55.928604 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 744/1506] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:05:55 2022] DELETE /identity/v3/users/219cfc19cc544a1484fb45654cc09cc7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:05:55.933155 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db28c4-6600-4b32-89b0-76801d0efec0 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:05:55.933628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db28c4-6600-4b32-89b0-76801d0efec0 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:05:55.933728 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db28c4-6600-4b32-89b0-76801d0efec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:05:55.955343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-e6db28c4-6600-4b32-89b0-76801d0efec0 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:05:55.956534 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e6db28c4-6600-4b32-89b0-76801d0efec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:05:56.013680 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 763/1507] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:05:56.023262 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ab9f4-b106-43b7-b631-2e6c017839f4 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:05:56.026820 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-171ab9f4-b106-43b7-b631-2e6c017839f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:05:56.081829 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ab9f4-b106-43b7-b631-2e6c017839f4 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:05:56.085309 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9767dc1-1944-4a17-9667-5567392b1a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:05:56.086014 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9767dc1-1944-4a17-9667-5567392b1a44 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:05:56.086330 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9767dc1-1944-4a17-9667-5567392b1a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:05:56.086603 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9767dc1-1944-4a17-9667-5567392b1a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:05:56.095979 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9767dc1-1944-4a17-9667-5567392b1a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:05:56.097448 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9767dc1-1944-4a17-9667-5567392b1a44 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:05:56.106584 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 745/1508] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:05:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:05:56.594817 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db28c4-6600-4b32-89b0-76801d0efec0 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:05:56.596478 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e6db28c4-6600-4b32-89b0-76801d0efec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:05:56.608032 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db28c4-6600-4b32-89b0-76801d0efec0 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:05:56.613138 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec14c74-bf8a-48ee-96d4-27fe3e4edcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:05:56.614260 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec14c74-bf8a-48ee-96d4-27fe3e4edcd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:05:56.614534 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec14c74-bf8a-48ee-96d4-27fe3e4edcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:05:56.614838 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec14c74-bf8a-48ee-96d4-27fe3e4edcd9 admin admin] PATH_INFO: `/v3/projects/31c1d8bb1a36437a970c2e2fd971b004` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:05:56.616026 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec14c74-bf8a-48ee-96d4-27fe3e4edcd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c1d8bb1a36437a970c2e2fd971b004)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:05:56.617057 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-5ec14c74-bf8a-48ee-96d4-27fe3e4edcd9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 17:05:56.617057 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 17:05:56.617057 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 17:05:56.618222 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec14c74-bf8a-48ee-96d4-27fe3e4edcd9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:05:56.753276 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5ec14c74-bf8a-48ee-96d4-27fe3e4edcd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c1d8bb1a36437a970c2e2fd971b004', 'request_id': 'req-5ec14c74-bf8a-48ee-96d4-27fe3e4edcd9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:05:56.821092 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5ec14c74-bf8a-48ee-96d4-27fe3e4edcd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c1d8bb1a36437a970c2e2fd971b004', 'request_id': 'req-5ec14c74-bf8a-48ee-96d4-27fe3e4edcd9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:05:56.827410 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5ec14c74-bf8a-48ee-96d4-27fe3e4edcd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c1d8bb1a36437a970c2e2fd971b004', 'request_id': 'req-5ec14c74-bf8a-48ee-96d4-27fe3e4edcd9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:05:56.846985 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5ec14c74-bf8a-48ee-96d4-27fe3e4edcd9 admin admin] The token cache is being invalidate because project 31c1d8bb1a36437a970c2e2fd971b004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:05:56.847261 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5ec14c74-bf8a-48ee-96d4-27fe3e4edcd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:05:56.848037 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5ec14c74-bf8a-48ee-96d4-27fe3e4edcd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:05:56.849589 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 764/1509] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:05:56 2022] DELETE /identity/v3/projects/31c1d8bb1a36437a970c2e2fd971b004 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:07:35.527814 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4b1c0-f9f8-41a0-b35a-baecc055d293 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:35.528411 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4b1c0-f9f8-41a0-b35a-baecc055d293 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:35.528411 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4b1c0-f9f8-41a0-b35a-baecc055d293 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:35.530152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 746/1510] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 17:07:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:07:35.535053 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b2d5d-b08a-47dc-b372-2f1ac2e8a52d None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:35.535490 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b2d5d-b08a-47dc-b372-2f1ac2e8a52d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:35.535595 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b2d5d-b08a-47dc-b372-2f1ac2e8a52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:35.554413 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-bd8b2d5d-b08a-47dc-b372-2f1ac2e8a52d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:07:35.555658 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-bd8b2d5d-b08a-47dc-b372-2f1ac2e8a52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:07:35.615105 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 765/1511] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 17:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:07:35.768910 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4b1c0-f9f8-41a0-b35a-baecc055d293 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:07:35.770792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f7d4b1c0-f9f8-41a0-b35a-baecc055d293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:07:35.842273 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4b1c0-f9f8-41a0-b35a-baecc055d293 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:07:35.847903 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbce78-48e0-4b5d-9be1-77cbf877fddc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:07:35.848545 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbce78-48e0-4b5d-9be1-77cbf877fddc service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:35.848829 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbce78-48e0-4b5d-9be1-77cbf877fddc service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:35.849135 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbce78-48e0-4b5d-9be1-77cbf877fddc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:35.857922 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbce78-48e0-4b5d-9be1-77cbf877fddc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:07:35.859528 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbce78-48e0-4b5d-9be1-77cbf877fddc service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:07:35.869759 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 747/1512] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:07:36.619731 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6caf4e6-84cf-40f7-9a8d-d145b9b99d0d None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:36.620258 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6caf4e6-84cf-40f7-9a8d-d145b9b99d0d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:36.620375 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6caf4e6-84cf-40f7-9a8d-d145b9b99d0d None None] PATH_INFO: `/v3` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:36.621564 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 766/1513] 10.222.0.105 () {54 vars in 926 bytes} [Wed Feb 16 17:07:36 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:07:36.628337 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285082-24fc-4856-b8f7-33d19ae0dc67 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:36.628748 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285082-24fc-4856-b8f7-33d19ae0dc67 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:36.628910 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285082-24fc-4856-b8f7-33d19ae0dc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:36.648352 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-b1285082-24fc-4856-b8f7-33d19ae0dc67 None None] MFA Rules not processed for user `ae711b94b32a431ab880aa8f6068ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:07:36.649478 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b1285082-24fc-4856-b8f7-33d19ae0dc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:07:36.710540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 748/1514] 10.222.0.105 () {58 vars in 1016 bytes} [Wed Feb 16 17:07:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:07:37.186903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704915b-4d23-4e4b-a344-c81fd2e5527c None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:37.187104 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704915b-4d23-4e4b-a344-c81fd2e5527c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:37.187370 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704915b-4d23-4e4b-a344-c81fd2e5527c None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:37.189207 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 767/1515] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 17:07:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:07:37.194337 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4dc62-c0be-47bd-8125-460be5bc3f64 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:37.194871 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4dc62-c0be-47bd-8125-460be5bc3f64 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:37.195183 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4dc62-c0be-47bd-8125-460be5bc3f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:37.213730 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-08e4dc62-c0be-47bd-8125-460be5bc3f64 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:07:37.214965 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-08e4dc62-c0be-47bd-8125-460be5bc3f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:07:37.222856 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 749/1516] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 17:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:07:37.377097 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704915b-4d23-4e4b-a344-c81fd2e5527c None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:07:37.391344 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704915b-4d23-4e4b-a344-c81fd2e5527c None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:07:37.396714 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a876cc-1f73-4f4b-8e0c-c61d99129d09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:07:37.397459 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a876cc-1f73-4f4b-8e0c-c61d99129d09 service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:37.397749 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a876cc-1f73-4f4b-8e0c-c61d99129d09 service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:37.398023 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a876cc-1f73-4f4b-8e0c-c61d99129d09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:37.406044 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a876cc-1f73-4f4b-8e0c-c61d99129d09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:07:37.407775 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a876cc-1f73-4f4b-8e0c-c61d99129d09 service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:07:37.417684 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 768/1517] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:07:41.043788 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29540a1d-2af3-421d-b1ae-b6c8ba2b876a None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:41.044315 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29540a1d-2af3-421d-b1ae-b6c8ba2b876a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:41.044315 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29540a1d-2af3-421d-b1ae-b6c8ba2b876a None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:41.046080 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 750/1518] 10.222.0.42 () {54 vars in 960 bytes} [Wed Feb 16 17:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:07:41.051107 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f56e8-da52-4568-bf2b-81344a13a62e None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:41.051607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f56e8-da52-4568-bf2b-81344a13a62e None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:41.051720 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f56e8-da52-4568-bf2b-81344a13a62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:41.072478 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-2c9f56e8-da52-4568-bf2b-81344a13a62e None None] MFA Rules not processed for user `ae711b94b32a431ab880aa8f6068ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:07:41.073654 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2c9f56e8-da52-4568-bf2b-81344a13a62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:07:41.081994 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 769/1519] 10.222.0.42 () {58 vars in 1057 bytes} [Wed Feb 16 17:07:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:07:41.089342 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29540a1d-2af3-421d-b1ae-b6c8ba2b876a None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:07:41.102966 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29540a1d-2af3-421d-b1ae-b6c8ba2b876a None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:07:41.107994 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1afe3ca-c924-4672-83a7-367a43da8657 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae711b94b32a431ab880aa8f6068ff25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:07:41.108612 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afe3ca-c924-4672-83a7-367a43da8657 service placement] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:41.108899 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afe3ca-c924-4672-83a7-367a43da8657 service placement] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:41.109177 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afe3ca-c924-4672-83a7-367a43da8657 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:41.117909 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1afe3ca-c924-4672-83a7-367a43da8657 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:07:41.119514 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1afe3ca-c924-4672-83a7-367a43da8657 service placement] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:07:41.128785 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 751/1520] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:07:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:07:49.125745 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00de481-cd28-4f96-ae05-7123a2f94ccd None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:49.126291 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00de481-cd28-4f96-ae05-7123a2f94ccd None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:49.126291 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00de481-cd28-4f96-ae05-7123a2f94ccd None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:49.128111 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 770/1521] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 17:07:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:07:49.133202 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3c8b3-f205-490e-aa62-bd0ecd186cef None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:49.133671 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3c8b3-f205-490e-aa62-bd0ecd186cef None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:49.133776 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3c8b3-f205-490e-aa62-bd0ecd186cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:49.152398 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-80f3c8b3-f205-490e-aa62-bd0ecd186cef None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:07:49.153590 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-80f3c8b3-f205-490e-aa62-bd0ecd186cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:07:49.161534 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 752/1522] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 17:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:07:49.313126 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00de481-cd28-4f96-ae05-7123a2f94ccd None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:07:49.327942 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00de481-cd28-4f96-ae05-7123a2f94ccd None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:07:49.333307 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c882724-700b-4e73-810b-fae570b40e56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:07:49.334551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c882724-700b-4e73-810b-fae570b40e56 service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:49.334857 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c882724-700b-4e73-810b-fae570b40e56 service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:49.335106 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c882724-700b-4e73-810b-fae570b40e56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:49.343128 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c882724-700b-4e73-810b-fae570b40e56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:07:49.344722 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c882724-700b-4e73-810b-fae570b40e56 service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:07:49.353874 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 771/1523] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:07:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:07:50.639107 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7168e2-f873-4454-aafe-3f3d2dd92a5c None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:50.639671 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7168e2-f873-4454-aafe-3f3d2dd92a5c None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:50.639671 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7168e2-f873-4454-aafe-3f3d2dd92a5c None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:50.641504 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 753/1524] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 17:07:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:07:50.647157 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1c50a-d666-4ea4-a8dd-6a3d2e42e124 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:50.647761 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1c50a-d666-4ea4-a8dd-6a3d2e42e124 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:50.647941 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1c50a-d666-4ea4-a8dd-6a3d2e42e124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:50.666583 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-adf1c50a-d666-4ea4-a8dd-6a3d2e42e124 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:07:50.667784 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-adf1c50a-d666-4ea4-a8dd-6a3d2e42e124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:07:50.675452 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 772/1525] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 17:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:07:50.830353 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7168e2-f873-4454-aafe-3f3d2dd92a5c None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:07:50.845188 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7168e2-f873-4454-aafe-3f3d2dd92a5c None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:07:50.850729 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b575f-c8e5-40c5-b8e0-dd6c998333e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:07:50.851359 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b575f-c8e5-40c5-b8e0-dd6c998333e0 service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:50.851640 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b575f-c8e5-40c5-b8e0-dd6c998333e0 service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:50.851914 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b575f-c8e5-40c5-b8e0-dd6c998333e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:50.859919 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b575f-c8e5-40c5-b8e0-dd6c998333e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:07:50.861480 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b575f-c8e5-40c5-b8e0-dd6c998333e0 service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:07:50.871096 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 754/1526] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:07:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:07:55.236145 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfb961-9cbe-4c9d-af78-a7e1ebc27cb7 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:55.236708 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfb961-9cbe-4c9d-af78-a7e1ebc27cb7 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:55.236708 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfb961-9cbe-4c9d-af78-a7e1ebc27cb7 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:55.238516 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 773/1527] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 17:07:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:07:55.244431 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d3d89-9fb9-4284-a0b5-89c737c3f57c None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:55.244834 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d3d89-9fb9-4284-a0b5-89c737c3f57c None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:55.244982 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d3d89-9fb9-4284-a0b5-89c737c3f57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:55.263275 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-791d3d89-9fb9-4284-a0b5-89c737c3f57c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:07:55.264479 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-791d3d89-9fb9-4284-a0b5-89c737c3f57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:07:55.272297 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 755/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 17:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:07:55.308516 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfb961-9cbe-4c9d-af78-a7e1ebc27cb7 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:07:55.310210 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0ecfb961-9cbe-4c9d-af78-a7e1ebc27cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:07:55.367582 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfb961-9cbe-4c9d-af78-a7e1ebc27cb7 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:07:55.371709 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa3b31-ed7b-4f8b-a6dc-469087944029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:07:55.372355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa3b31-ed7b-4f8b-a6dc-469087944029 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:55.372636 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa3b31-ed7b-4f8b-a6dc-469087944029 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:55.372913 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa3b31-ed7b-4f8b-a6dc-469087944029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:55.382546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa3b31-ed7b-4f8b-a6dc-469087944029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:07:55.384009 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa3b31-ed7b-4f8b-a6dc-469087944029 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:07:55.393105 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 774/1529] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:07:57.713919 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1ab67-56c2-44fa-a3cf-1ae301fa113d None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:57.714551 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1ab67-56c2-44fa-a3cf-1ae301fa113d None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:57.714551 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1ab67-56c2-44fa-a3cf-1ae301fa113d None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:57.716268 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 756/1530] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 17:07:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:07:57.721392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b526fe-bb61-4c76-98a4-23d2bd4da089 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:57.721826 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b526fe-bb61-4c76-98a4-23d2bd4da089 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:57.721932 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b526fe-bb61-4c76-98a4-23d2bd4da089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:57.739927 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-08b526fe-bb61-4c76-98a4-23d2bd4da089 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:07:57.741551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-08b526fe-bb61-4c76-98a4-23d2bd4da089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:07:57.749317 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 775/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 17:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:07:57.784754 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1ab67-56c2-44fa-a3cf-1ae301fa113d None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:07:57.796969 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1ab67-56c2-44fa-a3cf-1ae301fa113d None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:07:57.800543 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3b76b-2c1b-4203-97ce-8c8ead729b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:07:57.801172 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3b76b-2c1b-4203-97ce-8c8ead729b8d service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:07:57.801455 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3b76b-2c1b-4203-97ce-8c8ead729b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:07:57.801726 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3b76b-2c1b-4203-97ce-8c8ead729b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:07:57.811365 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3b76b-2c1b-4203-97ce-8c8ead729b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:07:57.812777 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3b76b-2c1b-4203-97ce-8c8ead729b8d service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:07:57.823093 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 757/1532] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:08:01.618983 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84c84a-45bc-4be3-8634-e08266d34db8 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:08:01.619527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84c84a-45bc-4be3-8634-e08266d34db8 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:08:01.619527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84c84a-45bc-4be3-8634-e08266d34db8 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:08:01.621357 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 776/1533] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 17:08:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:08:01.626495 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337ae0f-1d94-464b-88bd-df7815b73f0a None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:08:01.626967 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337ae0f-1d94-464b-88bd-df7815b73f0a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:08:01.627064 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337ae0f-1d94-464b-88bd-df7815b73f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:08:01.644999 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-6337ae0f-1d94-464b-88bd-df7815b73f0a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:08:01.646173 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6337ae0f-1d94-464b-88bd-df7815b73f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:08:01.654466 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 758/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 17:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:08:01.923150 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84c84a-45bc-4be3-8634-e08266d34db8 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:08:01.924921 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8f84c84a-45bc-4be3-8634-e08266d34db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:08:01.981804 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84c84a-45bc-4be3-8634-e08266d34db8 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:08:01.985391 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f109b-8566-4e5e-986e-73522e603613 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:08:01.986025 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f109b-8566-4e5e-986e-73522e603613 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:08:01.986310 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f109b-8566-4e5e-986e-73522e603613 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:08:01.986583 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f109b-8566-4e5e-986e-73522e603613 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:08:01.996475 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f109b-8566-4e5e-986e-73522e603613 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:08:01.997903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f109b-8566-4e5e-986e-73522e603613 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:08:02.008136 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 777/1535] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:08:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:08:04.392780 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dd429-3c38-43e0-8006-fed311bb6b2e None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:08:04.393346 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dd429-3c38-43e0-8006-fed311bb6b2e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:08:04.393346 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dd429-3c38-43e0-8006-fed311bb6b2e None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:08:04.395154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 759/1536] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 17:08:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:08:04.401210 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b2f3e-d8a2-4211-a15d-a57c226a2845 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:08:04.401613 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b2f3e-d8a2-4211-a15d-a57c226a2845 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:08:04.401761 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b2f3e-d8a2-4211-a15d-a57c226a2845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:08:04.420279 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-0b8b2f3e-d8a2-4211-a15d-a57c226a2845 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:08:04.421472 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0b8b2f3e-d8a2-4211-a15d-a57c226a2845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:08:04.429313 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 778/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 17:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:08:04.685947 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f81ed7-4f02-4555-9512-be7b83b5752d None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:08:04.686267 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f81ed7-4f02-4555-9512-be7b83b5752d None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:08:04.686487 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f81ed7-4f02-4555-9512-be7b83b5752d None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:08:04.688252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 760/1538] 10.222.0.42 () {54 vars in 963 bytes} [Wed Feb 16 17:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:08:04.693253 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c1602-c7ea-409e-90ec-8e9551e0678c None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:08:04.693547 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c1602-c7ea-409e-90ec-8e9551e0678c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:08:04.693827 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c1602-c7ea-409e-90ec-8e9551e0678c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:08:04.713286 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-689c1602-c7ea-409e-90ec-8e9551e0678c None None] MFA Rules not processed for user `07ca3e2a770f463a95dfb045ffd51dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:08:04.714465 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-689c1602-c7ea-409e-90ec-8e9551e0678c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:08:04.720957 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 779/1539] 10.222.0.42 () {58 vars in 1060 bytes} [Wed Feb 16 17:08:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:08:04.728507 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f81ed7-4f02-4555-9512-be7b83b5752d None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:08:04.738836 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f81ed7-4f02-4555-9512-be7b83b5752d None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:08:04.742669 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba9e7d-6cb3-4457-a897-cf2522333d08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:08:04.743292 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba9e7d-6cb3-4457-a897-cf2522333d08 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:08:04.743569 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba9e7d-6cb3-4457-a897-cf2522333d08 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:08:04.743838 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba9e7d-6cb3-4457-a897-cf2522333d08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:08:04.752599 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba9e7d-6cb3-4457-a897-cf2522333d08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:08:04.754020 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba9e7d-6cb3-4457-a897-cf2522333d08 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:08:04.764123 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 761/1540] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:08:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:29.274607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5589f-a80a-459f-b4fb-b5a4f2682823 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:29.276385 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5589f-a80a-459f-b4fb-b5a4f2682823 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:29.277296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5589f-a80a-459f-b4fb-b5a4f2682823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:29.317775 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-a0c5589f-a80a-459f-b4fb-b5a4f2682823 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:29.320333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a0c5589f-a80a-459f-b4fb-b5a4f2682823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:29.340098 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 780/1541] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:29.349750 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b6c46-63c6-4211-b2b8-0e28c059c1be None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:29.350587 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b6c46-63c6-4211-b2b8-0e28c059c1be None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:29.350587 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b6c46-63c6-4211-b2b8-0e28c059c1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:29.384778 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-df3b6c46-63c6-4211-b2b8-0e28c059c1be None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:29.386012 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-df3b6c46-63c6-4211-b2b8-0e28c059c1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:29.400030 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 762/1542] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:29.405072 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5589f-a80a-459f-b4fb-b5a4f2682823 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:29.417047 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5589f-a80a-459f-b4fb-b5a4f2682823 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:29.428017 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c55ee-57fb-4c74-aa9e-9aee8a432e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:29.429265 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c55ee-57fb-4c74-aa9e-9aee8a432e7b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:29.429793 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c55ee-57fb-4c74-aa9e-9aee8a432e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:29.430291 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c55ee-57fb-4c74-aa9e-9aee8a432e7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:29.431332 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c55ee-57fb-4c74-aa9e-9aee8a432e7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:09:29.435748 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c55ee-57fb-4c74-aa9e-9aee8a432e7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:29.435748 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c55ee-57fb-4c74-aa9e-9aee8a432e7b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:29.447615 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 781/1543] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:09:29.456994 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b6c46-63c6-4211-b2b8-0e28c059c1be None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:29.472325 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b6c46-63c6-4211-b2b8-0e28c059c1be None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:29.482795 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336d80d-e2d3-402e-ae1e-25df4daf4421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:29.483471 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336d80d-e2d3-402e-ae1e-25df4daf4421 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:29.484072 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336d80d-e2d3-402e-ae1e-25df4daf4421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:29.484486 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336d80d-e2d3-402e-ae1e-25df4daf4421 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:29.485363 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336d80d-e2d3-402e-ae1e-25df4daf4421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:29.487340 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336d80d-e2d3-402e-ae1e-25df4daf4421 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:29.597412 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 763/1544] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:29 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:29.601636 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c55ee-57fb-4c74-aa9e-9aee8a432e7b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:29.616343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c55ee-57fb-4c74-aa9e-9aee8a432e7b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:29.693528 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a3a6f-981b-416f-a68a-8fe81ee824f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:29.694805 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a3a6f-981b-416f-a68a-8fe81ee824f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:29.695374 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a3a6f-981b-416f-a68a-8fe81ee824f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:29.695888 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a3a6f-981b-416f-a68a-8fe81ee824f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:29.696863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a3a6f-981b-416f-a68a-8fe81ee824f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:29.699106 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a3a6f-981b-416f-a68a-8fe81ee824f8 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:29.834454 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 782/1545] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:29 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:29.839376 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336d80d-e2d3-402e-ae1e-25df4daf4421 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:29.856141 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336d80d-e2d3-402e-ae1e-25df4daf4421 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:29.863726 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8e022-75a4-455d-97bc-c2706c171942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:29.864524 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8e022-75a4-455d-97bc-c2706c171942 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:29.864816 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8e022-75a4-455d-97bc-c2706c171942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:29.865099 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8e022-75a4-455d-97bc-c2706c171942 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:29.866096 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8e022-75a4-455d-97bc-c2706c171942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:29.867735 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8e022-75a4-455d-97bc-c2706c171942 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:29.884831 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 764/1546] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:29.889258 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a3a6f-981b-416f-a68a-8fe81ee824f8 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:29.904592 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a3a6f-981b-416f-a68a-8fe81ee824f8 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:29.913120 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de71124-610a-4b52-b310-8696b43ff9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:29.914237 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de71124-610a-4b52-b310-8696b43ff9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:29.914780 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de71124-610a-4b52-b310-8696b43ff9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:29.915289 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de71124-610a-4b52-b310-8696b43ff9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:29.916232 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de71124-610a-4b52-b310-8696b43ff9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:29.918176 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de71124-610a-4b52-b310-8696b43ff9e0 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:29.921473 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834fc89-e43f-4874-b525-f94669aaa4ba None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:29.921798 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834fc89-e43f-4874-b525-f94669aaa4ba None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:29.922082 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834fc89-e43f-4874-b525-f94669aaa4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:29.933205 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 783/1547] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:29.937026 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de71124-610a-4b52-b310-8696b43ff9e0 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:29.950546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de71124-610a-4b52-b310-8696b43ff9e0 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:29.962907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-d834fc89-e43f-4874-b525-f94669aaa4ba None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:29.963474 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3742d-597c-46e1-8f7b-15d0726f4c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:29.964130 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d834fc89-e43f-4874-b525-f94669aaa4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:29.964849 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3742d-597c-46e1-8f7b-15d0726f4c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:29.965458 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3742d-597c-46e1-8f7b-15d0726f4c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:29.965964 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3742d-597c-46e1-8f7b-15d0726f4c8d admin admin] PATH_INFO: `/v3/projects/b66bc589cf454cc2a4008c1f03209923/users/627d03a71fcb47aca3bd86e4b422df87/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:29.978511 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 765/1548] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:09:29.985219 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3742d-597c-46e1-8f7b-15d0726f4c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66bc589cf454cc2a4008c1f03209923, user_id=627d03a71fcb47aca3bd86e4b422df87, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:29.988156 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2abc9-32cd-4611-8737-08afa7dbcd5e None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:29.988442 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2abc9-32cd-4611-8737-08afa7dbcd5e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:29.988723 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2abc9-32cd-4611-8737-08afa7dbcd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:29.989327 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3742d-597c-46e1-8f7b-15d0726f4c8d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:30.028950 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-a7d2abc9-32cd-4611-8737-08afa7dbcd5e None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:30.030175 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-a7d2abc9-32cd-4611-8737-08afa7dbcd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:30.039684 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 766/1549] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:09:30.044952 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2abc9-32cd-4611-8737-08afa7dbcd5e None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:30.059942 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2abc9-32cd-4611-8737-08afa7dbcd5e None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:30.070044 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f75fcc-9c2b-4474-9d66-7c9fa166ec22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:30.071520 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f75fcc-9c2b-4474-9d66-7c9fa166ec22 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.071520 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f75fcc-9c2b-4474-9d66-7c9fa166ec22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.071520 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f75fcc-9c2b-4474-9d66-7c9fa166ec22 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.072042 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f75fcc-9c2b-4474-9d66-7c9fa166ec22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:09:30.072284 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f75fcc-9c2b-4474-9d66-7c9fa166ec22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:30.073870 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f75fcc-9c2b-4474-9d66-7c9fa166ec22 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:30.079138 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 784/1550] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:29 2022] PUT /identity/v3/projects/b66bc589cf454cc2a4008c1f03209923/users/627d03a71fcb47aca3bd86e4b422df87/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:09:30.090270 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 767/1551] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 17:09:30.092041 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5766b9-e136-4a2a-b254-20610a323da3 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.092760 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5766b9-e136-4a2a-b254-20610a323da3 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.093906 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5766b9-e136-4a2a-b254-20610a323da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.099448 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f75fcc-9c2b-4474-9d66-7c9fa166ec22 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:30.113207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f75fcc-9c2b-4474-9d66-7c9fa166ec22 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:30.150384 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-af5766b9-e136-4a2a-b254-20610a323da3 None None] MFA Rules not processed for user `627d03a71fcb47aca3bd86e4b422df87`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:30.152158 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-af5766b9-e136-4a2a-b254-20610a323da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:30.267785 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 785/1552] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:09:30.270949 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f2a54-1b5a-4fdb-a9b2-4c89a6882b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:30.272070 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5766b9-e136-4a2a-b254-20610a323da3 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:30.272385 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f2a54-1b5a-4fdb-a9b2-4c89a6882b41 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.272815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f2a54-1b5a-4fdb-a9b2-4c89a6882b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.273093 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f2a54-1b5a-4fdb-a9b2-4c89a6882b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.273934 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f2a54-1b5a-4fdb-a9b2-4c89a6882b41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:30.275918 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f2a54-1b5a-4fdb-a9b2-4c89a6882b41 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:30.287907 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5766b9-e136-4a2a-b254-20610a323da3 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:30.300756 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34ad89-9ecf-4f90-bdac-cdc2297f681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:30.301880 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34ad89-9ecf-4f90-bdac-cdc2297f681a admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.302408 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34ad89-9ecf-4f90-bdac-cdc2297f681a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.302956 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34ad89-9ecf-4f90-bdac-cdc2297f681a admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.303911 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34ad89-9ecf-4f90-bdac-cdc2297f681a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:30.306518 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34ad89-9ecf-4f90-bdac-cdc2297f681a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:30.417702 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 768/1553] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:30 2022] POST /identity/v3/projects => generated 389 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:09:30.462992 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1cda5-9536-4016-b46f-1f2f5cf3df9d None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.462992 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1cda5-9536-4016-b46f-1f2f5cf3df9d None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.462992 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1cda5-9536-4016-b46f-1f2f5cf3df9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.462992 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-6fc1cda5-9536-4016-b46f-1f2f5cf3df9d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:30.462992 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6fc1cda5-9536-4016-b46f-1f2f5cf3df9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:30.480589 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 786/1554] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:30 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:09:30.482864 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80a271-5d20-4270-abf5-7dfcf2b97dba None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.483446 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80a271-5d20-4270-abf5-7dfcf2b97dba None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.484585 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80a271-5d20-4270-abf5-7dfcf2b97dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.510002 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-da80a271-5d20-4270-abf5-7dfcf2b97dba None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:30.511862 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-da80a271-5d20-4270-abf5-7dfcf2b97dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:30.524887 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 769/1555] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:30.533100 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1cda5-9536-4016-b46f-1f2f5cf3df9d None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:30.545964 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1cda5-9536-4016-b46f-1f2f5cf3df9d None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:30.613330 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 787/1556] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:30.615170 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33138c83-041e-4722-8222-d506333d7e1f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.616144 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33138c83-041e-4722-8222-d506333d7e1f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.616663 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33138c83-041e-4722-8222-d506333d7e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.630476 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ee4f5-60b4-44fc-82bf-4063763f62f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:30.631443 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ee4f5-60b4-44fc-82bf-4063763f62f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.631733 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ee4f5-60b4-44fc-82bf-4063763f62f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.632152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ee4f5-60b4-44fc-82bf-4063763f62f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.633709 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ee4f5-60b4-44fc-82bf-4063763f62f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:30.635541 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ee4f5-60b4-44fc-82bf-4063763f62f6 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:30.640344 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-33138c83-041e-4722-8222-d506333d7e1f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:30.642178 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-33138c83-041e-4722-8222-d506333d7e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:30.658071 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 788/1557] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:30.659782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdddd54-f00e-40c6-a818-87168f4faa8c None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.664485 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdddd54-f00e-40c6-a818-87168f4faa8c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.664485 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdddd54-f00e-40c6-a818-87168f4faa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.680123 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-5fdddd54-f00e-40c6-a818-87168f4faa8c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:30.681289 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5fdddd54-f00e-40c6-a818-87168f4faa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:30.690410 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 789/1558] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:30.692046 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdddd54-f00e-40c6-a818-87168f4faa8c None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:30.700412 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdddd54-f00e-40c6-a818-87168f4faa8c None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:30.705747 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea2642-8f62-4d1f-842e-33e4af5d5f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:30.706407 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea2642-8f62-4d1f-842e-33e4af5d5f3a admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.706712 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea2642-8f62-4d1f-842e-33e4af5d5f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.706985 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea2642-8f62-4d1f-842e-33e4af5d5f3a admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.707887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea2642-8f62-4d1f-842e-33e4af5d5f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:30.709809 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea2642-8f62-4d1f-842e-33e4af5d5f3a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:30.747278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 770/1559] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:30 2022] POST /identity/v3/users => generated 295 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:30.748708 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf922e-8fe7-4534-b02e-ec0c3796c2e7 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.749005 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf922e-8fe7-4534-b02e-ec0c3796c2e7 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.749284 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf922e-8fe7-4534-b02e-ec0c3796c2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.767127 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-edaf922e-8fe7-4534-b02e-ec0c3796c2e7 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:30.768310 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-edaf922e-8fe7-4534-b02e-ec0c3796c2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:30.776242 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 771/1560] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:30.777519 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148147f-47ad-493c-a4cd-dd4422ad2c5b None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.777806 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148147f-47ad-493c-a4cd-dd4422ad2c5b None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.778085 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148147f-47ad-493c-a4cd-dd4422ad2c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.795461 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-5148147f-47ad-493c-a4cd-dd4422ad2c5b None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:30.797133 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-5148147f-47ad-493c-a4cd-dd4422ad2c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:30.804750 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 772/1561] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:30.806089 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55a639-7dd7-41a1-a0b3-fadfe42cadbe None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.806344 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55a639-7dd7-41a1-a0b3-fadfe42cadbe None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.806621 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55a639-7dd7-41a1-a0b3-fadfe42cadbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.824449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 790/1562] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:30 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:30.824449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cf76d-c4bc-4c40-9e06-d0e829b69d73 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.824449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cf76d-c4bc-4c40-9e06-d0e829b69d73 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.824449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cf76d-c4bc-4c40-9e06-d0e829b69d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.824873 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-3e55a639-7dd7-41a1-a0b3-fadfe42cadbe None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:30.825963 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-3e55a639-7dd7-41a1-a0b3-fadfe42cadbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:30.833931 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 773/1563] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:30.836006 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3b044-eba3-476a-a605-cbf53276d473 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.836507 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3b044-eba3-476a-a605-cbf53276d473 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.836794 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3b044-eba3-476a-a605-cbf53276d473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.842394 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-7a4cf76d-c4bc-4c40-9e06-d0e829b69d73 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:30.844630 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-7a4cf76d-c4bc-4c40-9e06-d0e829b69d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:30.852490 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 791/1564] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:30.853742 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b83f76-074d-46c7-aabb-7e578d9bde49 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.854026 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b83f76-074d-46c7-aabb-7e578d9bde49 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.854309 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b83f76-074d-46c7-aabb-7e578d9bde49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.855523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-9fa3b044-eba3-476a-a605-cbf53276d473 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:30.856811 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-9fa3b044-eba3-476a-a605-cbf53276d473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:30.865387 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 774/1565] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:30.866439 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3b044-eba3-476a-a605-cbf53276d473 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:30.873597 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-70b83f76-074d-46c7-aabb-7e578d9bde49 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:30.875137 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-70b83f76-074d-46c7-aabb-7e578d9bde49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:30.875786 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3b044-eba3-476a-a605-cbf53276d473 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:30.880226 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a9479-faf9-4eb6-959c-3d4d7fe3b80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:30.880863 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a9479-faf9-4eb6-959c-3d4d7fe3b80e admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.881136 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a9479-faf9-4eb6-959c-3d4d7fe3b80e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.881406 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a9479-faf9-4eb6-959c-3d4d7fe3b80e admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.882113 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a9479-faf9-4eb6-959c-3d4d7fe3b80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:30.883265 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 792/1566] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:30.883716 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a9479-faf9-4eb6-959c-3d4d7fe3b80e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:30.884150 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b83f76-074d-46c7-aabb-7e578d9bde49 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:30.893974 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 775/1567] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:30.894155 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b83f76-074d-46c7-aabb-7e578d9bde49 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:30.894667 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a9479-faf9-4eb6-959c-3d4d7fe3b80e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:30.900202 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b22d4-4b4d-4eb0-b40d-c0d69ab1b549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:30.900856 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b22d4-4b4d-4eb0-b40d-c0d69ab1b549 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.901139 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b22d4-4b4d-4eb0-b40d-c0d69ab1b549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.901409 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b22d4-4b4d-4eb0-b40d-c0d69ab1b549 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.902119 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b22d4-4b4d-4eb0-b40d-c0d69ab1b549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:09:30.902422 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b22d4-4b4d-4eb0-b40d-c0d69ab1b549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:30.904075 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b22d4-4b4d-4eb0-b40d-c0d69ab1b549 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:30.905052 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a9479-faf9-4eb6-959c-3d4d7fe3b80e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:30.910413 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586558db-6e44-4303-8d42-290bcc6db5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:30.911068 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586558db-6e44-4303-8d42-290bcc6db5ac admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.911346 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586558db-6e44-4303-8d42-290bcc6db5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.911615 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586558db-6e44-4303-8d42-290bcc6db5ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.912311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586558db-6e44-4303-8d42-290bcc6db5ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:09:30.912607 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586558db-6e44-4303-8d42-290bcc6db5ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:30.914164 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586558db-6e44-4303-8d42-290bcc6db5ac admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:30.916446 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 793/1568] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:09:30.917313 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b22d4-4b4d-4eb0-b40d-c0d69ab1b549 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:30.927718 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b22d4-4b4d-4eb0-b40d-c0d69ab1b549 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:30.929169 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 776/1569] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:09:30.932177 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf1559-53d4-4cc9-a70b-9770cbc4abaf None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.932315 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0a1cf-f9fb-4bec-ab71-5c15984973a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:30.932757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf1559-53d4-4cc9-a70b-9770cbc4abaf None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.932952 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0a1cf-f9fb-4bec-ab71-5c15984973a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.933241 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0a1cf-f9fb-4bec-ab71-5c15984973a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.933356 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf1559-53d4-4cc9-a70b-9770cbc4abaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.933509 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0a1cf-f9fb-4bec-ab71-5c15984973a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.934346 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0a1cf-f9fb-4bec-ab71-5c15984973a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:30.935967 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0a1cf-f9fb-4bec-ab71-5c15984973a6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:30.947076 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 794/1570] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:30.947880 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0a1cf-f9fb-4bec-ab71-5c15984973a6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:30.953174 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-ccbf1559-53d4-4cc9-a70b-9770cbc4abaf None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:30.954352 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-ccbf1559-53d4-4cc9-a70b-9770cbc4abaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:30.957641 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0a1cf-f9fb-4bec-ab71-5c15984973a6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:30.962081 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 777/1571] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:30.962374 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3a2ed-50f6-453e-b016-ba267cc291ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:30.963061 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3a2ed-50f6-453e-b016-ba267cc291ed admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.963351 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3a2ed-50f6-453e-b016-ba267cc291ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.963732 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3a2ed-50f6-453e-b016-ba267cc291ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.963850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf1559-53d4-4cc9-a70b-9770cbc4abaf None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:30.964486 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3a2ed-50f6-453e-b016-ba267cc291ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:09:30.964793 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3a2ed-50f6-453e-b016-ba267cc291ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:30.966510 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3a2ed-50f6-453e-b016-ba267cc291ed admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:30.973847 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf1559-53d4-4cc9-a70b-9770cbc4abaf None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:30.978389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599df61-fd5a-4ad2-8481-5606b171b295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:30.979153 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 795/1572] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:09:30.979292 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599df61-fd5a-4ad2-8481-5606b171b295 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.979590 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599df61-fd5a-4ad2-8481-5606b171b295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.979872 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599df61-fd5a-4ad2-8481-5606b171b295 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.980279 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c1a84-1976-4146-aadd-bb6a573f4a2d None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:30.980669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c1a84-1976-4146-aadd-bb6a573f4a2d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:30.980774 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599df61-fd5a-4ad2-8481-5606b171b295 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:09:30.980951 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c1a84-1976-4146-aadd-bb6a573f4a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:30.981080 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599df61-fd5a-4ad2-8481-5606b171b295 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:30.982690 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599df61-fd5a-4ad2-8481-5606b171b295 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:30.995418 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 778/1573] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:09:30.996153 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599df61-fd5a-4ad2-8481-5606b171b295 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:30.999127 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-b29c1a84-1976-4146-aadd-bb6a573f4a2d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:31.000551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-b29c1a84-1976-4146-aadd-bb6a573f4a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:31.006092 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599df61-fd5a-4ad2-8481-5606b171b295 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:31.008903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 796/1574] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:31.011145 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6bd09-85fe-4912-b5e6-2563d9fe77a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:31.011559 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c1a84-1976-4146-aadd-bb6a573f4a2d None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:31.011782 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6bd09-85fe-4912-b5e6-2563d9fe77a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:31.012060 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6bd09-85fe-4912-b5e6-2563d9fe77a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:31.012493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6bd09-85fe-4912-b5e6-2563d9fe77a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:31.013036 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6bd09-85fe-4912-b5e6-2563d9fe77a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:31.014590 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6bd09-85fe-4912-b5e6-2563d9fe77a8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:31.021308 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c1a84-1976-4146-aadd-bb6a573f4a2d None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:31.025131 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 779/1575] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:31.025913 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc70a1-409e-42d2-be1b-c232e54ad001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:31.026153 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6bd09-85fe-4912-b5e6-2563d9fe77a8 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:31.026615 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc70a1-409e-42d2-be1b-c232e54ad001 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:31.026945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc70a1-409e-42d2-be1b-c232e54ad001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:31.027161 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc70a1-409e-42d2-be1b-c232e54ad001 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:31.027846 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc70a1-409e-42d2-be1b-c232e54ad001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:31.029903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc70a1-409e-42d2-be1b-c232e54ad001 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:31.036199 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6bd09-85fe-4912-b5e6-2563d9fe77a8 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:31.041082 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0aac2a-c27d-49a0-98ae-4addd4e6732f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:31.041841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0aac2a-c27d-49a0-98ae-4addd4e6732f admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:31.042134 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0aac2a-c27d-49a0-98ae-4addd4e6732f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:31.042411 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0aac2a-c27d-49a0-98ae-4addd4e6732f admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:31.043260 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0aac2a-c27d-49a0-98ae-4addd4e6732f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:31.045241 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0aac2a-c27d-49a0-98ae-4addd4e6732f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:31.099938 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 797/1576] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:31 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:31.100949 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc70a1-409e-42d2-be1b-c232e54ad001 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:31.131034 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 780/1577] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:31 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:31.131034 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0aac2a-c27d-49a0-98ae-4addd4e6732f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:31.160886 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc70a1-409e-42d2-be1b-c232e54ad001 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:31.187483 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0aac2a-c27d-49a0-98ae-4addd4e6732f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:31.192082 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69b4f5-4e32-4d7e-83e7-72d08377a113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:31.192732 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69b4f5-4e32-4d7e-83e7-72d08377a113 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:31.193009 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69b4f5-4e32-4d7e-83e7-72d08377a113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:31.193281 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69b4f5-4e32-4d7e-83e7-72d08377a113 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:31.193987 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69b4f5-4e32-4d7e-83e7-72d08377a113 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:09:31.194286 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69b4f5-4e32-4d7e-83e7-72d08377a113 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:31.195886 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69b4f5-4e32-4d7e-83e7-72d08377a113 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:31.207193 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 781/1578] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:09:31.207987 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69b4f5-4e32-4d7e-83e7-72d08377a113 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:31.215243 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760bb9d-e983-4333-bc08-ee98b2520aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:31.216242 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760bb9d-e983-4333-bc08-ee98b2520aac admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:31.216521 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760bb9d-e983-4333-bc08-ee98b2520aac admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:31.216791 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760bb9d-e983-4333-bc08-ee98b2520aac admin admin] PATH_INFO: `/v3/projects/35895395a16b4ac29f20e001201e6ffa/users/9612415aa89341c1b53662ac67b2dac1/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:31.217781 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69b4f5-4e32-4d7e-83e7-72d08377a113 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:31.223932 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873af31-7774-4694-816e-b2a77ac4a047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:31.224579 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873af31-7774-4694-816e-b2a77ac4a047 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:31.224856 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873af31-7774-4694-816e-b2a77ac4a047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:31.225132 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873af31-7774-4694-816e-b2a77ac4a047 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:31.225813 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873af31-7774-4694-816e-b2a77ac4a047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:31.227731 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873af31-7774-4694-816e-b2a77ac4a047 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:31.232066 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760bb9d-e983-4333-bc08-ee98b2520aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=35895395a16b4ac29f20e001201e6ffa, user_id=9612415aa89341c1b53662ac67b2dac1, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:31.235442 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760bb9d-e983-4333-bc08-ee98b2520aac admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:31.331430 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 798/1579] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:31 2022] PUT /identity/v3/projects/35895395a16b4ac29f20e001201e6ffa/users/9612415aa89341c1b53662ac67b2dac1/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:31.332269 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760bb9d-e983-4333-bc08-ee98b2520aac admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:31.371594 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 782/1580] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:31 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:31.372716 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873af31-7774-4694-816e-b2a77ac4a047 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:31.394759 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760bb9d-e983-4333-bc08-ee98b2520aac admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:31.432353 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873af31-7774-4694-816e-b2a77ac4a047 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:31.438031 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18405fa0-8fc7-4d46-a1e6-679fa7f41493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:31.438721 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18405fa0-8fc7-4d46-a1e6-679fa7f41493 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:31.439004 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18405fa0-8fc7-4d46-a1e6-679fa7f41493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:31.439275 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18405fa0-8fc7-4d46-a1e6-679fa7f41493 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:31.439991 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18405fa0-8fc7-4d46-a1e6-679fa7f41493 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:09:31.440293 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18405fa0-8fc7-4d46-a1e6-679fa7f41493 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:31.441873 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18405fa0-8fc7-4d46-a1e6-679fa7f41493 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:31.450073 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52038e-edcb-4056-a785-6332e9571fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:31.455156 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52038e-edcb-4056-a785-6332e9571fce admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:31.455156 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52038e-edcb-4056-a785-6332e9571fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:31.455156 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52038e-edcb-4056-a785-6332e9571fce admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:31.455156 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52038e-edcb-4056-a785-6332e9571fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:31.455578 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 783/1581] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:09:31.455679 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52038e-edcb-4056-a785-6332e9571fce admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:31.455779 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18405fa0-8fc7-4d46-a1e6-679fa7f41493 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:31.469565 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18405fa0-8fc7-4d46-a1e6-679fa7f41493 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:31.474369 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47745bc6-fd13-4e0f-b8d7-3cd8d8bd361a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:31.475271 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47745bc6-fd13-4e0f-b8d7-3cd8d8bd361a admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:31.475550 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47745bc6-fd13-4e0f-b8d7-3cd8d8bd361a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:31.475822 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47745bc6-fd13-4e0f-b8d7-3cd8d8bd361a admin admin] PATH_INFO: `/v3/projects/3554a01c63b84fcc82046b45d4683c7f/users/dd1b4007dbea4e46835dcf36bdb8b727/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:31.491068 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47745bc6-fd13-4e0f-b8d7-3cd8d8bd361a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3554a01c63b84fcc82046b45d4683c7f, user_id=dd1b4007dbea4e46835dcf36bdb8b727, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:31.493686 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47745bc6-fd13-4e0f-b8d7-3cd8d8bd361a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:31.560879 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 784/1582] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:31 2022] PUT /identity/v3/projects/3554a01c63b84fcc82046b45d4683c7f/users/dd1b4007dbea4e46835dcf36bdb8b727/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:31.566349 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 799/1583] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:31 2022] POST /identity/v3/projects => generated 383 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:31.566536 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47745bc6-fd13-4e0f-b8d7-3cd8d8bd361a admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:31.566666 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52038e-edcb-4056-a785-6332e9571fce admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:31.629586 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47745bc6-fd13-4e0f-b8d7-3cd8d8bd361a admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:31.634224 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52038e-edcb-4056-a785-6332e9571fce admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:31.634504 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cd71e-67cd-423d-94b5-984404ebddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:31.635200 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cd71e-67cd-423d-94b5-984404ebddbb admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:31.635514 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cd71e-67cd-423d-94b5-984404ebddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:31.635791 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cd71e-67cd-423d-94b5-984404ebddbb admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:31.636482 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cd71e-67cd-423d-94b5-984404ebddbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:31.638413 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cd71e-67cd-423d-94b5-984404ebddbb admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:31.639063 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f638e-1563-4db4-98eb-bb17790a88d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:31.639720 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f638e-1563-4db4-98eb-bb17790a88d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:31.640007 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f638e-1563-4db4-98eb-bb17790a88d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:31.640347 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f638e-1563-4db4-98eb-bb17790a88d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:31.641056 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f638e-1563-4db4-98eb-bb17790a88d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:31.643200 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f638e-1563-4db4-98eb-bb17790a88d1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:31.748738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 785/1584] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:31 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:31.750914 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cd71e-67cd-423d-94b5-984404ebddbb admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:31.760398 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cd71e-67cd-423d-94b5-984404ebddbb admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:31.765127 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66d9ea-c135-450c-beab-9c9ce01a7604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:31.766560 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66d9ea-c135-450c-beab-9c9ce01a7604 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:31.767001 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66d9ea-c135-450c-beab-9c9ce01a7604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:31.767277 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66d9ea-c135-450c-beab-9c9ce01a7604 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:31.767965 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66d9ea-c135-450c-beab-9c9ce01a7604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:31.770075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66d9ea-c135-450c-beab-9c9ce01a7604 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:31.772285 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 800/1585] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:31 2022] POST /identity/v3/users => generated 288 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:31.773193 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f638e-1563-4db4-98eb-bb17790a88d1 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:31.783274 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f638e-1563-4db4-98eb-bb17790a88d1 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:31.787902 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7d77d-a96c-4c9f-8390-df2b46fd11dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:31.788565 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7d77d-a96c-4c9f-8390-df2b46fd11dc admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:31.788858 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7d77d-a96c-4c9f-8390-df2b46fd11dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:31.789130 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7d77d-a96c-4c9f-8390-df2b46fd11dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:31.789840 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7d77d-a96c-4c9f-8390-df2b46fd11dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:31.791525 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7d77d-a96c-4c9f-8390-df2b46fd11dc admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:31.801644 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 801/1586] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:31.802498 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7d77d-a96c-4c9f-8390-df2b46fd11dc admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:31.812763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7d77d-a96c-4c9f-8390-df2b46fd11dc admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:31.817605 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cc50c-bde3-4ac0-9ac6-b1c397c3de36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:31.818241 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cc50c-bde3-4ac0-9ac6-b1c397c3de36 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:31.818546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cc50c-bde3-4ac0-9ac6-b1c397c3de36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:31.818866 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cc50c-bde3-4ac0-9ac6-b1c397c3de36 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:31.819551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cc50c-bde3-4ac0-9ac6-b1c397c3de36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:31.821456 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cc50c-bde3-4ac0-9ac6-b1c397c3de36 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:31.850333 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 786/1587] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:31 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:31.850333 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66d9ea-c135-450c-beab-9c9ce01a7604 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:31.907872 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66d9ea-c135-450c-beab-9c9ce01a7604 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:31.912540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de3ea6-9e4e-40c9-a9bb-3ac149b6b501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:31.913193 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de3ea6-9e4e-40c9-a9bb-3ac149b6b501 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:31.915863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 802/1588] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:31 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:31.915986 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de3ea6-9e4e-40c9-a9bb-3ac149b6b501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:31.915986 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de3ea6-9e4e-40c9-a9bb-3ac149b6b501 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:31.915986 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de3ea6-9e4e-40c9-a9bb-3ac149b6b501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:31.916215 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d800398-38c7-4a05-a6db-0131b79bdb5a None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:31.916215 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d800398-38c7-4a05-a6db-0131b79bdb5a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:31.916215 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d800398-38c7-4a05-a6db-0131b79bdb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:31.917327 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de3ea6-9e4e-40c9-a9bb-3ac149b6b501 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:31.933547 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-1d800398-38c7-4a05-a6db-0131b79bdb5a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:31.934810 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-1d800398-38c7-4a05-a6db-0131b79bdb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:31.943608 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 803/1589] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:31.944380 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d800398-38c7-4a05-a6db-0131b79bdb5a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:31.954135 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d800398-38c7-4a05-a6db-0131b79bdb5a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:31.958722 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e211f5-9508-48cb-a71f-884ac3e9514c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:31.959360 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e211f5-9508-48cb-a71f-884ac3e9514c admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:31.959730 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e211f5-9508-48cb-a71f-884ac3e9514c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:31.960002 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e211f5-9508-48cb-a71f-884ac3e9514c admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:31.960673 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e211f5-9508-48cb-a71f-884ac3e9514c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:31.962599 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e211f5-9508-48cb-a71f-884ac3e9514c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.008185 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 787/1590] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:31 2022] POST /identity/v3/projects => generated 403 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:32.009154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de3ea6-9e4e-40c9-a9bb-3ac149b6b501 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.067461 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de3ea6-9e4e-40c9-a9bb-3ac149b6b501 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.072115 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b22a4-cd60-4b2f-95a0-3389ce8b4a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.072763 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b22a4-cd60-4b2f-95a0-3389ce8b4a17 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.073046 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b22a4-cd60-4b2f-95a0-3389ce8b4a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.073321 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b22a4-cd60-4b2f-95a0-3389ce8b4a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.074034 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b22a4-cd60-4b2f-95a0-3389ce8b4a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:32.075747 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b22a4-cd60-4b2f-95a0-3389ce8b4a17 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.080539 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 804/1591] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:31 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:32.081540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e211f5-9508-48cb-a71f-884ac3e9514c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.088494 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 788/1592] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:32.088494 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b22a4-cd60-4b2f-95a0-3389ce8b4a17 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.091458 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e211f5-9508-48cb-a71f-884ac3e9514c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.096582 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0e4f3-ca4d-41b6-ab1f-c570cf9f4ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.096750 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b22a4-cd60-4b2f-95a0-3389ce8b4a17 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.097229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0e4f3-ca4d-41b6-ab1f-c570cf9f4ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.097512 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0e4f3-ca4d-41b6-ab1f-c570cf9f4ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.097787 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0e4f3-ca4d-41b6-ab1f-c570cf9f4ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.098503 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0e4f3-ca4d-41b6-ab1f-c570cf9f4ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:32.100124 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0e4f3-ca4d-41b6-ab1f-c570cf9f4ca6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.101229 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7307d6-7979-4276-a1c2-9146b321d346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.102082 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7307d6-7979-4276-a1c2-9146b321d346 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.102361 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7307d6-7979-4276-a1c2-9146b321d346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.102634 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7307d6-7979-4276-a1c2-9146b321d346 admin admin] PATH_INFO: `/v3/projects/35895395a16b4ac29f20e001201e6ffa/users/9612415aa89341c1b53662ac67b2dac1/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.104622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7307d6-7979-4276-a1c2-9146b321d346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35895395a16b4ac29f20e001201e6ffa, user_id=9612415aa89341c1b53662ac67b2dac1, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:32.111906 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 805/1593] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:32.117727 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0e4f3-ca4d-41b6-ab1f-c570cf9f4ca6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.117833 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7307d6-7979-4276-a1c2-9146b321d346 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.124465 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0e4f3-ca4d-41b6-ab1f-c570cf9f4ca6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.127757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 789/1594] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:32 2022] PUT /identity/v3/projects/35895395a16b4ac29f20e001201e6ffa/users/9612415aa89341c1b53662ac67b2dac1/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:32.128632 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7307d6-7979-4276-a1c2-9146b321d346 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.180366 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66ece9-9864-485d-b6f4-041aa065a79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.180951 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66ece9-9864-485d-b6f4-041aa065a79a admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.181237 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66ece9-9864-485d-b6f4-041aa065a79a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.181513 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66ece9-9864-485d-b6f4-041aa065a79a admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.182347 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66ece9-9864-485d-b6f4-041aa065a79a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:32.184313 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66ece9-9864-485d-b6f4-041aa065a79a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.196426 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7307d6-7979-4276-a1c2-9146b321d346 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.201187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6ddd7-895f-4fe9-b6e6-0f512c09189f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.201841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6ddd7-895f-4fe9-b6e6-0f512c09189f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.202123 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6ddd7-895f-4fe9-b6e6-0f512c09189f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.202409 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6ddd7-895f-4fe9-b6e6-0f512c09189f admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.203538 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6ddd7-895f-4fe9-b6e6-0f512c09189f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:32.205204 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6ddd7-895f-4fe9-b6e6-0f512c09189f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.214912 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 790/1595] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:32.215758 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6ddd7-895f-4fe9-b6e6-0f512c09189f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.269295 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6ddd7-895f-4fe9-b6e6-0f512c09189f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.272939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ed503-79f9-474d-ae2e-dd629e810d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.273575 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ed503-79f9-474d-ae2e-dd629e810d2a service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.273858 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ed503-79f9-474d-ae2e-dd629e810d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.274130 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ed503-79f9-474d-ae2e-dd629e810d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.283431 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ed503-79f9-474d-ae2e-dd629e810d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:32.284272 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 806/1596] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:32 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:32.284965 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ed503-79f9-474d-ae2e-dd629e810d2a service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.285289 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66ece9-9864-485d-b6f4-041aa065a79a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.295066 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 791/1597] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:32.295239 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66ece9-9864-485d-b6f4-041aa065a79a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.295957 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ed503-79f9-474d-ae2e-dd629e810d2a service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.300442 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ca8e9-3c61-4958-980f-e4370444d4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.301106 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ca8e9-3c61-4958-980f-e4370444d4dd admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.301415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ca8e9-3c61-4958-980f-e4370444d4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.301647 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ca8e9-3c61-4958-980f-e4370444d4dd admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.302323 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ca8e9-3c61-4958-980f-e4370444d4dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:32.304417 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ca8e9-3c61-4958-980f-e4370444d4dd admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.305788 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ed503-79f9-474d-ae2e-dd629e810d2a service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.310612 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818783e-8ea1-4ad2-80d4-c1fcdb8fc2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.311337 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818783e-8ea1-4ad2-80d4-c1fcdb8fc2fc admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.311620 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818783e-8ea1-4ad2-80d4-c1fcdb8fc2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.312696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818783e-8ea1-4ad2-80d4-c1fcdb8fc2fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.313518 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818783e-8ea1-4ad2-80d4-c1fcdb8fc2fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:32.315136 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818783e-8ea1-4ad2-80d4-c1fcdb8fc2fc admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.325027 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 792/1598] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:32.327810 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818783e-8ea1-4ad2-80d4-c1fcdb8fc2fc admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.335166 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818783e-8ea1-4ad2-80d4-c1fcdb8fc2fc admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.339791 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0184f-767e-4fe4-9e32-ae5d60ae706e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.340403 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0184f-767e-4fe4-9e32-ae5d60ae706e admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.340681 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0184f-767e-4fe4-9e32-ae5d60ae706e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.340952 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0184f-767e-4fe4-9e32-ae5d60ae706e admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.341643 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0184f-767e-4fe4-9e32-ae5d60ae706e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:32.343788 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0184f-767e-4fe4-9e32-ae5d60ae706e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.353189 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 793/1599] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:32.356938 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0184f-767e-4fe4-9e32-ae5d60ae706e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.363581 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0184f-767e-4fe4-9e32-ae5d60ae706e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.368341 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53461ee2-41ab-4044-8acb-a5fe6de9c502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.368932 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53461ee2-41ab-4044-8acb-a5fe6de9c502 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.369212 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53461ee2-41ab-4044-8acb-a5fe6de9c502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.369485 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53461ee2-41ab-4044-8acb-a5fe6de9c502 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.370165 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53461ee2-41ab-4044-8acb-a5fe6de9c502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:32.371685 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53461ee2-41ab-4044-8acb-a5fe6de9c502 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.381282 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 794/1600] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:32.385736 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85ba75-c97c-428c-a315-876a27d6a98f None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.385736 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85ba75-c97c-428c-a315-876a27d6a98f None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.385736 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85ba75-c97c-428c-a315-876a27d6a98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.386028 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 807/1601] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:32 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:32.386028 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ca8e9-3c61-4958-980f-e4370444d4dd admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.398958 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ca8e9-3c61-4958-980f-e4370444d4dd admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.403691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c06c7-dc91-4fee-a331-d9ad20572857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.404349 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c06c7-dc91-4fee-a331-d9ad20572857 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.405339 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c06c7-dc91-4fee-a331-d9ad20572857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.405339 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c06c7-dc91-4fee-a331-d9ad20572857 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.406117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c06c7-dc91-4fee-a331-d9ad20572857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:32.407961 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c06c7-dc91-4fee-a331-d9ad20572857 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.416694 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-7a85ba75-c97c-428c-a315-876a27d6a98f None None] MFA Rules not processed for user `9612415aa89341c1b53662ac67b2dac1`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:32.417947 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-7a85ba75-c97c-428c-a315-876a27d6a98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:32.418958 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 808/1602] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:32.419640 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c06c7-dc91-4fee-a331-d9ad20572857 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.431241 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c06c7-dc91-4fee-a331-d9ad20572857 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.436067 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041f8a3-4d76-401f-a34b-524001c0ea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.436799 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041f8a3-4d76-401f-a34b-524001c0ea5c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.437479 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041f8a3-4d76-401f-a34b-524001c0ea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.437479 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041f8a3-4d76-401f-a34b-524001c0ea5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.438114 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041f8a3-4d76-401f-a34b-524001c0ea5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:32.439847 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041f8a3-4d76-401f-a34b-524001c0ea5c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.450848 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 809/1603] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:32.451820 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041f8a3-4d76-401f-a34b-524001c0ea5c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.462386 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041f8a3-4d76-401f-a34b-524001c0ea5c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.467165 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4ace7-f007-4955-b388-6ef14002230a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.467832 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4ace7-f007-4955-b388-6ef14002230a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.468696 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4ace7-f007-4955-b388-6ef14002230a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.469486 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4ace7-f007-4955-b388-6ef14002230a admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.470327 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4ace7-f007-4955-b388-6ef14002230a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:32.471966 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4ace7-f007-4955-b388-6ef14002230a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.486792 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 810/1604] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:32.486792 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4ace7-f007-4955-b388-6ef14002230a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.496533 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 795/1605] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:32.497063 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4ace7-f007-4955-b388-6ef14002230a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.497174 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85ba75-c97c-428c-a315-876a27d6a98f None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.503964 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818a0a9-5ed8-45be-a2fc-9f61fa537d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.504766 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818a0a9-5ed8-45be-a2fc-9f61fa537d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.505107 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818a0a9-5ed8-45be-a2fc-9f61fa537d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.505555 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818a0a9-5ed8-45be-a2fc-9f61fa537d10 admin admin] PATH_INFO: `/v3/projects/8df95163760d4b77a64fff45618b6a41/users/9490c5d94696445ea9731b5db976e93a/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.508396 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85ba75-c97c-428c-a315-876a27d6a98f None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.516427 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0751e1-e06b-4f3f-be0d-b3c1d7ca9ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.516427 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0751e1-e06b-4f3f-be0d-b3c1d7ca9ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.516427 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0751e1-e06b-4f3f-be0d-b3c1d7ca9ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.516427 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0751e1-e06b-4f3f-be0d-b3c1d7ca9ae7 admin admin] PATH_INFO: `/v3/projects/fe5f405ce059489f92848cf0223ed677/users/db53f0b9c80640dc9e93349861182d6f/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.522202 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818a0a9-5ed8-45be-a2fc-9f61fa537d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df95163760d4b77a64fff45618b6a41, user_id=9490c5d94696445ea9731b5db976e93a, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:32.525164 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818a0a9-5ed8-45be-a2fc-9f61fa537d10 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.529751 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0751e1-e06b-4f3f-be0d-b3c1d7ca9ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5f405ce059489f92848cf0223ed677, user_id=db53f0b9c80640dc9e93349861182d6f, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:32.533114 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0751e1-e06b-4f3f-be0d-b3c1d7ca9ae7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.631343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 811/1606] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:32 2022] PUT /identity/v3/projects/8df95163760d4b77a64fff45618b6a41/users/9490c5d94696445ea9731b5db976e93a/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:32.631343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818a0a9-5ed8-45be-a2fc-9f61fa537d10 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.640367 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 796/1607] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:32 2022] PUT /identity/v3/projects/fe5f405ce059489f92848cf0223ed677/users/db53f0b9c80640dc9e93349861182d6f/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:32.641365 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0751e1-e06b-4f3f-be0d-b3c1d7ca9ae7 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.715118 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818a0a9-5ed8-45be-a2fc-9f61fa537d10 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.718610 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0751e1-e06b-4f3f-be0d-b3c1d7ca9ae7 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.721166 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2e2dd-59fa-4cba-aef2-3a09d4525be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.721835 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2e2dd-59fa-4cba-aef2-3a09d4525be9 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.722141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2e2dd-59fa-4cba-aef2-3a09d4525be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.722417 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2e2dd-59fa-4cba-aef2-3a09d4525be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.723248 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2e2dd-59fa-4cba-aef2-3a09d4525be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:32.723667 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2ccaa-3a8d-4f56-9f80-8dd744b40437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.726075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2ccaa-3a8d-4f56-9f80-8dd744b40437 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.726075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2ccaa-3a8d-4f56-9f80-8dd744b40437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.726247 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2e2dd-59fa-4cba-aef2-3a09d4525be9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.726338 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2ccaa-3a8d-4f56-9f80-8dd744b40437 admin admin] PATH_INFO: `/v3/projects/9a66da4daef8436fb5c15521ca7ca9a7/users/60197e5576eb43e099846bfc42c611a6/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.736403 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 812/1608] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:32.737228 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2e2dd-59fa-4cba-aef2-3a09d4525be9 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.741587 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2ccaa-3a8d-4f56-9f80-8dd744b40437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a66da4daef8436fb5c15521ca7ca9a7, user_id=60197e5576eb43e099846bfc42c611a6, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:32.744513 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2ccaa-3a8d-4f56-9f80-8dd744b40437 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.747759 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2e2dd-59fa-4cba-aef2-3a09d4525be9 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.753963 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4238693-434c-4378-9250-b41ef75ac2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.754615 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4238693-434c-4378-9250-b41ef75ac2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.754985 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4238693-434c-4378-9250-b41ef75ac2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.755259 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4238693-434c-4378-9250-b41ef75ac2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.755973 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4238693-434c-4378-9250-b41ef75ac2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:32.757540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4238693-434c-4378-9250-b41ef75ac2d2 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.768525 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 813/1609] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:32.771457 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4238693-434c-4378-9250-b41ef75ac2d2 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.781768 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4238693-434c-4378-9250-b41ef75ac2d2 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.786719 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b60adc-1a94-490d-870c-1dd786bad393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.787646 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b60adc-1a94-490d-870c-1dd786bad393 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.787924 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b60adc-1a94-490d-870c-1dd786bad393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.788197 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b60adc-1a94-490d-870c-1dd786bad393 admin admin] PATH_INFO: `/v3/projects/241e5308f6f147028433f8b865e84a1c/users/fc6236a6436344c79a9e8b4c2360a4d6/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.802906 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b60adc-1a94-490d-870c-1dd786bad393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=241e5308f6f147028433f8b865e84a1c, user_id=fc6236a6436344c79a9e8b4c2360a4d6, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:32.805620 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b60adc-1a94-490d-870c-1dd786bad393 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:32.813495 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 797/1610] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:32 2022] PUT /identity/v3/projects/9a66da4daef8436fb5c15521ca7ca9a7/users/60197e5576eb43e099846bfc42c611a6/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:32.814358 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2ccaa-3a8d-4f56-9f80-8dd744b40437 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:32.862675 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 814/1611] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:32 2022] PUT /identity/v3/projects/241e5308f6f147028433f8b865e84a1c/users/fc6236a6436344c79a9e8b4c2360a4d6/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:32.871961 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a52cf-5e99-4ee4-8e62-c17ddfd71987 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.871961 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a52cf-5e99-4ee4-8e62-c17ddfd71987 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.871961 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a52cf-5e99-4ee4-8e62-c17ddfd71987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.873570 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2ccaa-3a8d-4f56-9f80-8dd744b40437 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:32.905346 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-fa5a52cf-5e99-4ee4-8e62-c17ddfd71987 None None] MFA Rules not processed for user `9490c5d94696445ea9731b5db976e93a`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:32.907549 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-fa5a52cf-5e99-4ee4-8e62-c17ddfd71987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:32.929446 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652d1c1-71b6-4175-81b6-76494b323107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:32.930123 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652d1c1-71b6-4175-81b6-76494b323107 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.930410 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652d1c1-71b6-4175-81b6-76494b323107 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.930727 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652d1c1-71b6-4175-81b6-76494b323107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.979194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 815/1612] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:32.980633 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502dfd3-a98f-4ab9-a01f-531e4df2b4d8 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:32.981003 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502dfd3-a98f-4ab9-a01f-531e4df2b4d8 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:32.981372 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502dfd3-a98f-4ab9-a01f-531e4df2b4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:32.998881 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652d1c1-71b6-4175-81b6-76494b323107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:33.000609 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652d1c1-71b6-4175-81b6-76494b323107 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:33.011003 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 798/1613] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:33.012028 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652d1c1-71b6-4175-81b6-76494b323107 service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:33.013190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-d502dfd3-a98f-4ab9-a01f-531e4df2b4d8 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:33.014562 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d502dfd3-a98f-4ab9-a01f-531e4df2b4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:33.076176 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652d1c1-71b6-4175-81b6-76494b323107 service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:33.082193 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 816/1614] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:33.082343 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0305dfdd-ced1-42a7-8e10-91dd917a1923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:33.083035 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305dfdd-ced1-42a7-8e10-91dd917a1923 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:33.083323 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305dfdd-ced1-42a7-8e10-91dd917a1923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:33.083613 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305dfdd-ced1-42a7-8e10-91dd917a1923 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:33.084373 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0305dfdd-ced1-42a7-8e10-91dd917a1923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:33.086188 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502dfd3-a98f-4ab9-a01f-531e4df2b4d8 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:33.087918 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0305dfdd-ced1-42a7-8e10-91dd917a1923 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:33.096519 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502dfd3-a98f-4ab9-a01f-531e4df2b4d8 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:33.101342 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab742bad-220d-47eb-9b45-eee57d161d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:33.102212 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab742bad-220d-47eb-9b45-eee57d161d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:33.102486 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab742bad-220d-47eb-9b45-eee57d161d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:33.102789 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab742bad-220d-47eb-9b45-eee57d161d0a admin admin] PATH_INFO: `/v3/projects/0b97d3aa33d8479eb2d0f4ba153fb09a/users/7488c1fe51db42c18d6f0464e22fbeae/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:33.107278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 799/1615] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:33.107278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8fd8b-7209-4308-b6ff-205fdb2e2cca None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:33.107278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8fd8b-7209-4308-b6ff-205fdb2e2cca None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:33.107278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8fd8b-7209-4308-b6ff-205fdb2e2cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:33.118190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab742bad-220d-47eb-9b45-eee57d161d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b97d3aa33d8479eb2d0f4ba153fb09a, user_id=7488c1fe51db42c18d6f0464e22fbeae, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:33.120870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab742bad-220d-47eb-9b45-eee57d161d0a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:33.126621 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-5eb8fd8b-7209-4308-b6ff-205fdb2e2cca None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:33.128056 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-5eb8fd8b-7209-4308-b6ff-205fdb2e2cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:33.138075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 800/1616] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:33.139585 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaf577-adad-446c-b8c9-291527c6e0b9 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:33.139902 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaf577-adad-446c-b8c9-291527c6e0b9 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:33.141092 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaf577-adad-446c-b8c9-291527c6e0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:33.167940 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-dabaf577-adad-446c-b8c9-291527c6e0b9 None None] MFA Rules not processed for user `fc6236a6436344c79a9e8b4c2360a4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:33.169131 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-dabaf577-adad-446c-b8c9-291527c6e0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:33.218562 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 817/1617] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:33 2022] PUT /identity/v3/projects/0b97d3aa33d8479eb2d0f4ba153fb09a/users/7488c1fe51db42c18d6f0464e22fbeae/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:33.219842 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa717f-02e3-47d4-a8fb-9c75c0cbca45 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:33.220135 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa717f-02e3-47d4-a8fb-9c75c0cbca45 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:33.220443 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa717f-02e3-47d4-a8fb-9c75c0cbca45 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:33.222248 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 818/1618] 10.222.0.42 () {54 vars in 961 bytes} [Wed Feb 16 17:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:09:33.223448 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa717f-02e3-47d4-a8fb-9c75c0cbca45 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:33.225480 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-50fa717f-02e3-47d4-a8fb-9c75c0cbca45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:33.243823 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 801/1619] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:33.244641 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabaf577-adad-446c-b8c9-291527c6e0b9 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:33.259266 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabaf577-adad-446c-b8c9-291527c6e0b9 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:33.297596 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa717f-02e3-47d4-a8fb-9c75c0cbca45 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:33.302059 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735d406-297a-4f4c-8273-d471ee767e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:33.302885 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735d406-297a-4f4c-8273-d471ee767e30 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:33.303436 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735d406-297a-4f4c-8273-d471ee767e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:33.303782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735d406-297a-4f4c-8273-d471ee767e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:33.323694 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054c810-dca5-4f48-855d-b487262357c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:33.324611 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054c810-dca5-4f48-855d-b487262357c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:33.324897 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054c810-dca5-4f48-855d-b487262357c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:33.325169 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054c810-dca5-4f48-855d-b487262357c3 admin admin] PATH_INFO: `/v3/projects/fed1e50a307f4038b904d12fd2ef5e6d/users/f4cab702a26e4ec6b102dcb7f0fef587/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:33.342136 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054c810-dca5-4f48-855d-b487262357c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed1e50a307f4038b904d12fd2ef5e6d, user_id=f4cab702a26e4ec6b102dcb7f0fef587, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:33.345925 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054c810-dca5-4f48-855d-b487262357c3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:33.370673 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735d406-297a-4f4c-8273-d471ee767e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:33.372112 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735d406-297a-4f4c-8273-d471ee767e30 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:33.382094 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 819/1620] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:33.382916 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735d406-297a-4f4c-8273-d471ee767e30 service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:33.391640 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735d406-297a-4f4c-8273-d471ee767e30 service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:33.395661 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d02386-94d7-4db5-8599-632b1262aa6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:33.396314 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d02386-94d7-4db5-8599-632b1262aa6c service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:33.396588 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d02386-94d7-4db5-8599-632b1262aa6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:33.396859 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d02386-94d7-4db5-8599-632b1262aa6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:33.406352 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d02386-94d7-4db5-8599-632b1262aa6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:33.407820 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d02386-94d7-4db5-8599-632b1262aa6c service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:33.418178 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 820/1621] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:33.423607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17715cf-1bb8-43df-b96f-88e4e7375362 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:33.423607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17715cf-1bb8-43df-b96f-88e4e7375362 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:33.423607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17715cf-1bb8-43df-b96f-88e4e7375362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:33.442569 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-a17715cf-1bb8-43df-b96f-88e4e7375362 None None] MFA Rules not processed for user `9a30603a236e4681a7702eec7029e9db`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:33.443957 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a17715cf-1bb8-43df-b96f-88e4e7375362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:33.456643 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 802/1622] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:33 2022] PUT /identity/v3/projects/fed1e50a307f4038b904d12fd2ef5e6d/users/f4cab702a26e4ec6b102dcb7f0fef587/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:33.458150 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33334046-1130-4c67-b705-8dd863e9f811 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:33.458425 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33334046-1130-4c67-b705-8dd863e9f811 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:33.459038 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33334046-1130-4c67-b705-8dd863e9f811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:33.497671 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-33334046-1130-4c67-b705-8dd863e9f811 None None] MFA Rules not processed for user `7488c1fe51db42c18d6f0464e22fbeae`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:33.499432 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-33334046-1130-4c67-b705-8dd863e9f811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:33.545369 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 821/1623] 10.222.0.42 () {58 vars in 1058 bytes} [Wed Feb 16 17:09:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:33.548767 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a4567-b26d-4b2c-88dc-97c7b1b30a63 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:33.550308 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a4567-b26d-4b2c-88dc-97c7b1b30a63 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:33.550868 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a4567-b26d-4b2c-88dc-97c7b1b30a63 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:33.554708 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 822/1624] 10.222.0.42 () {54 vars in 961 bytes} [Wed Feb 16 17:09:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:09:33.558341 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e848ff9-24ca-4761-ac28-2d1fe1784a99 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:33.561628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e848ff9-24ca-4761-ac28-2d1fe1784a99 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:33.562713 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e848ff9-24ca-4761-ac28-2d1fe1784a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:33.601133 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-4e848ff9-24ca-4761-ac28-2d1fe1784a99 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:33.602413 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-4e848ff9-24ca-4761-ac28-2d1fe1784a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:33.625964 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 803/1625] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:33.627843 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c04b-4af1-4d31-99a3-365657d2e777 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:33.628327 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c04b-4af1-4d31-99a3-365657d2e777 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:33.628770 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c04b-4af1-4d31-99a3-365657d2e777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:33.654365 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-a6c5c04b-4af1-4d31-99a3-365657d2e777 None None] MFA Rules not processed for user `9a30603a236e4681a7702eec7029e9db`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:33.655805 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-a6c5c04b-4af1-4d31-99a3-365657d2e777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:33.668885 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 804/1626] 10.222.0.42 () {58 vars in 1058 bytes} [Wed Feb 16 17:09:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:33.671682 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5c04b-4af1-4d31-99a3-365657d2e777 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:33.682701 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5c04b-4af1-4d31-99a3-365657d2e777 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:33.690059 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb1915-a318-4edb-b1df-0cb2bd4c0314 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:33.690817 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb1915-a318-4edb-b1df-0cb2bd4c0314 service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:33.691102 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb1915-a318-4edb-b1df-0cb2bd4c0314 service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:33.691406 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb1915-a318-4edb-b1df-0cb2bd4c0314 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:33.700670 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 823/1627] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:33.701629 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e848ff9-24ca-4761-ac28-2d1fe1784a99 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:33.713129 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e848ff9-24ca-4761-ac28-2d1fe1784a99 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:33.719551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39998447-5b89-4884-851e-344288d07ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:33.720276 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39998447-5b89-4884-851e-344288d07ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:33.720628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39998447-5b89-4884-851e-344288d07ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:33.720974 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39998447-5b89-4884-851e-344288d07ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:33.721895 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39998447-5b89-4884-851e-344288d07ec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:33.724312 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39998447-5b89-4884-851e-344288d07ec6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:33.766392 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb1915-a318-4edb-b1df-0cb2bd4c0314 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:33.768063 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb1915-a318-4edb-b1df-0cb2bd4c0314 service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:33.798012 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 805/1628] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:33.799330 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb1915-a318-4edb-b1df-0cb2bd4c0314 service nova] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:33.823523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb1915-a318-4edb-b1df-0cb2bd4c0314 service nova] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:33.847187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4b8ec-1e3e-433a-9789-c7e497fff6c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:33.847187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4b8ec-1e3e-433a-9789-c7e497fff6c0 service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:33.847187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4b8ec-1e3e-433a-9789-c7e497fff6c0 service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:33.847604 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4b8ec-1e3e-433a-9789-c7e497fff6c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:33.898633 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 824/1629] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:33 2022] POST /identity/v3/projects => generated 365 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:33.902556 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39998447-5b89-4884-851e-344288d07ec6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:33.931090 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4b8ec-1e3e-433a-9789-c7e497fff6c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:33.935233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4b8ec-1e3e-433a-9789-c7e497fff6c0 service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:33.948565 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 806/1630] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:33.948996 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4b8ec-1e3e-433a-9789-c7e497fff6c0 service nova] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:33.962832 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4b8ec-1e3e-433a-9789-c7e497fff6c0 service nova] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:34.070706 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd37770-001a-430b-8702-41279a196b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:34.071510 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd37770-001a-430b-8702-41279a196b7c admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:34.071899 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd37770-001a-430b-8702-41279a196b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:34.072261 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd37770-001a-430b-8702-41279a196b7c admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:34.072965 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd37770-001a-430b-8702-41279a196b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:34.074932 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd37770-001a-430b-8702-41279a196b7c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:34.082786 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39998447-5b89-4884-851e-344288d07ec6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:34.090599 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f9b65-d9d0-45fe-a7b1-b93edd6b5d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:34.091077 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f9b65-d9d0-45fe-a7b1-b93edd6b5d0a service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:34.091605 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f9b65-d9d0-45fe-a7b1-b93edd6b5d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:34.091893 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f9b65-d9d0-45fe-a7b1-b93edd6b5d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:34.133022 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f9b65-d9d0-45fe-a7b1-b93edd6b5d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:34.133022 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f9b65-d9d0-45fe-a7b1-b93edd6b5d0a service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:34.143395 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 825/1631] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:34.200129 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40a60e-2eb4-4590-a763-99a2e6f34941 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:34.200129 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40a60e-2eb4-4590-a763-99a2e6f34941 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:34.200129 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40a60e-2eb4-4590-a763-99a2e6f34941 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:34.200129 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 826/1632] 10.222.0.42 () {54 vars in 912 bytes} [Wed Feb 16 17:09:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 17:09:34.205534 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e4d3e-9ceb-4841-869d-30cf84ba362f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:34.205688 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e4d3e-9ceb-4841-869d-30cf84ba362f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:34.206046 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e4d3e-9ceb-4841-869d-30cf84ba362f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:34.230392 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 807/1633] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:33 2022] POST /identity/v3/users => generated 289 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:34.232789 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd37770-001a-430b-8702-41279a196b7c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:34.257286 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd37770-001a-430b-8702-41279a196b7c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:34.260126 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-d10e4d3e-9ceb-4841-869d-30cf84ba362f None None] MFA Rules not processed for user `9a30603a236e4681a7702eec7029e9db`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:34.267106 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d10e4d3e-9ceb-4841-869d-30cf84ba362f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:34.275270 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd1a74-d8a1-437a-b53b-55c007a4e6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:34.278308 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1a74-d8a1-437a-b53b-55c007a4e6df admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:34.278981 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1a74-d8a1-437a-b53b-55c007a4e6df admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:34.283446 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1a74-d8a1-437a-b53b-55c007a4e6df admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:34.283446 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd1a74-d8a1-437a-b53b-55c007a4e6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:34.285787 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd1a74-d8a1-437a-b53b-55c007a4e6df admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:34.310046 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 808/1634] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:09:34.312231 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd1a74-d8a1-437a-b53b-55c007a4e6df admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:34.338297 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd1a74-d8a1-437a-b53b-55c007a4e6df admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:34.355600 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b3b9b-8d98-4503-aafe-0f6b8298871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:34.357977 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b3b9b-8d98-4503-aafe-0f6b8298871b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:34.358270 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b3b9b-8d98-4503-aafe-0f6b8298871b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:34.358829 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b3b9b-8d98-4503-aafe-0f6b8298871b admin admin] PATH_INFO: `/v3/users/627d03a71fcb47aca3bd86e4b422df87` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:34.360872 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b3b9b-8d98-4503-aafe-0f6b8298871b admin admin] RBAC: Authorizing `identity:delete_user(user_id=627d03a71fcb47aca3bd86e4b422df87)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:34.363915 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b3b9b-8d98-4503-aafe-0f6b8298871b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:34.405674 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 827/1635] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Feb 16 17:09:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:34.407958 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e4d3e-9ceb-4841-869d-30cf84ba362f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:34.429900 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e4d3e-9ceb-4841-869d-30cf84ba362f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:34.435886 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe797c-d91a-4ce2-bbfb-bce3f16168fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:34.437774 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe797c-d91a-4ce2-bbfb-bce3f16168fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:34.438156 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe797c-d91a-4ce2-bbfb-bce3f16168fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:34.438544 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe797c-d91a-4ce2-bbfb-bce3f16168fd admin admin] PATH_INFO: `/v3/projects/4962345bfd53441da1727aa1ef52da1e/users/11418fc704f948b9b7b15de732221bb7/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:34.464305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe797c-d91a-4ce2-bbfb-bce3f16168fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4962345bfd53441da1727aa1ef52da1e, user_id=11418fc704f948b9b7b15de732221bb7, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:34.468778 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe797c-d91a-4ce2-bbfb-bce3f16168fd admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:34.641802 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 828/1636] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:34 2022] PUT /identity/v3/projects/4962345bfd53441da1727aa1ef52da1e/users/11418fc704f948b9b7b15de732221bb7/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:34.641802 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe797c-d91a-4ce2-bbfb-bce3f16168fd admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:34.696314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e46b3b9b-8d98-4503-aafe-0f6b8298871b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '627d03a71fcb47aca3bd86e4b422df87'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:34.697690 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e46b3b9b-8d98-4503-aafe-0f6b8298871b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '627d03a71fcb47aca3bd86e4b422df87'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:34.720294 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e46b3b9b-8d98-4503-aafe-0f6b8298871b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '627d03a71fcb47aca3bd86e4b422df87'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:34.729560 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e46b3b9b-8d98-4503-aafe-0f6b8298871b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '627d03a71fcb47aca3bd86e4b422df87'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:34.730004 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe797c-d91a-4ce2-bbfb-bce3f16168fd admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:34.741513 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c3f08-138a-46ac-a8c9-83f6ce8d0d61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:34.742723 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c3f08-138a-46ac-a8c9-83f6ce8d0d61 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:34.743234 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c3f08-138a-46ac-a8c9-83f6ce8d0d61 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:34.743710 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c3f08-138a-46ac-a8c9-83f6ce8d0d61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:34.746758 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-be6c3f08-138a-46ac-a8c9-83f6ce8d0d61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:34.850224 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e46b3b9b-8d98-4503-aafe-0f6b8298871b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '627d03a71fcb47aca3bd86e4b422df87'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:34.857141 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 809/1637] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:09:34 2022] DELETE /identity/v3/users/627d03a71fcb47aca3bd86e4b422df87 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:34.862584 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49060e-0cb2-47ff-a9e4-d981a157db7a None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:34.863574 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49060e-0cb2-47ff-a9e4-d981a157db7a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:34.863872 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49060e-0cb2-47ff-a9e4-d981a157db7a None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:34.866245 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 810/1638] 10.222.0.42 () {54 vars in 912 bytes} [Wed Feb 16 17:09:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:09:34.870239 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c3f08-138a-46ac-a8c9-83f6ce8d0d61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:34.871934 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49060e-0cb2-47ff-a9e4-d981a157db7a None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:34.875609 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c3f08-138a-46ac-a8c9-83f6ce8d0d61 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:34.878259 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-3e49060e-0cb2-47ff-a9e4-d981a157db7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:34.889679 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 829/1639] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:34.892772 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6acda1-3ec5-4832-999b-e0dafc4b7a40 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:34.893570 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6acda1-3ec5-4832-999b-e0dafc4b7a40 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:34.894101 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6acda1-3ec5-4832-999b-e0dafc4b7a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:34.914696 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-ee6acda1-3ec5-4832-999b-e0dafc4b7a40 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:34.916392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-ee6acda1-3ec5-4832-999b-e0dafc4b7a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:35.027794 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49060e-0cb2-47ff-a9e4-d981a157db7a None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:35.040280 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb0880-1472-4d1b-9db5-387a0f7a922e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:35.040998 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb0880-1472-4d1b-9db5-387a0f7a922e admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:35.041275 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb0880-1472-4d1b-9db5-387a0f7a922e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:35.041551 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb0880-1472-4d1b-9db5-387a0f7a922e admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:35.042288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb0880-1472-4d1b-9db5-387a0f7a922e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:35.043938 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb0880-1472-4d1b-9db5-387a0f7a922e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:35.070242 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 811/1640] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:35.074298 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 830/1641] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:35.078521 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6acda1-3ec5-4832-999b-e0dafc4b7a40 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:35.082479 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cd139-4053-46c3-9ec1-f8e32bf84826 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:35.082479 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cd139-4053-46c3-9ec1-f8e32bf84826 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:35.082479 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cd139-4053-46c3-9ec1-f8e32bf84826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:35.096938 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6acda1-3ec5-4832-999b-e0dafc4b7a40 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:35.110676 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d050ee3-a1ce-4165-a6af-92465d3639c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:35.111982 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d050ee3-a1ce-4165-a6af-92465d3639c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:35.112275 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d050ee3-a1ce-4165-a6af-92465d3639c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:35.112554 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d050ee3-a1ce-4165-a6af-92465d3639c8 admin admin] PATH_INFO: `/v3/projects/4962345bfd53441da1727aa1ef52da1e/users/11418fc704f948b9b7b15de732221bb7/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:35.119474 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d050ee3-a1ce-4165-a6af-92465d3639c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4962345bfd53441da1727aa1ef52da1e, user_id=11418fc704f948b9b7b15de732221bb7, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:35.122442 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-9c6cd139-4053-46c3-9ec1-f8e32bf84826 None None] MFA Rules not processed for user `9a30603a236e4681a7702eec7029e9db`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:35.127867 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d050ee3-a1ce-4165-a6af-92465d3639c8 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:35.128428 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-9c6cd139-4053-46c3-9ec1-f8e32bf84826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:35.160851 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 831/1642] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:35 2022] PUT /identity/v3/projects/4962345bfd53441da1727aa1ef52da1e/users/11418fc704f948b9b7b15de732221bb7/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:35.162789 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d050ee3-a1ce-4165-a6af-92465d3639c8 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:35.170987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0d050ee3-a1ce-4165-a6af-92465d3639c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:35.258276 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d050ee3-a1ce-4165-a6af-92465d3639c8 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:35.269754 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaab793-dd2d-4f9f-83b8-bb8ced6b89cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:35.271236 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaab793-dd2d-4f9f-83b8-bb8ced6b89cf service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:35.273147 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaab793-dd2d-4f9f-83b8-bb8ced6b89cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:35.273728 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaab793-dd2d-4f9f-83b8-bb8ced6b89cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:35.293689 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 812/1643] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Feb 16 17:09:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:35.295126 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30ddaf-1139-4760-8376-1a4324691a5f None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:35.295415 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30ddaf-1139-4760-8376-1a4324691a5f None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:35.295690 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30ddaf-1139-4760-8376-1a4324691a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:35.381962 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-7f30ddaf-1139-4760-8376-1a4324691a5f None None] MFA Rules not processed for user `11418fc704f948b9b7b15de732221bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:35.383660 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-7f30ddaf-1139-4760-8376-1a4324691a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:35.412752 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaab793-dd2d-4f9f-83b8-bb8ced6b89cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:35.415519 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaab793-dd2d-4f9f-83b8-bb8ced6b89cf service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:35.462093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 832/1644] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:35.462093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaab793-dd2d-4f9f-83b8-bb8ced6b89cf service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:35.462093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-dcaab793-dd2d-4f9f-83b8-bb8ced6b89cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:35.605414 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 813/1645] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:35.641827 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaab793-dd2d-4f9f-83b8-bb8ced6b89cf service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:35.647162 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efc910-8842-40bb-a91d-9f97b7d40ca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:35.647821 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efc910-8842-40bb-a91d-9f97b7d40ca7 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:35.648107 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efc910-8842-40bb-a91d-9f97b7d40ca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:35.648373 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efc910-8842-40bb-a91d-9f97b7d40ca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:35.734378 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7efc910-8842-40bb-a91d-9f97b7d40ca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:35.736277 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7efc910-8842-40bb-a91d-9f97b7d40ca7 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:35.749683 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 833/1646] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:36.449771 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81e5b8-6c81-4f93-8321-ccce176d4fef None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:36.449771 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81e5b8-6c81-4f93-8321-ccce176d4fef None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:36.449771 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81e5b8-6c81-4f93-8321-ccce176d4fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:36.462887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efc910-8842-40bb-a91d-9f97b7d40ca7 service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:36.464337 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d7efc910-8842-40bb-a91d-9f97b7d40ca7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:36.499932 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efc910-8842-40bb-a91d-9f97b7d40ca7 service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:36.511011 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edb0c1-5784-4340-b7db-490fcc1ba559 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:36.511746 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edb0c1-5784-4340-b7db-490fcc1ba559 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:36.511746 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edb0c1-5784-4340-b7db-490fcc1ba559 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:36.512065 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edb0c1-5784-4340-b7db-490fcc1ba559 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:36.526619 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edb0c1-5784-4340-b7db-490fcc1ba559 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:36.526619 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edb0c1-5784-4340-b7db-490fcc1ba559 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:36.538726 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-6f81e5b8-6c81-4f93-8321-ccce176d4fef None None] MFA Rules not processed for user `60197e5576eb43e099846bfc42c611a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:36.541530 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6f81e5b8-6c81-4f93-8321-ccce176d4fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:36.555695 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 834/1647] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:36 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:36.641902 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 814/1648] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:36.652349 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f43e7-62e7-46a5-9825-4b029fda4318 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:36.652877 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f43e7-62e7-46a5-9825-4b029fda4318 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:36.653226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f43e7-62e7-46a5-9825-4b029fda4318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:36.680285 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-0f8f43e7-62e7-46a5-9825-4b029fda4318 None None] MFA Rules not processed for user `60197e5576eb43e099846bfc42c611a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:36.682490 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0f8f43e7-62e7-46a5-9825-4b029fda4318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:36.693576 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 835/1649] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:09:36.861113 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81e5b8-6c81-4f93-8321-ccce176d4fef None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:36.862546 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6f81e5b8-6c81-4f93-8321-ccce176d4fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:36.902402 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81e5b8-6c81-4f93-8321-ccce176d4fef None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:36.923852 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c526ae-0581-43a3-b93f-ade679293ada service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:36.924537 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c526ae-0581-43a3-b93f-ade679293ada service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:36.924818 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c526ae-0581-43a3-b93f-ade679293ada service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:36.925095 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c526ae-0581-43a3-b93f-ade679293ada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:36.940954 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c526ae-0581-43a3-b93f-ade679293ada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:36.941761 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c526ae-0581-43a3-b93f-ade679293ada service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:36.981832 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 815/1650] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:37.109949 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f43e7-62e7-46a5-9825-4b029fda4318 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:37.113108 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0f8f43e7-62e7-46a5-9825-4b029fda4318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:37.144772 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f43e7-62e7-46a5-9825-4b029fda4318 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:37.159341 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e94ad4-454e-4ab5-b27a-09a06cf2912c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:37.161582 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e94ad4-454e-4ab5-b27a-09a06cf2912c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:37.161582 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e94ad4-454e-4ab5-b27a-09a06cf2912c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:37.161582 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e94ad4-454e-4ab5-b27a-09a06cf2912c admin admin] PATH_INFO: `/v3/projects/b66bc589cf454cc2a4008c1f03209923` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:37.170004 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e94ad4-454e-4ab5-b27a-09a06cf2912c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66bc589cf454cc2a4008c1f03209923)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:37.197575 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e94ad4-454e-4ab5-b27a-09a06cf2912c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:37.333697 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647d03c-4447-4117-988a-cb38eb0b8169 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:37.335003 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647d03c-4447-4117-988a-cb38eb0b8169 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:37.335519 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647d03c-4447-4117-988a-cb38eb0b8169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:37.388099 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-49e94ad4-454e-4ab5-b27a-09a06cf2912c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66bc589cf454cc2a4008c1f03209923', 'request_id': 'req-49e94ad4-454e-4ab5-b27a-09a06cf2912c'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:37.413881 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-e647d03c-4447-4117-988a-cb38eb0b8169 None None] MFA Rules not processed for user `f4cab702a26e4ec6b102dcb7f0fef587`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:37.416321 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e647d03c-4447-4117-988a-cb38eb0b8169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:37.463839 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-49e94ad4-454e-4ab5-b27a-09a06cf2912c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66bc589cf454cc2a4008c1f03209923', 'request_id': 'req-49e94ad4-454e-4ab5-b27a-09a06cf2912c'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:37.471366 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-49e94ad4-454e-4ab5-b27a-09a06cf2912c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66bc589cf454cc2a4008c1f03209923', 'request_id': 'req-49e94ad4-454e-4ab5-b27a-09a06cf2912c'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:37.487428 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-49e94ad4-454e-4ab5-b27a-09a06cf2912c admin admin] The token cache is being invalidate because project b66bc589cf454cc2a4008c1f03209923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:09:37.487993 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-49e94ad4-454e-4ab5-b27a-09a06cf2912c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:37.488999 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-49e94ad4-454e-4ab5-b27a-09a06cf2912c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:37.491217 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 836/1651] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:09:37 2022] DELETE /identity/v3/projects/b66bc589cf454cc2a4008c1f03209923 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:37.501484 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e94ad4-454e-4ab5-b27a-09a06cf2912c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:37.503579 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-49e94ad4-454e-4ab5-b27a-09a06cf2912c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:37.582706 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 816/1652] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:37.582706 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647d03c-4447-4117-988a-cb38eb0b8169 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:37.583278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e647d03c-4447-4117-988a-cb38eb0b8169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:37.630867 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e94ad4-454e-4ab5-b27a-09a06cf2912c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:37.652637 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005e136-70c9-4948-8476-dab2d2467f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:37.653927 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005e136-70c9-4948-8476-dab2d2467f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:37.655005 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005e136-70c9-4948-8476-dab2d2467f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:37.656240 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005e136-70c9-4948-8476-dab2d2467f3e admin admin] PATH_INFO: `/v3/users/7488c1fe51db42c18d6f0464e22fbeae` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:37.659247 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005e136-70c9-4948-8476-dab2d2467f3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7488c1fe51db42c18d6f0464e22fbeae)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:37.660726 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: WARNING py.warnings [None req-6005e136-70c9-4948-8476-dab2d2467f3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 17:09:37.660726 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: warnings.warn(msg) Feb 16 17:09:37.660726 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: Feb 16 17:09:37.663120 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005e136-70c9-4948-8476-dab2d2467f3e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:37.679579 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647d03c-4447-4117-988a-cb38eb0b8169 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:37.686496 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e8f6c-e7bd-4c6e-8450-a7288e8d151d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:37.688341 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e8f6c-e7bd-4c6e-8450-a7288e8d151d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:37.688842 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e8f6c-e7bd-4c6e-8450-a7288e8d151d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:37.689681 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e8f6c-e7bd-4c6e-8450-a7288e8d151d admin admin] PATH_INFO: `/v3/users/9612415aa89341c1b53662ac67b2dac1` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:37.691350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e8f6c-e7bd-4c6e-8450-a7288e8d151d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9612415aa89341c1b53662ac67b2dac1)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:37.694417 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e8f6c-e7bd-4c6e-8450-a7288e8d151d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:37.936289 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-6005e136-70c9-4948-8476-dab2d2467f3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7488c1fe51db42c18d6f0464e22fbeae'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:37.936289 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-6005e136-70c9-4948-8476-dab2d2467f3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7488c1fe51db42c18d6f0464e22fbeae'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:37.952434 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b17e8f6c-e7bd-4c6e-8450-a7288e8d151d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9612415aa89341c1b53662ac67b2dac1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:37.953536 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b17e8f6c-e7bd-4c6e-8450-a7288e8d151d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9612415aa89341c1b53662ac67b2dac1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:37.976098 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-6005e136-70c9-4948-8476-dab2d2467f3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7488c1fe51db42c18d6f0464e22fbeae'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:37.994142 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-6005e136-70c9-4948-8476-dab2d2467f3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7488c1fe51db42c18d6f0464e22fbeae'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:37.995021 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-6005e136-70c9-4948-8476-dab2d2467f3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7488c1fe51db42c18d6f0464e22fbeae'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:38.006311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b17e8f6c-e7bd-4c6e-8450-a7288e8d151d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9612415aa89341c1b53662ac67b2dac1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:38.021097 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b17e8f6c-e7bd-4c6e-8450-a7288e8d151d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9612415aa89341c1b53662ac67b2dac1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:38.125754 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 837/1653] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:09:37 2022] DELETE /identity/v3/users/7488c1fe51db42c18d6f0464e22fbeae => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:38.127396 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005e136-70c9-4948-8476-dab2d2467f3e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:38.129527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-6005e136-70c9-4948-8476-dab2d2467f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:38.206538 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b17e8f6c-e7bd-4c6e-8450-a7288e8d151d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9612415aa89341c1b53662ac67b2dac1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:38.217532 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 817/1654] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:09:37 2022] DELETE /identity/v3/users/9612415aa89341c1b53662ac67b2dac1 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:38.220581 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb733fd1-66e0-495c-86df-e32f83961f58 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:38.221363 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb733fd1-66e0-495c-86df-e32f83961f58 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:38.222042 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb733fd1-66e0-495c-86df-e32f83961f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:38.234034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005e136-70c9-4948-8476-dab2d2467f3e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:38.252786 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-bb733fd1-66e0-495c-86df-e32f83961f58 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:38.255588 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-bb733fd1-66e0-495c-86df-e32f83961f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:38.328362 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b2ec5-6bbb-4437-9197-062ef38cd86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:38.329211 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b2ec5-6bbb-4437-9197-062ef38cd86e admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:38.329430 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b2ec5-6bbb-4437-9197-062ef38cd86e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:38.329754 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b2ec5-6bbb-4437-9197-062ef38cd86e admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:38.330409 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b2ec5-6bbb-4437-9197-062ef38cd86e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:38.332459 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b2ec5-6bbb-4437-9197-062ef38cd86e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:38.396117 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 818/1655] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:38.397394 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0f140-990b-4142-aef0-26dddf0f5180 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:38.397747 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0f140-990b-4142-aef0-26dddf0f5180 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:38.398221 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0f140-990b-4142-aef0-26dddf0f5180 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:38.400632 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 819/1656] 10.222.0.42 () {54 vars in 912 bytes} [Wed Feb 16 17:09:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:09:38.407482 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca398a61-2cc1-4a4e-9b7f-322adcce96bc None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:38.407839 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca398a61-2cc1-4a4e-9b7f-322adcce96bc None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:38.408332 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca398a61-2cc1-4a4e-9b7f-322adcce96bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:38.447997 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 838/1657] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:38 2022] POST /identity/v3/projects => generated 405 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:38.449098 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b2ec5-6bbb-4437-9197-062ef38cd86e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:38.453195 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d48b2ec5-6bbb-4437-9197-062ef38cd86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:38.460176 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-ca398a61-2cc1-4a4e-9b7f-322adcce96bc None None] MFA Rules not processed for user `f6db9534cc094e8281b0aa34e2cb4b46`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:38.461534 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-ca398a61-2cc1-4a4e-9b7f-322adcce96bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:38.580429 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b2ec5-6bbb-4437-9197-062ef38cd86e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:38.581097 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 820/1658] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Feb 16 17:09:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:09:38.581715 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca398a61-2cc1-4a4e-9b7f-322adcce96bc None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:38.584880 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-ca398a61-2cc1-4a4e-9b7f-322adcce96bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:38.587628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf352d-13e8-4839-89b1-e03f3e595ac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:38.588574 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf352d-13e8-4839-89b1-e03f3e595ac7 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:38.589252 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf352d-13e8-4839-89b1-e03f3e595ac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:38.589530 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf352d-13e8-4839-89b1-e03f3e595ac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:38.731338 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca398a61-2cc1-4a4e-9b7f-322adcce96bc None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:38.768541 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b78a3-8e11-4a0c-8b0a-22d1e486c5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:38.769219 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf352d-13e8-4839-89b1-e03f3e595ac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:38.771253 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf352d-13e8-4839-89b1-e03f3e595ac7 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:38.772502 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b78a3-8e11-4a0c-8b0a-22d1e486c5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:38.772792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b78a3-8e11-4a0c-8b0a-22d1e486c5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:38.773073 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b78a3-8e11-4a0c-8b0a-22d1e486c5f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:38.773791 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b78a3-8e11-4a0c-8b0a-22d1e486c5f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:38.790239 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b78a3-8e11-4a0c-8b0a-22d1e486c5f2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:38.801134 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 839/1659] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:38.803827 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf352d-13e8-4839-89b1-e03f3e595ac7 service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:38.830892 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf352d-13e8-4839-89b1-e03f3e595ac7 service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:38.840716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b385e-480e-4c80-8d13-f49f9eaa9cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:38.840716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b385e-480e-4c80-8d13-f49f9eaa9cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:38.840716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b385e-480e-4c80-8d13-f49f9eaa9cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:38.840716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b385e-480e-4c80-8d13-f49f9eaa9cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:38.850683 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b385e-480e-4c80-8d13-f49f9eaa9cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:38.852903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b385e-480e-4c80-8d13-f49f9eaa9cc0 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:38.867857 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 840/1660] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:38.960981 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 821/1661] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:38 2022] POST /identity/v3/users => generated 309 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:38.968592 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b385e-480e-4c80-8d13-f49f9eaa9cc0 service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:38.990619 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b385e-480e-4c80-8d13-f49f9eaa9cc0 service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:39.019306 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3843a-0ef6-4d5e-bc40-094da63b6b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:39.019994 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3843a-0ef6-4d5e-bc40-094da63b6b8b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:39.020271 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3843a-0ef6-4d5e-bc40-094da63b6b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:39.020540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3843a-0ef6-4d5e-bc40-094da63b6b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:39.021306 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3843a-0ef6-4d5e-bc40-094da63b6b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:39.022987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3843a-0ef6-4d5e-bc40-094da63b6b8b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:39.057099 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 841/1662] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:39.066311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b78a3-8e11-4a0c-8b0a-22d1e486c5f2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:39.082205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b78a3-8e11-4a0c-8b0a-22d1e486c5f2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:39.095946 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47108aa6-cce2-4571-ac0a-f342e8138e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:39.097449 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47108aa6-cce2-4571-ac0a-f342e8138e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:39.097738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47108aa6-cce2-4571-ac0a-f342e8138e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:39.098018 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47108aa6-cce2-4571-ac0a-f342e8138e43 admin admin] PATH_INFO: `/v3/projects/7b97069c8599434b98239b09e62f0cb1/users/7f179fdd8e634fca879f5fc2c996e81b/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:39.142846 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47108aa6-cce2-4571-ac0a-f342e8138e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b97069c8599434b98239b09e62f0cb1, user_id=7f179fdd8e634fca879f5fc2c996e81b, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:39.146978 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47108aa6-cce2-4571-ac0a-f342e8138e43 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:39.269402 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 822/1663] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:39 2022] PUT /identity/v3/projects/7b97069c8599434b98239b09e62f0cb1/users/7f179fdd8e634fca879f5fc2c996e81b/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:39.273754 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3843a-0ef6-4d5e-bc40-094da63b6b8b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:39.287158 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3843a-0ef6-4d5e-bc40-094da63b6b8b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:39.386850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f9dcc-e0c0-4bcb-8695-9cac87c1f698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:39.389335 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f9dcc-e0c0-4bcb-8695-9cac87c1f698 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:39.390045 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f9dcc-e0c0-4bcb-8695-9cac87c1f698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:39.391152 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f9dcc-e0c0-4bcb-8695-9cac87c1f698 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:39.393531 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f9dcc-e0c0-4bcb-8695-9cac87c1f698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:39.395831 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f9dcc-e0c0-4bcb-8695-9cac87c1f698 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:39.413871 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 842/1664] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:39.415017 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47108aa6-cce2-4571-ac0a-f342e8138e43 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:39.433373 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f9dcc-e0c0-4bcb-8695-9cac87c1f698 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:39.434086 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47108aa6-cce2-4571-ac0a-f342e8138e43 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:39.435576 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a64f9dcc-e0c0-4bcb-8695-9cac87c1f698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:39.449965 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c28760-f767-4e8a-9276-dcd88b8e4590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:39.450889 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c28760-f767-4e8a-9276-dcd88b8e4590 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:39.451220 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c28760-f767-4e8a-9276-dcd88b8e4590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:39.451494 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c28760-f767-4e8a-9276-dcd88b8e4590 admin admin] PATH_INFO: `/v3/projects/7b97069c8599434b98239b09e62f0cb1/users/7f179fdd8e634fca879f5fc2c996e81b/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:39.455992 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c28760-f767-4e8a-9276-dcd88b8e4590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b97069c8599434b98239b09e62f0cb1, user_id=7f179fdd8e634fca879f5fc2c996e81b, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:39.463862 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c28760-f767-4e8a-9276-dcd88b8e4590 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:39.464161 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f9dcc-e0c0-4bcb-8695-9cac87c1f698 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:39.486632 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f8be1-da27-4521-8f96-c42d3a33898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:39.487611 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f8be1-da27-4521-8f96-c42d3a33898d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:39.489594 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f8be1-da27-4521-8f96-c42d3a33898d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:39.489912 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f8be1-da27-4521-8f96-c42d3a33898d admin admin] PATH_INFO: `/v3/projects/35895395a16b4ac29f20e001201e6ffa` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:39.490483 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 823/1665] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:39 2022] PUT /identity/v3/projects/7b97069c8599434b98239b09e62f0cb1/users/7f179fdd8e634fca879f5fc2c996e81b/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:09:39.497324 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f8be1-da27-4521-8f96-c42d3a33898d admin admin] RBAC: Authorizing `identity:delete_project(project_id=35895395a16b4ac29f20e001201e6ffa)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:39.503735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f8be1-da27-4521-8f96-c42d3a33898d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:39.738596 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-643f8be1-da27-4521-8f96-c42d3a33898d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35895395a16b4ac29f20e001201e6ffa', 'request_id': 'req-643f8be1-da27-4521-8f96-c42d3a33898d'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:39.838566 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-643f8be1-da27-4521-8f96-c42d3a33898d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35895395a16b4ac29f20e001201e6ffa', 'request_id': 'req-643f8be1-da27-4521-8f96-c42d3a33898d'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:39.847773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-643f8be1-da27-4521-8f96-c42d3a33898d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35895395a16b4ac29f20e001201e6ffa', 'request_id': 'req-643f8be1-da27-4521-8f96-c42d3a33898d'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:39.872960 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-643f8be1-da27-4521-8f96-c42d3a33898d admin admin] The token cache is being invalidate because project 35895395a16b4ac29f20e001201e6ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:09:39.881963 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-643f8be1-da27-4521-8f96-c42d3a33898d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:39.881963 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-643f8be1-da27-4521-8f96-c42d3a33898d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:39.890039 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 843/1666] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:09:39 2022] DELETE /identity/v3/projects/35895395a16b4ac29f20e001201e6ffa => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:39.895195 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d212a-91f3-4e77-98e9-7cca669d7b56 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:39.895672 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d212a-91f3-4e77-98e9-7cca669d7b56 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:39.895782 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d212a-91f3-4e77-98e9-7cca669d7b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:39.931636 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-5b0d212a-91f3-4e77-98e9-7cca669d7b56 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:39.934034 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-5b0d212a-91f3-4e77-98e9-7cca669d7b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:40.093420 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 824/1667] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:40.100857 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eaadeb-c180-43ac-94d4-848120c21d97 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:40.101787 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eaadeb-c180-43ac-94d4-848120c21d97 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:40.102314 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eaadeb-c180-43ac-94d4-848120c21d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:40.106977 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298c050-7797-43fe-a940-28f358853ced None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:40.107269 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298c050-7797-43fe-a940-28f358853ced None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:40.107710 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298c050-7797-43fe-a940-28f358853ced None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:40.110916 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 825/1668] 10.222.0.42 () {54 vars in 960 bytes} [Wed Feb 16 17:09:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 17:09:40.118622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9fe98-831b-491c-a74f-b92a913c9bed None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:40.119226 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9fe98-831b-491c-a74f-b92a913c9bed None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:40.119679 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9fe98-831b-491c-a74f-b92a913c9bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:40.136938 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-90eaadeb-c180-43ac-94d4-848120c21d97 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:40.140840 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-90eaadeb-c180-43ac-94d4-848120c21d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:40.144918 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-1ba9fe98-831b-491c-a74f-b92a913c9bed None None] MFA Rules not processed for user `ae711b94b32a431ab880aa8f6068ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:40.146489 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-1ba9fe98-831b-491c-a74f-b92a913c9bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:40.162362 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 844/1669] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:40.167450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eaadeb-c180-43ac-94d4-848120c21d97 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:40.185019 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eaadeb-c180-43ac-94d4-848120c21d97 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:40.199130 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c4b1d-4e8b-48a6-a708-896c7824e2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:40.200272 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c4b1d-4e8b-48a6-a708-896c7824e2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:40.200786 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c4b1d-4e8b-48a6-a708-896c7824e2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:40.201304 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c4b1d-4e8b-48a6-a708-896c7824e2b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:40.202271 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c4b1d-4e8b-48a6-a708-896c7824e2b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:09:40.209596 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c4b1d-4e8b-48a6-a708-896c7824e2b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:40.209596 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c4b1d-4e8b-48a6-a708-896c7824e2b9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:40.238918 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 845/1670] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 17:09:40.245133 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c4b1d-4e8b-48a6-a708-896c7824e2b9 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:40.265187 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c4b1d-4e8b-48a6-a708-896c7824e2b9 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:40.280334 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bd808-d34a-4df9-83c5-108ae55fb829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:40.281951 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bd808-d34a-4df9-83c5-108ae55fb829 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:40.282339 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bd808-d34a-4df9-83c5-108ae55fb829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:40.282837 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bd808-d34a-4df9-83c5-108ae55fb829 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:40.283618 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909bd808-d34a-4df9-83c5-108ae55fb829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:40.286801 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909bd808-d34a-4df9-83c5-108ae55fb829 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:40.289045 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 826/1671] 10.222.0.42 () {58 vars in 1057 bytes} [Wed Feb 16 17:09:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:40.302572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9fe98-831b-491c-a74f-b92a913c9bed None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:40.322204 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9fe98-831b-491c-a74f-b92a913c9bed None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:40.368700 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e392cb-92fb-4192-a501-a92704077ab1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae711b94b32a431ab880aa8f6068ff25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:40.373623 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e392cb-92fb-4192-a501-a92704077ab1 service placement] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:40.376123 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e392cb-92fb-4192-a501-a92704077ab1 service placement] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:40.886975 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e392cb-92fb-4192-a501-a92704077ab1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:40.886975 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-85e392cb-92fb-4192-a501-a92704077ab1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:40.894296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 846/1672] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:40 2022] POST /identity/v3/projects => generated 363 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:40.894296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bd808-d34a-4df9-83c5-108ae55fb829 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:40.894296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-909bd808-d34a-4df9-83c5-108ae55fb829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:40.901861 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e392cb-92fb-4192-a501-a92704077ab1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:40.901861 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e392cb-92fb-4192-a501-a92704077ab1 service placement] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:40.901861 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 827/1673] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:40.901861 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e392cb-92fb-4192-a501-a92704077ab1 service placement] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:40.901861 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e392cb-92fb-4192-a501-a92704077ab1 service placement] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:40.908141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bd808-d34a-4df9-83c5-108ae55fb829 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:40.908141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ff353-9e8f-4f0f-aa35-9c2e7f44da27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:40.908141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ff353-9e8f-4f0f-aa35-9c2e7f44da27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:40.908141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ff353-9e8f-4f0f-aa35-9c2e7f44da27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:40.910157 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ff353-9e8f-4f0f-aa35-9c2e7f44da27 admin admin] PATH_INFO: `/v3/users/9490c5d94696445ea9731b5db976e93a` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:40.910157 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ff353-9e8f-4f0f-aa35-9c2e7f44da27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9490c5d94696445ea9731b5db976e93a)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:40.910157 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ff353-9e8f-4f0f-aa35-9c2e7f44da27 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:40.912112 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8eba6-7dc2-4f49-9144-9274f916ad05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:40.912112 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8eba6-7dc2-4f49-9144-9274f916ad05 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:40.912112 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8eba6-7dc2-4f49-9144-9274f916ad05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:40.912112 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8eba6-7dc2-4f49-9144-9274f916ad05 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:40.914204 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8eba6-7dc2-4f49-9144-9274f916ad05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:40.914204 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8eba6-7dc2-4f49-9144-9274f916ad05 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:40.917790 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 828/1674] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:40 2022] POST /identity/v3/users => generated 282 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:40.918842 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8eba6-7dc2-4f49-9144-9274f916ad05 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:40.967316 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8eba6-7dc2-4f49-9144-9274f916ad05 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:40.987678 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426c5c7-e5b7-436a-bb30-072738e1959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:40.989317 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426c5c7-e5b7-436a-bb30-072738e1959c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:40.992268 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426c5c7-e5b7-436a-bb30-072738e1959c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:40.992560 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426c5c7-e5b7-436a-bb30-072738e1959c admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:40.993333 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426c5c7-e5b7-436a-bb30-072738e1959c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:40.994993 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426c5c7-e5b7-436a-bb30-072738e1959c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:41.017193 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 829/1675] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:41.018324 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426c5c7-e5b7-436a-bb30-072738e1959c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:41.033312 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b426c5c7-e5b7-436a-bb30-072738e1959c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:41.049689 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426c5c7-e5b7-436a-bb30-072738e1959c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:41.055384 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f33143-674e-4acf-b5f5-22e587c50b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:41.060907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f33143-674e-4acf-b5f5-22e587c50b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:41.060907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f33143-674e-4acf-b5f5-22e587c50b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:41.060907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f33143-674e-4acf-b5f5-22e587c50b8c admin admin] PATH_INFO: `/v3/projects/0b97d3aa33d8479eb2d0f4ba153fb09a` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:41.060907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f33143-674e-4acf-b5f5-22e587c50b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b97d3aa33d8479eb2d0f4ba153fb09a)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:41.060907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: WARNING py.warnings [None req-77f33143-674e-4acf-b5f5-22e587c50b8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 17:09:41.060907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: warnings.warn(msg) Feb 16 17:09:41.060907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: Feb 16 17:09:41.062578 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f33143-674e-4acf-b5f5-22e587c50b8c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:41.068779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2a2ff353-9e8f-4f0f-aa35-9c2e7f44da27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9490c5d94696445ea9731b5db976e93a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:41.069550 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2a2ff353-9e8f-4f0f-aa35-9c2e7f44da27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9490c5d94696445ea9731b5db976e93a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:41.099370 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2a2ff353-9e8f-4f0f-aa35-9c2e7f44da27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9490c5d94696445ea9731b5db976e93a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:41.118008 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2a2ff353-9e8f-4f0f-aa35-9c2e7f44da27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9490c5d94696445ea9731b5db976e93a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:41.119241 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2a2ff353-9e8f-4f0f-aa35-9c2e7f44da27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9490c5d94696445ea9731b5db976e93a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:41.246882 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-77f33143-674e-4acf-b5f5-22e587c50b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b97d3aa33d8479eb2d0f4ba153fb09a', 'request_id': 'req-77f33143-674e-4acf-b5f5-22e587c50b8c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:41.255990 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 847/1676] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:09:40 2022] DELETE /identity/v3/users/9490c5d94696445ea9731b5db976e93a => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:41.256796 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ff353-9e8f-4f0f-aa35-9c2e7f44da27 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:41.257986 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2a2ff353-9e8f-4f0f-aa35-9c2e7f44da27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:41.366949 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-77f33143-674e-4acf-b5f5-22e587c50b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b97d3aa33d8479eb2d0f4ba153fb09a', 'request_id': 'req-77f33143-674e-4acf-b5f5-22e587c50b8c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:41.378013 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-77f33143-674e-4acf-b5f5-22e587c50b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b97d3aa33d8479eb2d0f4ba153fb09a', 'request_id': 'req-77f33143-674e-4acf-b5f5-22e587c50b8c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:41.385782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ff353-9e8f-4f0f-aa35-9c2e7f44da27 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:41.420535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a295913-f055-41f4-b16a-4044911b32fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:41.422750 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a295913-f055-41f4-b16a-4044911b32fb admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:41.423054 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a295913-f055-41f4-b16a-4044911b32fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:41.429748 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a295913-f055-41f4-b16a-4044911b32fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:41.429748 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a295913-f055-41f4-b16a-4044911b32fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:41.434114 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a295913-f055-41f4-b16a-4044911b32fb admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:41.454477 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-77f33143-674e-4acf-b5f5-22e587c50b8c admin admin] The token cache is being invalidate because project 0b97d3aa33d8479eb2d0f4ba153fb09a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:09:41.454802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-77f33143-674e-4acf-b5f5-22e587c50b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:41.457194 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-77f33143-674e-4acf-b5f5-22e587c50b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:41.463760 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 830/1677] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:09:41 2022] DELETE /identity/v3/projects/0b97d3aa33d8479eb2d0f4ba153fb09a => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:41.465995 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f8e9e-32ca-428b-be36-7b0b5e21aafe None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:41.473361 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 848/1678] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:41.474522 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a295913-f055-41f4-b16a-4044911b32fb admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:41.475622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f8e9e-32ca-428b-be36-7b0b5e21aafe None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:41.475932 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f8e9e-32ca-428b-be36-7b0b5e21aafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:41.484962 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5a295913-f055-41f4-b16a-4044911b32fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:41.516649 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a295913-f055-41f4-b16a-4044911b32fb admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:41.518592 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-de5f8e9e-32ca-428b-be36-7b0b5e21aafe None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:41.522896 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-de5f8e9e-32ca-428b-be36-7b0b5e21aafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:41.540538 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16f7aa-b890-40e0-a50a-1186ff6af9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:41.541556 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16f7aa-b890-40e0-a50a-1186ff6af9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:41.541849 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16f7aa-b890-40e0-a50a-1186ff6af9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:41.542130 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16f7aa-b890-40e0-a50a-1186ff6af9b5 admin admin] PATH_INFO: `/v3/users/11418fc704f948b9b7b15de732221bb7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:41.545522 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16f7aa-b890-40e0-a50a-1186ff6af9b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11418fc704f948b9b7b15de732221bb7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:41.547823 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16f7aa-b890-40e0-a50a-1186ff6af9b5 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:41.549041 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 831/1679] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:41.550372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f8e9e-32ca-428b-be36-7b0b5e21aafe None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:41.554106 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-de5f8e9e-32ca-428b-be36-7b0b5e21aafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:41.588778 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f8e9e-32ca-428b-be36-7b0b5e21aafe None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:41.607281 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e393ee1-ff13-4a59-9072-13fff730de7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:41.608214 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e393ee1-ff13-4a59-9072-13fff730de7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:41.609660 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e393ee1-ff13-4a59-9072-13fff730de7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:41.609969 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e393ee1-ff13-4a59-9072-13fff730de7f admin admin] PATH_INFO: `/v3/projects/11ce07acf9674b3097f56909b0c4590e/users/626f86c8841c48988b75066df1fd3474/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:41.646328 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e393ee1-ff13-4a59-9072-13fff730de7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ce07acf9674b3097f56909b0c4590e, user_id=626f86c8841c48988b75066df1fd3474, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:41.649665 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e393ee1-ff13-4a59-9072-13fff730de7f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:41.811191 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 832/1680] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:41 2022] PUT /identity/v3/projects/11ce07acf9674b3097f56909b0c4590e/users/626f86c8841c48988b75066df1fd3474/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:41.823438 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e393ee1-ff13-4a59-9072-13fff730de7f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:41.830096 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-7e393ee1-ff13-4a59-9072-13fff730de7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:41.927662 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e393ee1-ff13-4a59-9072-13fff730de7f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:41.930475 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-cf16f7aa-b890-40e0-a50a-1186ff6af9b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11418fc704f948b9b7b15de732221bb7'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:41.931678 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-cf16f7aa-b890-40e0-a50a-1186ff6af9b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11418fc704f948b9b7b15de732221bb7'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:41.933091 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f459f-2612-4628-9143-fa472c3a17b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:41.934193 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f459f-2612-4628-9143-fa472c3a17b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:41.934468 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f459f-2612-4628-9143-fa472c3a17b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:41.934883 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f459f-2612-4628-9143-fa472c3a17b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:41.937861 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-9d8f459f-2612-4628-9143-fa472c3a17b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:41.948156 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-cf16f7aa-b890-40e0-a50a-1186ff6af9b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11418fc704f948b9b7b15de732221bb7'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:41.958950 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-cf16f7aa-b890-40e0-a50a-1186ff6af9b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11418fc704f948b9b7b15de732221bb7'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:41.961610 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-cf16f7aa-b890-40e0-a50a-1186ff6af9b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11418fc704f948b9b7b15de732221bb7'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:42.054959 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f459f-2612-4628-9143-fa472c3a17b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:42.056600 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f459f-2612-4628-9143-fa472c3a17b8 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:42.075215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 833/1681] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:42.076683 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 849/1682] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:09:41 2022] DELETE /identity/v3/users/11418fc704f948b9b7b15de732221bb7 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:42.080813 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73fdcd-0abc-4f0a-b962-918dee9fd75d None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:42.081386 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73fdcd-0abc-4f0a-b962-918dee9fd75d None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:42.081867 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73fdcd-0abc-4f0a-b962-918dee9fd75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:42.133072 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-1c73fdcd-0abc-4f0a-b962-918dee9fd75d None None] MFA Rules not processed for user `626f86c8841c48988b75066df1fd3474`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:42.134933 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-1c73fdcd-0abc-4f0a-b962-918dee9fd75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:42.152664 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa972c-e109-49b7-9bdc-b51035de5b36 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:42.152959 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa972c-e109-49b7-9bdc-b51035de5b36 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:42.153346 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa972c-e109-49b7-9bdc-b51035de5b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:42.221125 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-f1fa972c-e109-49b7-9bdc-b51035de5b36 None None] MFA Rules not processed for user `7f179fdd8e634fca879f5fc2c996e81b`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:42.222849 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f1fa972c-e109-49b7-9bdc-b51035de5b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:42.272827 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 834/1683] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:42 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:42.280062 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73fdcd-0abc-4f0a-b962-918dee9fd75d None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:42.283697 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-1c73fdcd-0abc-4f0a-b962-918dee9fd75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:42.411654 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 850/1684] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:42 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:42.414308 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73fdcd-0abc-4f0a-b962-918dee9fd75d None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:42.425460 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb517bf5-bb9b-43f5-b771-2829b63fc1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:42.426260 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb517bf5-bb9b-43f5-b771-2829b63fc1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:42.426718 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb517bf5-bb9b-43f5-b771-2829b63fc1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:42.427073 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb517bf5-bb9b-43f5-b771-2829b63fc1e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:42.427954 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb517bf5-bb9b-43f5-b771-2829b63fc1e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:42.430124 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb517bf5-bb9b-43f5-b771-2829b63fc1e0 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:42.558412 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 835/1685] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:42 2022] POST /identity/v3/projects => generated 363 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:42.563899 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa972c-e109-49b7-9bdc-b51035de5b36 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:42.581409 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa972c-e109-49b7-9bdc-b51035de5b36 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:42.695350 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bebcfb-33db-4398-8e15-dd25cdd73181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:42.695853 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bebcfb-33db-4398-8e15-dd25cdd73181 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:42.696210 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bebcfb-33db-4398-8e15-dd25cdd73181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:42.696555 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bebcfb-33db-4398-8e15-dd25cdd73181 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:42.697610 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bebcfb-33db-4398-8e15-dd25cdd73181 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:42.699676 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bebcfb-33db-4398-8e15-dd25cdd73181 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:42.866395 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 851/1686] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:42 2022] POST /identity/v3/users => generated 288 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:42.869596 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb517bf5-bb9b-43f5-b771-2829b63fc1e0 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:42.885347 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb517bf5-bb9b-43f5-b771-2829b63fc1e0 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:42.905025 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd7e4e-8629-4b89-a3a3-99893e61d02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:42.906417 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd7e4e-8629-4b89-a3a3-99893e61d02a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:42.907057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd7e4e-8629-4b89-a3a3-99893e61d02a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:42.907439 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd7e4e-8629-4b89-a3a3-99893e61d02a admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:42.908609 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd7e4e-8629-4b89-a3a3-99893e61d02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:42.910285 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd7e4e-8629-4b89-a3a3-99893e61d02a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:42.925353 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 836/1687] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:42.928165 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bebcfb-33db-4398-8e15-dd25cdd73181 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:42.946835 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bebcfb-33db-4398-8e15-dd25cdd73181 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:42.952618 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6eed6-aa1c-406c-a6d9-25d7583d4015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:42.953611 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6eed6-aa1c-406c-a6d9-25d7583d4015 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:42.954346 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6eed6-aa1c-406c-a6d9-25d7583d4015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:42.954346 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6eed6-aa1c-406c-a6d9-25d7583d4015 admin admin] PATH_INFO: `/v3/projects/bb96c01efc47434b968a3f7669a9fb68/users/a54b06fce77b45d387c5de5762202a34/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:42.973045 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6eed6-aa1c-406c-a6d9-25d7583d4015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb96c01efc47434b968a3f7669a9fb68, user_id=a54b06fce77b45d387c5de5762202a34, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:42.976524 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6eed6-aa1c-406c-a6d9-25d7583d4015 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:43.119556 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 852/1688] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:42 2022] PUT /identity/v3/projects/bb96c01efc47434b968a3f7669a9fb68/users/a54b06fce77b45d387c5de5762202a34/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:43.119741 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd7e4e-8629-4b89-a3a3-99893e61d02a admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:43.127892 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd7e4e-8629-4b89-a3a3-99893e61d02a admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:43.224612 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5890e-9f9b-423a-92e6-f01cdbc311cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:43.225545 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5890e-9f9b-423a-92e6-f01cdbc311cc admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:43.225969 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5890e-9f9b-423a-92e6-f01cdbc311cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:43.226398 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5890e-9f9b-423a-92e6-f01cdbc311cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:43.227433 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5890e-9f9b-423a-92e6-f01cdbc311cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:43.230380 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5890e-9f9b-423a-92e6-f01cdbc311cc admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:43.246358 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 837/1689] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:43.251057 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6eed6-aa1c-406c-a6d9-25d7583d4015 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:43.271107 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6eed6-aa1c-406c-a6d9-25d7583d4015 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:43.280044 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa6c7a-a8cb-4b5e-8d47-cecd2c3c0b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:43.282330 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa6c7a-a8cb-4b5e-8d47-cecd2c3c0b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:43.282785 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa6c7a-a8cb-4b5e-8d47-cecd2c3c0b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:43.312527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa6c7a-a8cb-4b5e-8d47-cecd2c3c0b87 admin admin] PATH_INFO: `/v3/projects/bb96c01efc47434b968a3f7669a9fb68/users/a54b06fce77b45d387c5de5762202a34/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:43.312527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa6c7a-a8cb-4b5e-8d47-cecd2c3c0b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb96c01efc47434b968a3f7669a9fb68, user_id=a54b06fce77b45d387c5de5762202a34, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:43.312527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa6c7a-a8cb-4b5e-8d47-cecd2c3c0b87 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:43.312527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 853/1690] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:43 2022] PUT /identity/v3/projects/bb96c01efc47434b968a3f7669a9fb68/users/a54b06fce77b45d387c5de5762202a34/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:43.313891 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e4f8a-9379-417a-a1cc-35fee3912986 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:43.314298 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e4f8a-9379-417a-a1cc-35fee3912986 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:43.314688 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e4f8a-9379-417a-a1cc-35fee3912986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:43.372080 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-701e4f8a-9379-417a-a1cc-35fee3912986 None None] MFA Rules not processed for user `a54b06fce77b45d387c5de5762202a34`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:43.373300 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-701e4f8a-9379-417a-a1cc-35fee3912986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:43.501858 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 838/1691] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:43 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:43.508145 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa6c7a-a8cb-4b5e-8d47-cecd2c3c0b87 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:43.510281 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-1cfa6c7a-a8cb-4b5e-8d47-cecd2c3c0b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:43.527339 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e4f8a-9379-417a-a1cc-35fee3912986 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:43.529364 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-701e4f8a-9379-417a-a1cc-35fee3912986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:43.681794 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa6c7a-a8cb-4b5e-8d47-cecd2c3c0b87 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:43.697382 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bbee7-5876-4a8a-8707-d34797a6b551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:43.698202 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bbee7-5876-4a8a-8707-d34797a6b551 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:43.698487 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bbee7-5876-4a8a-8707-d34797a6b551 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:43.698860 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bbee7-5876-4a8a-8707-d34797a6b551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:43.710932 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e4f8a-9379-417a-a1cc-35fee3912986 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:43.718890 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4899447-fc0a-4348-88b9-ce02c8a2ceb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:43.719925 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4899447-fc0a-4348-88b9-ce02c8a2ceb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:43.723854 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4899447-fc0a-4348-88b9-ce02c8a2ceb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:43.724490 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4899447-fc0a-4348-88b9-ce02c8a2ceb1 admin admin] PATH_INFO: `/v3/projects/8df95163760d4b77a64fff45618b6a41` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:43.725780 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4899447-fc0a-4348-88b9-ce02c8a2ceb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df95163760d4b77a64fff45618b6a41)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:43.731008 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4899447-fc0a-4348-88b9-ce02c8a2ceb1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:43.737022 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289bbee7-5876-4a8a-8707-d34797a6b551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:43.739991 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289bbee7-5876-4a8a-8707-d34797a6b551 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:43.782745 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 854/1692] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:43 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:43.784804 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bbee7-5876-4a8a-8707-d34797a6b551 service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:43.791677 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-289bbee7-5876-4a8a-8707-d34797a6b551 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:43.848518 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bbee7-5876-4a8a-8707-d34797a6b551 service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:43.854963 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfec53-71d2-4924-abfe-c129ec5215cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:43.855903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfec53-71d2-4924-abfe-c129ec5215cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:43.856229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfec53-71d2-4924-abfe-c129ec5215cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:43.856509 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfec53-71d2-4924-abfe-c129ec5215cb admin admin] PATH_INFO: `/v3/projects/4962345bfd53441da1727aa1ef52da1e` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:43.861533 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfec53-71d2-4924-abfe-c129ec5215cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4962345bfd53441da1727aa1ef52da1e)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:43.867784 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfec53-71d2-4924-abfe-c129ec5215cb admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:44.005329 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d4899447-fc0a-4348-88b9-ce02c8a2ceb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df95163760d4b77a64fff45618b6a41', 'request_id': 'req-d4899447-fc0a-4348-88b9-ce02c8a2ceb1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:44.055754 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-48dfec53-71d2-4924-abfe-c129ec5215cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4962345bfd53441da1727aa1ef52da1e', 'request_id': 'req-48dfec53-71d2-4924-abfe-c129ec5215cb'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:44.106180 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d4899447-fc0a-4348-88b9-ce02c8a2ceb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df95163760d4b77a64fff45618b6a41', 'request_id': 'req-d4899447-fc0a-4348-88b9-ce02c8a2ceb1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:44.114317 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d4899447-fc0a-4348-88b9-ce02c8a2ceb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df95163760d4b77a64fff45618b6a41', 'request_id': 'req-d4899447-fc0a-4348-88b9-ce02c8a2ceb1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:44.129514 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d4899447-fc0a-4348-88b9-ce02c8a2ceb1 admin admin] The token cache is being invalidate because project 8df95163760d4b77a64fff45618b6a41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:09:44.131612 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d4899447-fc0a-4348-88b9-ce02c8a2ceb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:44.132961 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d4899447-fc0a-4348-88b9-ce02c8a2ceb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:44.135642 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 839/1693] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:09:43 2022] DELETE /identity/v3/projects/8df95163760d4b77a64fff45618b6a41 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:09:44.137336 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4899447-fc0a-4348-88b9-ce02c8a2ceb1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:44.140357 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d4899447-fc0a-4348-88b9-ce02c8a2ceb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:44.170564 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-48dfec53-71d2-4924-abfe-c129ec5215cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4962345bfd53441da1727aa1ef52da1e', 'request_id': 'req-48dfec53-71d2-4924-abfe-c129ec5215cb'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:44.177638 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-48dfec53-71d2-4924-abfe-c129ec5215cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4962345bfd53441da1727aa1ef52da1e', 'request_id': 'req-48dfec53-71d2-4924-abfe-c129ec5215cb'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:44.215321 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-48dfec53-71d2-4924-abfe-c129ec5215cb admin admin] The token cache is being invalidate because project 4962345bfd53441da1727aa1ef52da1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:09:44.215615 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-48dfec53-71d2-4924-abfe-c129ec5215cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:44.222190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-48dfec53-71d2-4924-abfe-c129ec5215cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:44.228450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 855/1694] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:09:43 2022] DELETE /identity/v3/projects/4962345bfd53441da1727aa1ef52da1e => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:44.228450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09634f-b472-4bd0-93e3-88d4648f97e9 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:44.228450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09634f-b472-4bd0-93e3-88d4648f97e9 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:44.228450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09634f-b472-4bd0-93e3-88d4648f97e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:44.237227 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4899447-fc0a-4348-88b9-ce02c8a2ceb1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:44.254905 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-2e09634f-b472-4bd0-93e3-88d4648f97e9 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:44.269687 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2e09634f-b472-4bd0-93e3-88d4648f97e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:44.354292 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780a6aa-8a78-4e54-9b0b-6ba5127f81f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:44.355463 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780a6aa-8a78-4e54-9b0b-6ba5127f81f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:44.355907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780a6aa-8a78-4e54-9b0b-6ba5127f81f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:44.356431 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780a6aa-8a78-4e54-9b0b-6ba5127f81f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:44.358744 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-3780a6aa-8a78-4e54-9b0b-6ba5127f81f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:44.409061 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 856/1695] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:44.411919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cd781-524a-40dd-bd9d-cf2fb0a819bb None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:44.412427 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cd781-524a-40dd-bd9d-cf2fb0a819bb None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:44.412934 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cd781-524a-40dd-bd9d-cf2fb0a819bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:44.430199 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780a6aa-8a78-4e54-9b0b-6ba5127f81f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:44.432802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780a6aa-8a78-4e54-9b0b-6ba5127f81f2 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:44.446582 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 840/1696] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:44 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:44.448298 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42656260-030b-4d4b-8840-67b146b594d0 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:44.448919 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42656260-030b-4d4b-8840-67b146b594d0 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:44.449373 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42656260-030b-4d4b-8840-67b146b594d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:44.472021 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-573cd781-524a-40dd-bd9d-cf2fb0a819bb None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:44.473299 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-573cd781-524a-40dd-bd9d-cf2fb0a819bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:44.484787 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-42656260-030b-4d4b-8840-67b146b594d0 None None] MFA Rules not processed for user `dd1b4007dbea4e46835dcf36bdb8b727`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:44.485984 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-42656260-030b-4d4b-8840-67b146b594d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:44.515846 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 857/1697] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:44.517606 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446f478-de83-4d23-9190-af2d62dc06be None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:44.521223 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446f478-de83-4d23-9190-af2d62dc06be None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:44.521669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446f478-de83-4d23-9190-af2d62dc06be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:44.560644 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-a446f478-de83-4d23-9190-af2d62dc06be None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:44.562379 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a446f478-de83-4d23-9190-af2d62dc06be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:44.587658 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 858/1698] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:44.595001 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 841/1699] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:44.596207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42656260-030b-4d4b-8840-67b146b594d0 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:44.604521 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e542713-263a-4b09-8036-2473e9dcd489 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:44.606088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e542713-263a-4b09-8036-2473e9dcd489 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:44.606383 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e542713-263a-4b09-8036-2473e9dcd489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:44.621558 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42656260-030b-4d4b-8840-67b146b594d0 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:44.648574 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-8e542713-263a-4b09-8036-2473e9dcd489 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:44.649428 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342a6af-e1f2-496e-b2b0-f0af5b8239b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:44.649860 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8e542713-263a-4b09-8036-2473e9dcd489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:44.650912 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342a6af-e1f2-496e-b2b0-f0af5b8239b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:44.651387 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342a6af-e1f2-496e-b2b0-f0af5b8239b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:44.651868 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342a6af-e1f2-496e-b2b0-f0af5b8239b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:44.652851 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342a6af-e1f2-496e-b2b0-f0af5b8239b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:09:44.653363 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342a6af-e1f2-496e-b2b0-f0af5b8239b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:44.656281 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342a6af-e1f2-496e-b2b0-f0af5b8239b6 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:44.662058 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 859/1700] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:44.663649 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e542713-263a-4b09-8036-2473e9dcd489 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:44.664387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8e542713-263a-4b09-8036-2473e9dcd489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:44.679680 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 842/1701] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:09:44.684289 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342a6af-e1f2-496e-b2b0-f0af5b8239b6 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:44.700415 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342a6af-e1f2-496e-b2b0-f0af5b8239b6 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:44.707566 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94700372-46b9-40dd-995e-4019b855e1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:44.708523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94700372-46b9-40dd-995e-4019b855e1ba admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:44.708996 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94700372-46b9-40dd-995e-4019b855e1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:44.709556 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94700372-46b9-40dd-995e-4019b855e1ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:44.710477 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94700372-46b9-40dd-995e-4019b855e1ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:09:44.711212 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94700372-46b9-40dd-995e-4019b855e1ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:44.713071 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94700372-46b9-40dd-995e-4019b855e1ba admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:44.741366 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 843/1702] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:09:44.742833 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94700372-46b9-40dd-995e-4019b855e1ba admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:44.767671 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e542713-263a-4b09-8036-2473e9dcd489 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:44.775254 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364082d4-f71a-46f8-8cc3-ff9af4ff89d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:44.775852 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94700372-46b9-40dd-995e-4019b855e1ba admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:44.775954 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364082d4-f71a-46f8-8cc3-ff9af4ff89d9 service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:44.777824 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364082d4-f71a-46f8-8cc3-ff9af4ff89d9 service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:44.778120 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364082d4-f71a-46f8-8cc3-ff9af4ff89d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:44.788419 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0fea0-5b8b-4bfe-b7ca-78c52a295699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:44.789363 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0fea0-5b8b-4bfe-b7ca-78c52a295699 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:44.789735 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0fea0-5b8b-4bfe-b7ca-78c52a295699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:44.790127 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0fea0-5b8b-4bfe-b7ca-78c52a295699 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:44.791422 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0fea0-5b8b-4bfe-b7ca-78c52a295699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:44.798358 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0fea0-5b8b-4bfe-b7ca-78c52a295699 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:44.817485 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364082d4-f71a-46f8-8cc3-ff9af4ff89d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:44.819397 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364082d4-f71a-46f8-8cc3-ff9af4ff89d9 service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:44.834511 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 860/1703] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:44.835382 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364082d4-f71a-46f8-8cc3-ff9af4ff89d9 service nova] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:44.870351 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364082d4-f71a-46f8-8cc3-ff9af4ff89d9 service nova] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:44.886455 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94eb2b-ddcf-4f5f-9d4f-fdee0217e328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:44.890827 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94eb2b-ddcf-4f5f-9d4f-fdee0217e328 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:44.891511 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94eb2b-ddcf-4f5f-9d4f-fdee0217e328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:44.891511 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94eb2b-ddcf-4f5f-9d4f-fdee0217e328 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:44.892773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94eb2b-ddcf-4f5f-9d4f-fdee0217e328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:44.898265 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94eb2b-ddcf-4f5f-9d4f-fdee0217e328 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:44.966832 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 844/1704] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:44 2022] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:44.974988 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0fea0-5b8b-4bfe-b7ca-78c52a295699 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:45.111952 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 861/1705] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:44 2022] POST /identity/v3/projects => generated 363 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:45.115849 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94eb2b-ddcf-4f5f-9d4f-fdee0217e328 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:45.136718 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0fea0-5b8b-4bfe-b7ca-78c52a295699 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:45.301093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94eb2b-ddcf-4f5f-9d4f-fdee0217e328 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:45.302989 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352948c3-8022-4b67-ac56-326ba77d323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:45.304016 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352948c3-8022-4b67-ac56-326ba77d323d admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:45.304467 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352948c3-8022-4b67-ac56-326ba77d323d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:45.305288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352948c3-8022-4b67-ac56-326ba77d323d admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:45.306170 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352948c3-8022-4b67-ac56-326ba77d323d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:45.308631 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352948c3-8022-4b67-ac56-326ba77d323d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:45.324823 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a4140-a704-41f4-b28c-085f71a9e66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:45.325525 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a4140-a704-41f4-b28c-085f71a9e66e admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:45.325964 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a4140-a704-41f4-b28c-085f71a9e66e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:45.326242 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a4140-a704-41f4-b28c-085f71a9e66e admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:45.327610 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a4140-a704-41f4-b28c-085f71a9e66e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:45.334611 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a4140-a704-41f4-b28c-085f71a9e66e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:45.462409 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 845/1706] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:44 2022] POST /identity/v3/users => generated 287 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:45.464495 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50725543-ced3-4735-8656-e4f9e9d656e8 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:45.464957 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50725543-ced3-4735-8656-e4f9e9d656e8 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:45.465252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50725543-ced3-4735-8656-e4f9e9d656e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:45.507749 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-50725543-ced3-4735-8656-e4f9e9d656e8 None None] MFA Rules not processed for user `db53f0b9c80640dc9e93349861182d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:45.510360 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-50725543-ced3-4735-8656-e4f9e9d656e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:45.524273 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 862/1707] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:45 2022] POST /identity/v3/users => generated 282 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:45.525123 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a4140-a704-41f4-b28c-085f71a9e66e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:45.537802 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a4140-a704-41f4-b28c-085f71a9e66e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:45.542822 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dd864-d09e-4bfc-a261-8b930dc9b3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:45.543791 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dd864-d09e-4bfc-a261-8b930dc9b3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:45.543791 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dd864-d09e-4bfc-a261-8b930dc9b3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:45.544034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dd864-d09e-4bfc-a261-8b930dc9b3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:45.544755 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dd864-d09e-4bfc-a261-8b930dc9b3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:45.547429 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dd864-d09e-4bfc-a261-8b930dc9b3a5 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:45.557894 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 863/1708] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:45.558507 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dd864-d09e-4bfc-a261-8b930dc9b3a5 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:45.572692 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dd864-d09e-4bfc-a261-8b930dc9b3a5 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:45.586689 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d38fe0-aefa-4813-89c1-adabe8dc404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:45.587935 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d38fe0-aefa-4813-89c1-adabe8dc404b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:45.588224 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d38fe0-aefa-4813-89c1-adabe8dc404b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:45.588504 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d38fe0-aefa-4813-89c1-adabe8dc404b admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:45.589297 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d38fe0-aefa-4813-89c1-adabe8dc404b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:45.592320 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d38fe0-aefa-4813-89c1-adabe8dc404b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:45.599252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 846/1709] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:45.600823 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50725543-ced3-4735-8656-e4f9e9d656e8 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:45.613214 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50725543-ced3-4735-8656-e4f9e9d656e8 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:45.615667 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 864/1710] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:45.616836 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d38fe0-aefa-4813-89c1-adabe8dc404b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:45.618510 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-53d38fe0-aefa-4813-89c1-adabe8dc404b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:45.619610 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7aee5-e3bb-470e-a6b6-6f91a6732af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:45.622210 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7aee5-e3bb-470e-a6b6-6f91a6732af5 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:45.622210 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7aee5-e3bb-470e-a6b6-6f91a6732af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:45.622210 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7aee5-e3bb-470e-a6b6-6f91a6732af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:45.622210 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7aee5-e3bb-470e-a6b6-6f91a6732af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:45.623804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7aee5-e3bb-470e-a6b6-6f91a6732af5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:45.638473 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 847/1711] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:45.644618 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7aee5-e3bb-470e-a6b6-6f91a6732af5 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:45.656336 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7aee5-e3bb-470e-a6b6-6f91a6732af5 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:45.661687 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2e827-cd0b-49b0-a10f-aed8c5b86cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:45.666802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2e827-cd0b-49b0-a10f-aed8c5b86cba admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:45.666802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2e827-cd0b-49b0-a10f-aed8c5b86cba admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:45.666802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2e827-cd0b-49b0-a10f-aed8c5b86cba admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:45.666802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2e827-cd0b-49b0-a10f-aed8c5b86cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:45.666802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2e827-cd0b-49b0-a10f-aed8c5b86cba admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:45.682211 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 848/1712] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:45.683053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2e827-cd0b-49b0-a10f-aed8c5b86cba admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:45.697195 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2e827-cd0b-49b0-a10f-aed8c5b86cba admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:45.716916 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d96c4-1d8c-47d2-952c-2c4c7d918929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:45.718388 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d96c4-1d8c-47d2-952c-2c4c7d918929 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:45.719705 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d96c4-1d8c-47d2-952c-2c4c7d918929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:45.720004 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d96c4-1d8c-47d2-952c-2c4c7d918929 admin admin] PATH_INFO: `/v3/projects/75b777102cc94352842991d4a83d1749/users/c5ec6f8ba65a4ccdba33dcef06a3750e/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:45.764083 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d96c4-1d8c-47d2-952c-2c4c7d918929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75b777102cc94352842991d4a83d1749, user_id=c5ec6f8ba65a4ccdba33dcef06a3750e, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:45.764169 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d38fe0-aefa-4813-89c1-adabe8dc404b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:45.764263 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d96c4-1d8c-47d2-952c-2c4c7d918929 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:45.775238 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaf70c-04b9-4ae4-8b66-03fe8f285904 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:45.777485 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaf70c-04b9-4ae4-8b66-03fe8f285904 service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:45.777970 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaf70c-04b9-4ae4-8b66-03fe8f285904 service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:45.778787 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaf70c-04b9-4ae4-8b66-03fe8f285904 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:45.791321 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbaf70c-04b9-4ae4-8b66-03fe8f285904 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:45.797263 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbaf70c-04b9-4ae4-8b66-03fe8f285904 service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:45.810074 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 865/1713] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:45.813194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaf70c-04b9-4ae4-8b66-03fe8f285904 service nova] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:45.836653 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaf70c-04b9-4ae4-8b66-03fe8f285904 service nova] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:45.849189 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218cf2e-9dd1-4fbf-8551-e9b4e4e4676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:45.850147 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218cf2e-9dd1-4fbf-8551-e9b4e4e4676d admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:45.850432 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218cf2e-9dd1-4fbf-8551-e9b4e4e4676d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:45.850778 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218cf2e-9dd1-4fbf-8551-e9b4e4e4676d admin admin] PATH_INFO: `/v3/projects/450fd659900049bbb0e05fb11daf2ae9/users/1f585ba25f0649639150f70b07ba3ce2/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:45.872768 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218cf2e-9dd1-4fbf-8551-e9b4e4e4676d admin admin] RBAC: Authorizing `identity:create_grant(project_id=450fd659900049bbb0e05fb11daf2ae9, user_id=1f585ba25f0649639150f70b07ba3ce2, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:45.876157 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218cf2e-9dd1-4fbf-8551-e9b4e4e4676d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:45.934513 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 849/1714] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:45 2022] PUT /identity/v3/projects/75b777102cc94352842991d4a83d1749/users/c5ec6f8ba65a4ccdba33dcef06a3750e/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:45.946518 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f44c2-8565-43d4-b127-741a7418d2aa None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:45.950448 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f44c2-8565-43d4-b127-741a7418d2aa None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:45.950448 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f44c2-8565-43d4-b127-741a7418d2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:45.990060 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 866/1715] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:45 2022] PUT /identity/v3/projects/450fd659900049bbb0e05fb11daf2ae9/users/1f585ba25f0649639150f70b07ba3ce2/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:46.001851 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97597bc-dc34-4ae4-ab88-19a6be37ba6f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:46.002131 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97597bc-dc34-4ae4-ab88-19a6be37ba6f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:46.003056 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97597bc-dc34-4ae4-ab88-19a6be37ba6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:46.037763 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-b50f44c2-8565-43d4-b127-741a7418d2aa None None] MFA Rules not processed for user `c5ec6f8ba65a4ccdba33dcef06a3750e`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:46.039246 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b50f44c2-8565-43d4-b127-741a7418d2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:46.102580 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-f97597bc-dc34-4ae4-ab88-19a6be37ba6f None None] MFA Rules not processed for user `1f585ba25f0649639150f70b07ba3ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:46.103467 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f97597bc-dc34-4ae4-ab88-19a6be37ba6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:46.209732 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 850/1716] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:46.230514 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f44c2-8565-43d4-b127-741a7418d2aa None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:46.326616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 867/1717] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:46 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:46.332368 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97597bc-dc34-4ae4-ab88-19a6be37ba6f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:46.482243 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f44c2-8565-43d4-b127-741a7418d2aa None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:46.494620 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062568f2-17ba-490c-b683-e5e2254f21c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:46.495460 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062568f2-17ba-490c-b683-e5e2254f21c4 service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:46.499327 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062568f2-17ba-490c-b683-e5e2254f21c4 service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:46.499327 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062568f2-17ba-490c-b683-e5e2254f21c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:46.510574 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97597bc-dc34-4ae4-ab88-19a6be37ba6f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:46.518007 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d8199-aa72-4ec0-83b9-7a3abc4eb8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:46.519326 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d8199-aa72-4ec0-83b9-7a3abc4eb8bd admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:46.519875 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d8199-aa72-4ec0-83b9-7a3abc4eb8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:46.520378 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d8199-aa72-4ec0-83b9-7a3abc4eb8bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:46.521336 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d8199-aa72-4ec0-83b9-7a3abc4eb8bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:46.528542 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d8199-aa72-4ec0-83b9-7a3abc4eb8bd admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:46.549061 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062568f2-17ba-490c-b683-e5e2254f21c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:46.550731 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062568f2-17ba-490c-b683-e5e2254f21c4 service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:46.564991 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 851/1718] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:46.566024 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062568f2-17ba-490c-b683-e5e2254f21c4 service nova] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:46.567958 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-062568f2-17ba-490c-b683-e5e2254f21c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:46.596169 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062568f2-17ba-490c-b683-e5e2254f21c4 service nova] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:46.620134 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180704b3-f53c-4ecc-9669-86c5036d5a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:46.624540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180704b3-f53c-4ecc-9669-86c5036d5a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:46.624934 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180704b3-f53c-4ecc-9669-86c5036d5a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:46.625462 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180704b3-f53c-4ecc-9669-86c5036d5a06 admin admin] PATH_INFO: `/v3/users/f4cab702a26e4ec6b102dcb7f0fef587` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:46.628418 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180704b3-f53c-4ecc-9669-86c5036d5a06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4cab702a26e4ec6b102dcb7f0fef587)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:46.630554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180704b3-f53c-4ecc-9669-86c5036d5a06 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:46.668485 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 868/1719] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:46 2022] POST /identity/v3/projects => generated 363 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:46.673584 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d8199-aa72-4ec0-83b9-7a3abc4eb8bd admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:46.828496 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d8199-aa72-4ec0-83b9-7a3abc4eb8bd admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:46.835617 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae6184-afec-4c92-80a8-a72762fd64ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:46.836351 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae6184-afec-4c92-80a8-a72762fd64ad admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:46.836661 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae6184-afec-4c92-80a8-a72762fd64ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:46.836939 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae6184-afec-4c92-80a8-a72762fd64ad admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:46.837646 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae6184-afec-4c92-80a8-a72762fd64ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:46.839970 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae6184-afec-4c92-80a8-a72762fd64ad admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:46.912578 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-180704b3-f53c-4ecc-9669-86c5036d5a06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4cab702a26e4ec6b102dcb7f0fef587'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:46.913362 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-180704b3-f53c-4ecc-9669-86c5036d5a06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4cab702a26e4ec6b102dcb7f0fef587'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:46.931153 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-180704b3-f53c-4ecc-9669-86c5036d5a06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4cab702a26e4ec6b102dcb7f0fef587'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:46.943197 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-180704b3-f53c-4ecc-9669-86c5036d5a06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4cab702a26e4ec6b102dcb7f0fef587'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:46.985681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 869/1720] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:46 2022] POST /identity/v3/users => generated 288 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:46.987873 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae6184-afec-4c92-80a8-a72762fd64ad admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:46.991924 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-9fae6184-afec-4c92-80a8-a72762fd64ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:47.008088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae6184-afec-4c92-80a8-a72762fd64ad admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:47.016852 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db57c2-b7ac-4516-abc7-6e7d98f7000d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:47.016852 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db57c2-b7ac-4516-abc7-6e7d98f7000d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:47.016852 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db57c2-b7ac-4516-abc7-6e7d98f7000d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:47.016852 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db57c2-b7ac-4516-abc7-6e7d98f7000d admin admin] PATH_INFO: `/v3/users/c5ec6f8ba65a4ccdba33dcef06a3750e` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:47.017386 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db57c2-b7ac-4516-abc7-6e7d98f7000d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5ec6f8ba65a4ccdba33dcef06a3750e)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:47.019362 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db57c2-b7ac-4516-abc7-6e7d98f7000d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:47.066824 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-180704b3-f53c-4ecc-9669-86c5036d5a06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4cab702a26e4ec6b102dcb7f0fef587'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:47.074975 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 852/1721] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:09:46 2022] DELETE /identity/v3/users/f4cab702a26e4ec6b102dcb7f0fef587 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:47.075572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180704b3-f53c-4ecc-9669-86c5036d5a06 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:47.087067 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-180704b3-f53c-4ecc-9669-86c5036d5a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:47.231752 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180704b3-f53c-4ecc-9669-86c5036d5a06 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:47.243211 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2b02b-6e97-47a9-89be-2d35e26d1ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:47.245314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2b02b-6e97-47a9-89be-2d35e26d1ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:47.245599 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2b02b-6e97-47a9-89be-2d35e26d1ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:47.246654 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2b02b-6e97-47a9-89be-2d35e26d1ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:47.247678 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2b02b-6e97-47a9-89be-2d35e26d1ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:47.252882 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2b02b-6e97-47a9-89be-2d35e26d1ea4 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:47.260155 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-36db57c2-b7ac-4516-abc7-6e7d98f7000d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5ec6f8ba65a4ccdba33dcef06a3750e'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:47.260876 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-36db57c2-b7ac-4516-abc7-6e7d98f7000d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5ec6f8ba65a4ccdba33dcef06a3750e'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:47.278738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 853/1722] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:47.278738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2b02b-6e97-47a9-89be-2d35e26d1ea4 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:47.285149 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f8c2b02b-6e97-47a9-89be-2d35e26d1ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:47.290117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-36db57c2-b7ac-4516-abc7-6e7d98f7000d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5ec6f8ba65a4ccdba33dcef06a3750e'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:47.304789 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2b02b-6e97-47a9-89be-2d35e26d1ea4 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:47.307415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-36db57c2-b7ac-4516-abc7-6e7d98f7000d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5ec6f8ba65a4ccdba33dcef06a3750e'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:47.308137 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-36db57c2-b7ac-4516-abc7-6e7d98f7000d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5ec6f8ba65a4ccdba33dcef06a3750e'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:47.313080 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a31cd-fed0-4e53-8d83-0dd6dea01038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:47.314761 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a31cd-fed0-4e53-8d83-0dd6dea01038 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:47.315530 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a31cd-fed0-4e53-8d83-0dd6dea01038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:47.316139 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a31cd-fed0-4e53-8d83-0dd6dea01038 admin admin] PATH_INFO: `/v3/projects/8771b220f4f043d0b9e29732596bf106/users/884cabea10684e9c8872d23c570639b9/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:47.340648 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a31cd-fed0-4e53-8d83-0dd6dea01038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8771b220f4f043d0b9e29732596bf106, user_id=884cabea10684e9c8872d23c570639b9, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:47.347941 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a31cd-fed0-4e53-8d83-0dd6dea01038 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:47.414787 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 870/1723] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:09:46 2022] DELETE /identity/v3/users/c5ec6f8ba65a4ccdba33dcef06a3750e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:47.418406 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2fce2-a317-4ebe-a0e8-d1015abbc463 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:47.418723 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2fce2-a317-4ebe-a0e8-d1015abbc463 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:47.419055 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2fce2-a317-4ebe-a0e8-d1015abbc463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:47.441298 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-5ee2fce2-a317-4ebe-a0e8-d1015abbc463 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:47.442781 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5ee2fce2-a317-4ebe-a0e8-d1015abbc463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:47.501622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 854/1724] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:47 2022] PUT /identity/v3/projects/8771b220f4f043d0b9e29732596bf106/users/884cabea10684e9c8872d23c570639b9/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:47.505877 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a31cd-fed0-4e53-8d83-0dd6dea01038 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:47.731767 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a31cd-fed0-4e53-8d83-0dd6dea01038 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:47.736542 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 871/1725] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:09:47.737182 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2fce2-a317-4ebe-a0e8-d1015abbc463 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:47.738515 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5ee2fce2-a317-4ebe-a0e8-d1015abbc463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:47.751430 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3112ea1-6475-44e3-9a48-b164db073270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:47.752119 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3112ea1-6475-44e3-9a48-b164db073270 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:47.752476 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3112ea1-6475-44e3-9a48-b164db073270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:47.752672 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3112ea1-6475-44e3-9a48-b164db073270 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:47.753675 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3112ea1-6475-44e3-9a48-b164db073270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:47.754988 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2fce2-a317-4ebe-a0e8-d1015abbc463 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:47.755239 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3112ea1-6475-44e3-9a48-b164db073270 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:47.766696 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd7603-1225-4551-a4fb-ee5e398ce9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:47.767564 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd7603-1225-4551-a4fb-ee5e398ce9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:47.767849 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd7603-1225-4551-a4fb-ee5e398ce9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:47.768121 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd7603-1225-4551-a4fb-ee5e398ce9a3 admin admin] PATH_INFO: `/v3/projects/fed1e50a307f4038b904d12fd2ef5e6d` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:47.772479 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd7603-1225-4551-a4fb-ee5e398ce9a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fed1e50a307f4038b904d12fd2ef5e6d)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:47.775129 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd7603-1225-4551-a4fb-ee5e398ce9a3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:47.783585 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 855/1726] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:47.786298 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3112ea1-6475-44e3-9a48-b164db073270 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:47.791694 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b3112ea1-6475-44e3-9a48-b164db073270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:47.875210 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3112ea1-6475-44e3-9a48-b164db073270 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:47.878010 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8958b1-95f7-409e-96b1-13bf2c033548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:47.878845 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8958b1-95f7-409e-96b1-13bf2c033548 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:47.879234 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8958b1-95f7-409e-96b1-13bf2c033548 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:47.879611 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8958b1-95f7-409e-96b1-13bf2c033548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:47.891986 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8958b1-95f7-409e-96b1-13bf2c033548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:47.894036 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8958b1-95f7-409e-96b1-13bf2c033548 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:47.907300 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 856/1727] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:47.908230 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8958b1-95f7-409e-96b1-13bf2c033548 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:47.938228 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8958b1-95f7-409e-96b1-13bf2c033548 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:47.993579 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-64fd7603-1225-4551-a4fb-ee5e398ce9a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fed1e50a307f4038b904d12fd2ef5e6d', 'request_id': 'req-64fd7603-1225-4551-a4fb-ee5e398ce9a3'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:48.029925 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1835b8-6fcf-43aa-9eb4-b55f558363e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:48.031760 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1835b8-6fcf-43aa-9eb4-b55f558363e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:48.031931 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1835b8-6fcf-43aa-9eb4-b55f558363e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:48.032210 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1835b8-6fcf-43aa-9eb4-b55f558363e9 admin admin] PATH_INFO: `/v3/projects/8771b220f4f043d0b9e29732596bf106/users/884cabea10684e9c8872d23c570639b9/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:48.034437 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1835b8-6fcf-43aa-9eb4-b55f558363e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8771b220f4f043d0b9e29732596bf106, user_id=884cabea10684e9c8872d23c570639b9, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:48.037650 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1835b8-6fcf-43aa-9eb4-b55f558363e9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:48.060198 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 857/1728] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:47 2022] PUT /identity/v3/projects/8771b220f4f043d0b9e29732596bf106/users/884cabea10684e9c8872d23c570639b9/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:48.066083 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e076fb4-7300-4021-8470-8598ff3dece8 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:48.066083 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e076fb4-7300-4021-8470-8598ff3dece8 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:48.066083 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e076fb4-7300-4021-8470-8598ff3dece8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:48.095979 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-5e076fb4-7300-4021-8470-8598ff3dece8 None None] MFA Rules not processed for user `884cabea10684e9c8872d23c570639b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:48.097349 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-5e076fb4-7300-4021-8470-8598ff3dece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:48.098222 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-64fd7603-1225-4551-a4fb-ee5e398ce9a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fed1e50a307f4038b904d12fd2ef5e6d', 'request_id': 'req-64fd7603-1225-4551-a4fb-ee5e398ce9a3'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:48.109557 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-64fd7603-1225-4551-a4fb-ee5e398ce9a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fed1e50a307f4038b904d12fd2ef5e6d', 'request_id': 'req-64fd7603-1225-4551-a4fb-ee5e398ce9a3'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:48.127155 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-64fd7603-1225-4551-a4fb-ee5e398ce9a3 admin admin] The token cache is being invalidate because project fed1e50a307f4038b904d12fd2ef5e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:09:48.127736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-64fd7603-1225-4551-a4fb-ee5e398ce9a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:48.128548 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-64fd7603-1225-4551-a4fb-ee5e398ce9a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:48.131940 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 872/1729] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:09:47 2022] DELETE /identity/v3/projects/fed1e50a307f4038b904d12fd2ef5e6d => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:48.135137 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd7603-1225-4551-a4fb-ee5e398ce9a3 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:48.137480 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-64fd7603-1225-4551-a4fb-ee5e398ce9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:48.154825 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd7603-1225-4551-a4fb-ee5e398ce9a3 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:48.265587 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 858/1730] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:48 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:09:48.276794 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e076fb4-7300-4021-8470-8598ff3dece8 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:48.278692 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-5e076fb4-7300-4021-8470-8598ff3dece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:48.371079 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e01dc-5b58-44fe-a1a1-d08789060487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:48.371977 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e01dc-5b58-44fe-a1a1-d08789060487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:48.372262 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e01dc-5b58-44fe-a1a1-d08789060487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:48.372539 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e01dc-5b58-44fe-a1a1-d08789060487 admin admin] PATH_INFO: `/v3/users/7f179fdd8e634fca879f5fc2c996e81b` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:48.374512 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e01dc-5b58-44fe-a1a1-d08789060487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f179fdd8e634fca879f5fc2c996e81b)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:48.377524 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e01dc-5b58-44fe-a1a1-d08789060487 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:48.396104 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e076fb4-7300-4021-8470-8598ff3dece8 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:48.403069 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32c30a-7743-415c-97ac-cff3c58bd906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:48.403952 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32c30a-7743-415c-97ac-cff3c58bd906 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:48.404381 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32c30a-7743-415c-97ac-cff3c58bd906 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:48.404981 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32c30a-7743-415c-97ac-cff3c58bd906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:48.423651 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32c30a-7743-415c-97ac-cff3c58bd906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:48.425584 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32c30a-7743-415c-97ac-cff3c58bd906 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:48.487121 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 859/1731] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:48 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:48.735440 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-315e01dc-5b58-44fe-a1a1-d08789060487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f179fdd8e634fca879f5fc2c996e81b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:48.745539 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-315e01dc-5b58-44fe-a1a1-d08789060487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f179fdd8e634fca879f5fc2c996e81b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:48.782408 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-315e01dc-5b58-44fe-a1a1-d08789060487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f179fdd8e634fca879f5fc2c996e81b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:48.802196 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-315e01dc-5b58-44fe-a1a1-d08789060487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f179fdd8e634fca879f5fc2c996e81b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:48.811255 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-315e01dc-5b58-44fe-a1a1-d08789060487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f179fdd8e634fca879f5fc2c996e81b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:48.883888 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32c30a-7743-415c-97ac-cff3c58bd906 service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:48.886483 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-9c32c30a-7743-415c-97ac-cff3c58bd906 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:48.906953 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32c30a-7743-415c-97ac-cff3c58bd906 service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:48.916161 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704cd3f-1450-4172-87a0-0d383d8107e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:48.920989 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704cd3f-1450-4172-87a0-0d383d8107e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:48.920989 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704cd3f-1450-4172-87a0-0d383d8107e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:48.920989 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704cd3f-1450-4172-87a0-0d383d8107e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:48.926835 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-3704cd3f-1450-4172-87a0-0d383d8107e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:48.970504 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 873/1732] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:09:48 2022] DELETE /identity/v3/users/7f179fdd8e634fca879f5fc2c996e81b => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:09:49.143859 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704cd3f-1450-4172-87a0-0d383d8107e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:49.145355 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704cd3f-1450-4172-87a0-0d383d8107e8 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:49.191979 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 860/1733] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:48 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:49.220919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd05c6f-1488-43cd-a8d3-38ee4cad0688 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:49.221513 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd05c6f-1488-43cd-a8d3-38ee4cad0688 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:49.224856 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd05c6f-1488-43cd-a8d3-38ee4cad0688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:49.253805 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-9dd05c6f-1488-43cd-a8d3-38ee4cad0688 None None] MFA Rules not processed for user `fa9ea7738c634318a532ebca2e564745`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:49.256312 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-9dd05c6f-1488-43cd-a8d3-38ee4cad0688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:49.371906 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 874/1734] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Feb 16 17:09:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:09:49.770161 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704cd3f-1450-4172-87a0-0d383d8107e8 service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:49.770161 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-3704cd3f-1450-4172-87a0-0d383d8107e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:49.794128 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704cd3f-1450-4172-87a0-0d383d8107e8 service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:49.910236 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd05c6f-1488-43cd-a8d3-38ee4cad0688 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:49.911866 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-9dd05c6f-1488-43cd-a8d3-38ee4cad0688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:49.985352 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5c67e-27b7-4615-8b11-f895469ee70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:49.986781 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5c67e-27b7-4615-8b11-f895469ee70e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:49.987202 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5c67e-27b7-4615-8b11-f895469ee70e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:49.988251 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5c67e-27b7-4615-8b11-f895469ee70e admin admin] PATH_INFO: `/v3/projects/7b97069c8599434b98239b09e62f0cb1` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:49.993817 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5c67e-27b7-4615-8b11-f895469ee70e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b97069c8599434b98239b09e62f0cb1)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:49.998514 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5c67e-27b7-4615-8b11-f895469ee70e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:50.073785 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd05c6f-1488-43cd-a8d3-38ee4cad0688 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:50.081911 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c69926-47c5-4919-9ab0-0d8585d1bcb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc59cb98783b4353a405b8b9a3a9d592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:50.083777 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c69926-47c5-4919-9ab0-0d8585d1bcb6 service swift] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:50.084068 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c69926-47c5-4919-9ab0-0d8585d1bcb6 service swift] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:50.084578 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c69926-47c5-4919-9ab0-0d8585d1bcb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:50.096160 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c69926-47c5-4919-9ab0-0d8585d1bcb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:50.100083 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c69926-47c5-4919-9ab0-0d8585d1bcb6 service swift] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:50.110694 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 875/1735] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Feb 16 17:09:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 17:09:50.111688 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c69926-47c5-4919-9ab0-0d8585d1bcb6 service swift] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:50.114058 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e8c69926-47c5-4919-9ab0-0d8585d1bcb6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:50.132792 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c69926-47c5-4919-9ab0-0d8585d1bcb6 service swift] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:50.144576 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef1481-37b1-4871-9be9-5cbbfaae4114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:50.145237 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef1481-37b1-4871-9be9-5cbbfaae4114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:50.145738 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef1481-37b1-4871-9be9-5cbbfaae4114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:50.147369 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef1481-37b1-4871-9be9-5cbbfaae4114 admin admin] PATH_INFO: `/v3/projects/75b777102cc94352842991d4a83d1749` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:50.155681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef1481-37b1-4871-9be9-5cbbfaae4114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75b777102cc94352842991d4a83d1749)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:50.155681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef1481-37b1-4871-9be9-5cbbfaae4114 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:50.256968 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-16d5c67e-27b7-4615-8b11-f895469ee70e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b97069c8599434b98239b09e62f0cb1', 'request_id': 'req-16d5c67e-27b7-4615-8b11-f895469ee70e'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:50.371670 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-16d5c67e-27b7-4615-8b11-f895469ee70e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b97069c8599434b98239b09e62f0cb1', 'request_id': 'req-16d5c67e-27b7-4615-8b11-f895469ee70e'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:50.379406 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-16d5c67e-27b7-4615-8b11-f895469ee70e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b97069c8599434b98239b09e62f0cb1', 'request_id': 'req-16d5c67e-27b7-4615-8b11-f895469ee70e'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:50.406360 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-16d5c67e-27b7-4615-8b11-f895469ee70e admin admin] The token cache is being invalidate because project 7b97069c8599434b98239b09e62f0cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:09:50.407007 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-16d5c67e-27b7-4615-8b11-f895469ee70e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:50.419758 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-16d5c67e-27b7-4615-8b11-f895469ee70e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:50.419842 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-86ef1481-37b1-4871-9be9-5cbbfaae4114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75b777102cc94352842991d4a83d1749', 'request_id': 'req-86ef1481-37b1-4871-9be9-5cbbfaae4114'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:50.419937 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 861/1736] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:09:49 2022] DELETE /identity/v3/projects/7b97069c8599434b98239b09e62f0cb1 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:50.419937 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddbc6a-8e7b-4ccd-8038-b9c62242e8bc None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:50.420189 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddbc6a-8e7b-4ccd-8038-b9c62242e8bc None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:50.420738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddbc6a-8e7b-4ccd-8038-b9c62242e8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:50.446070 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-b8ddbc6a-8e7b-4ccd-8038-b9c62242e8bc None None] MFA Rules not processed for user `dd1b4007dbea4e46835dcf36bdb8b727`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:50.447885 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b8ddbc6a-8e7b-4ccd-8038-b9c62242e8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:50.549016 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-86ef1481-37b1-4871-9be9-5cbbfaae4114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75b777102cc94352842991d4a83d1749', 'request_id': 'req-86ef1481-37b1-4871-9be9-5cbbfaae4114'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:50.572318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-86ef1481-37b1-4871-9be9-5cbbfaae4114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75b777102cc94352842991d4a83d1749', 'request_id': 'req-86ef1481-37b1-4871-9be9-5cbbfaae4114'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:50.587678 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 862/1737] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:09:50.589256 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebf6ac-0ff0-4a31-9b1a-1c2b1922ac42 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:50.589665 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebf6ac-0ff0-4a31-9b1a-1c2b1922ac42 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:50.590113 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebf6ac-0ff0-4a31-9b1a-1c2b1922ac42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:50.595797 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-86ef1481-37b1-4871-9be9-5cbbfaae4114 admin admin] The token cache is being invalidate because project 75b777102cc94352842991d4a83d1749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:09:50.596098 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-86ef1481-37b1-4871-9be9-5cbbfaae4114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:50.598868 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-86ef1481-37b1-4871-9be9-5cbbfaae4114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:50.604331 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 876/1738] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:09:50 2022] DELETE /identity/v3/projects/75b777102cc94352842991d4a83d1749 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:50.608003 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414737b6-6229-4a71-899f-fe6bfd24892d None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:50.608940 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414737b6-6229-4a71-899f-fe6bfd24892d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:50.609446 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414737b6-6229-4a71-899f-fe6bfd24892d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:50.658435 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-414737b6-6229-4a71-899f-fe6bfd24892d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:50.659720 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-414737b6-6229-4a71-899f-fe6bfd24892d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:50.676066 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-44ebf6ac-0ff0-4a31-9b1a-1c2b1922ac42 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:50.677986 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-44ebf6ac-0ff0-4a31-9b1a-1c2b1922ac42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:50.810359 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 877/1739] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:50.813018 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414737b6-6229-4a71-899f-fe6bfd24892d None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:50.826176 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-414737b6-6229-4a71-899f-fe6bfd24892d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:50.835844 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 863/1740] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:50.842206 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b42acf-d052-42b0-a84d-6e3a16cea006 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:50.842206 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b42acf-d052-42b0-a84d-6e3a16cea006 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:50.842206 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b42acf-d052-42b0-a84d-6e3a16cea006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:50.888925 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-b2b42acf-d052-42b0-a84d-6e3a16cea006 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:50.891350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b2b42acf-d052-42b0-a84d-6e3a16cea006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:50.898827 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414737b6-6229-4a71-899f-fe6bfd24892d None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:50.911545 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ce9c1-0ba1-4931-b6cd-4f0b02d7febb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:50.916876 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ce9c1-0ba1-4931-b6cd-4f0b02d7febb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:50.916876 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ce9c1-0ba1-4931-b6cd-4f0b02d7febb admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:50.916876 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ce9c1-0ba1-4931-b6cd-4f0b02d7febb admin admin] PATH_INFO: `/v3/users/fc6236a6436344c79a9e8b4c2360a4d6` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:50.916876 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ce9c1-0ba1-4931-b6cd-4f0b02d7febb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc6236a6436344c79a9e8b4c2360a4d6)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:50.916876 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ce9c1-0ba1-4931-b6cd-4f0b02d7febb admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:50.922599 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 864/1741] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:50.927980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0614ebd-c8a8-4541-a181-4cfd62a1c83b None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:50.928291 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0614ebd-c8a8-4541-a181-4cfd62a1c83b None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:50.928576 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0614ebd-c8a8-4541-a181-4cfd62a1c83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:50.957680 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-f0614ebd-c8a8-4541-a181-4cfd62a1c83b None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:50.959309 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f0614ebd-c8a8-4541-a181-4cfd62a1c83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:50.978473 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 865/1742] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:50.980969 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0614ebd-c8a8-4541-a181-4cfd62a1c83b None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:51.026793 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0614ebd-c8a8-4541-a181-4cfd62a1c83b None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:51.042128 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6ad29-5d15-4c61-b7b9-91ae9595681d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:51.045043 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6ad29-5d15-4c61-b7b9-91ae9595681d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:51.045630 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6ad29-5d15-4c61-b7b9-91ae9595681d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:51.047520 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6ad29-5d15-4c61-b7b9-91ae9595681d admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:51.049088 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6ad29-5d15-4c61-b7b9-91ae9595681d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:09:51.050292 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6ad29-5d15-4c61-b7b9-91ae9595681d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:51.055718 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6ad29-5d15-4c61-b7b9-91ae9595681d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:51.104828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 866/1743] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:09:51.108668 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6ad29-5d15-4c61-b7b9-91ae9595681d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:51.145183 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6ad29-5d15-4c61-b7b9-91ae9595681d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:51.152319 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be22e60-22ee-4c8e-b014-f74a94195576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:51.164839 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be22e60-22ee-4c8e-b014-f74a94195576 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:51.165121 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be22e60-22ee-4c8e-b014-f74a94195576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:51.167028 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be22e60-22ee-4c8e-b014-f74a94195576 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:51.168248 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be22e60-22ee-4c8e-b014-f74a94195576 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:09:51.168713 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be22e60-22ee-4c8e-b014-f74a94195576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:51.183101 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be22e60-22ee-4c8e-b014-f74a94195576 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:51.241253 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-358ce9c1-0ba1-4931-b6cd-4f0b02d7febb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc6236a6436344c79a9e8b4c2360a4d6'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:51.242143 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-358ce9c1-0ba1-4931-b6cd-4f0b02d7febb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc6236a6436344c79a9e8b4c2360a4d6'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:51.244166 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 867/1744] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:09:51.245625 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be22e60-22ee-4c8e-b014-f74a94195576 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:51.256163 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-9be22e60-22ee-4c8e-b014-f74a94195576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:51.331498 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-358ce9c1-0ba1-4931-b6cd-4f0b02d7febb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc6236a6436344c79a9e8b4c2360a4d6'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:51.335467 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be22e60-22ee-4c8e-b014-f74a94195576 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:51.367368 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdbc51-3d1a-4250-b8e3-81884c19889d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:51.368056 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdbc51-3d1a-4250-b8e3-81884c19889d admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:51.368339 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdbc51-3d1a-4250-b8e3-81884c19889d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:51.368615 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdbc51-3d1a-4250-b8e3-81884c19889d admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:51.369318 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cdbc51-3d1a-4250-b8e3-81884c19889d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:51.371857 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cdbc51-3d1a-4250-b8e3-81884c19889d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:51.373477 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-358ce9c1-0ba1-4931-b6cd-4f0b02d7febb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc6236a6436344c79a9e8b4c2360a4d6'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:51.379834 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-358ce9c1-0ba1-4931-b6cd-4f0b02d7febb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc6236a6436344c79a9e8b4c2360a4d6'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:51.638939 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 878/1745] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:09:50 2022] DELETE /identity/v3/users/fc6236a6436344c79a9e8b4c2360a4d6 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:51.638939 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ce9c1-0ba1-4931-b6cd-4f0b02d7febb admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:51.638939 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-358ce9c1-0ba1-4931-b6cd-4f0b02d7febb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:51.683658 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 868/1746] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:51 2022] POST /identity/v3/projects => generated 387 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:51.685162 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1648fd2-75da-48e8-88af-3a4b11005d99 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:51.685456 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1648fd2-75da-48e8-88af-3a4b11005d99 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:51.685747 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1648fd2-75da-48e8-88af-3a4b11005d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:51.689161 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ce9c1-0ba1-4931-b6cd-4f0b02d7febb admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:51.740789 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-f1648fd2-75da-48e8-88af-3a4b11005d99 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:51.742100 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f1648fd2-75da-48e8-88af-3a4b11005d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:51.785976 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f7963-1576-4b39-983b-4d9be93b4a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:51.786873 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f7963-1576-4b39-983b-4d9be93b4a6a admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:51.787158 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f7963-1576-4b39-983b-4d9be93b4a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:51.787503 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f7963-1576-4b39-983b-4d9be93b4a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:51.788317 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f7963-1576-4b39-983b-4d9be93b4a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:51.791169 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f7963-1576-4b39-983b-4d9be93b4a6a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:51.868928 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 869/1747] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:51.868928 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1648fd2-75da-48e8-88af-3a4b11005d99 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:51.914613 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1648fd2-75da-48e8-88af-3a4b11005d99 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:51.919943 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc00f5-bd84-4e75-b313-444cb058e5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:51.920808 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc00f5-bd84-4e75-b313-444cb058e5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:51.921837 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc00f5-bd84-4e75-b313-444cb058e5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:51.921837 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc00f5-bd84-4e75-b313-444cb058e5b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:51.922016 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc00f5-bd84-4e75-b313-444cb058e5b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:51.924113 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc00f5-bd84-4e75-b313-444cb058e5b6 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:53.231095 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 879/1748] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:51 2022] POST /identity/v3/projects => generated 369 bytes in 1672 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:53.232677 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f7963-1576-4b39-983b-4d9be93b4a6a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:53.236407 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-bd6f7963-1576-4b39-983b-4d9be93b4a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:53.298428 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f7963-1576-4b39-983b-4d9be93b4a6a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:53.302784 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce32ca0-8552-4657-89b0-d01e1e3afb66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:53.303427 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce32ca0-8552-4657-89b0-d01e1e3afb66 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:53.303706 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce32ca0-8552-4657-89b0-d01e1e3afb66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:53.304089 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce32ca0-8552-4657-89b0-d01e1e3afb66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:53.307192 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 870/1749] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:51 2022] POST /identity/v3/users => generated 294 bytes in 1441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:53.308473 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb820fc-6a56-44d1-ad27-cf91dd8fd5f5 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:53.308754 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb820fc-6a56-44d1-ad27-cf91dd8fd5f5 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:53.309024 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb820fc-6a56-44d1-ad27-cf91dd8fd5f5 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:53.323479 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 871/1750] 10.222.0.42 () {54 vars in 912 bytes} [Wed Feb 16 17:09:53 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:09:53.324762 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb820fc-6a56-44d1-ad27-cf91dd8fd5f5 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:53.405389 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce32ca0-8552-4657-89b0-d01e1e3afb66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:53.407758 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce32ca0-8552-4657-89b0-d01e1e3afb66 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:53.425934 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 880/1751] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:53.427303 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce32ca0-8552-4657-89b0-d01e1e3afb66 service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:53.440796 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce32ca0-8552-4657-89b0-d01e1e3afb66 service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:53.468661 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d3b01-aaa1-4f8b-9978-2d13b7030e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:53.468661 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d3b01-aaa1-4f8b-9978-2d13b7030e94 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:53.468661 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d3b01-aaa1-4f8b-9978-2d13b7030e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:53.468661 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d3b01-aaa1-4f8b-9978-2d13b7030e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:53.469641 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d3b01-aaa1-4f8b-9978-2d13b7030e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:53.471970 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d3b01-aaa1-4f8b-9978-2d13b7030e94 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:53.492252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb820fc-6a56-44d1-ad27-cf91dd8fd5f5 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:53.507654 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9845f-b5b1-4b6c-a267-a9fbc3060e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:53.508527 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9845f-b5b1-4b6c-a267-a9fbc3060e70 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:53.508724 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 881/1752] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:53.508819 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9845f-b5b1-4b6c-a267-a9fbc3060e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:53.509106 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9845f-b5b1-4b6c-a267-a9fbc3060e70 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:53.509801 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9845f-b5b1-4b6c-a267-a9fbc3060e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:53.510135 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584908f0-34df-4fef-8463-565ae60ad08c None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:53.510437 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584908f0-34df-4fef-8463-565ae60ad08c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:53.510789 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584908f0-34df-4fef-8463-565ae60ad08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:53.513172 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9845f-b5b1-4b6c-a267-a9fbc3060e70 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:53.560785 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-584908f0-34df-4fef-8463-565ae60ad08c None None] MFA Rules not processed for user `f6db9534cc094e8281b0aa34e2cb4b46`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:53.563578 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-584908f0-34df-4fef-8463-565ae60ad08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:53.573526 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 882/1753] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Feb 16 17:09:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:53.574429 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584908f0-34df-4fef-8463-565ae60ad08c None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:53.604692 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584908f0-34df-4fef-8463-565ae60ad08c None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:53.617274 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3096d2-e367-4d16-bcdf-cba1551bc894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:53.618010 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3096d2-e367-4d16-bcdf-cba1551bc894 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:53.618296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3096d2-e367-4d16-bcdf-cba1551bc894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:53.618592 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3096d2-e367-4d16-bcdf-cba1551bc894 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:53.619334 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3096d2-e367-4d16-bcdf-cba1551bc894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:53.621081 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3096d2-e367-4d16-bcdf-cba1551bc894 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:53.633851 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 883/1754] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:53.635017 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3096d2-e367-4d16-bcdf-cba1551bc894 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:53.637449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-ef3096d2-e367-4d16-bcdf-cba1551bc894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:53.663292 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3096d2-e367-4d16-bcdf-cba1551bc894 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:53.667648 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03cb76-e035-4fdf-a728-910a88af1dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:53.668373 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03cb76-e035-4fdf-a728-910a88af1dbc service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:53.668709 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03cb76-e035-4fdf-a728-910a88af1dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:53.669135 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03cb76-e035-4fdf-a728-910a88af1dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:53.681454 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03cb76-e035-4fdf-a728-910a88af1dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:53.686851 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 872/1755] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:53 2022] POST /identity/v3/users => generated 285 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:53.687776 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03cb76-e035-4fdf-a728-910a88af1dbc service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:53.688203 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9845f-b5b1-4b6c-a267-a9fbc3060e70 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:53.718086 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9845f-b5b1-4b6c-a267-a9fbc3060e70 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:53.731037 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956db53-cb87-49dc-8a0c-298e0dd66bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:53.732199 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 884/1756] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:53.732761 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956db53-cb87-49dc-8a0c-298e0dd66bea admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:53.733744 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956db53-cb87-49dc-8a0c-298e0dd66bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:53.734409 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03cb76-e035-4fdf-a728-910a88af1dbc service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:53.734563 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956db53-cb87-49dc-8a0c-298e0dd66bea admin admin] PATH_INFO: `/v3/projects/a2182d0bf14649bfb69555c62178a233/users/feb62185357042e3bb6f830bcf169ddc/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:53.769662 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956db53-cb87-49dc-8a0c-298e0dd66bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2182d0bf14649bfb69555c62178a233, user_id=feb62185357042e3bb6f830bcf169ddc, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:53.772830 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956db53-cb87-49dc-8a0c-298e0dd66bea admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:53.775728 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03cb76-e035-4fdf-a728-910a88af1dbc service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:53.786494 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6ac08-b0f8-4dc1-b392-4da45d76b8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:53.786494 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6ac08-b0f8-4dc1-b392-4da45d76b8aa admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:53.786494 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6ac08-b0f8-4dc1-b392-4da45d76b8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:53.786494 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6ac08-b0f8-4dc1-b392-4da45d76b8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:53.787087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6ac08-b0f8-4dc1-b392-4da45d76b8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:53.791835 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6ac08-b0f8-4dc1-b392-4da45d76b8aa admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:53.822492 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 885/1757] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:53.826356 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050818d-188a-4400-9ea1-fa17df11a269 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:53.826711 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050818d-188a-4400-9ea1-fa17df11a269 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:53.827021 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050818d-188a-4400-9ea1-fa17df11a269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:53.852285 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-d050818d-188a-4400-9ea1-fa17df11a269 None None] MFA Rules not processed for user `f6db9534cc094e8281b0aa34e2cb4b46`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:53.853586 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d050818d-188a-4400-9ea1-fa17df11a269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:53.862029 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 886/1758] 10.222.0.105 () {58 vars in 1016 bytes} [Wed Feb 16 17:09:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:53.871494 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050818d-188a-4400-9ea1-fa17df11a269 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:53.894066 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050818d-188a-4400-9ea1-fa17df11a269 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:53.901521 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbfeda-c223-4fdd-9384-456a887bdc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:53.902326 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbfeda-c223-4fdd-9384-456a887bdc51 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:53.902779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbfeda-c223-4fdd-9384-456a887bdc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:53.903181 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbfeda-c223-4fdd-9384-456a887bdc51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:53.904223 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbfeda-c223-4fdd-9384-456a887bdc51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:53.908719 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbfeda-c223-4fdd-9384-456a887bdc51 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:53.940286 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 873/1759] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:53 2022] PUT /identity/v3/projects/a2182d0bf14649bfb69555c62178a233/users/feb62185357042e3bb6f830bcf169ddc/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:53.949159 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 887/1760] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:53.953117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbfeda-c223-4fdd-9384-456a887bdc51 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:53.953769 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852805bb-c624-4a7c-b0b9-7af94854e5c7 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:53.953986 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852805bb-c624-4a7c-b0b9-7af94854e5c7 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:53.954270 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852805bb-c624-4a7c-b0b9-7af94854e5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:53.999672 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbfeda-c223-4fdd-9384-456a887bdc51 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:54.023758 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-852805bb-c624-4a7c-b0b9-7af94854e5c7 None None] MFA Rules not processed for user `feb62185357042e3bb6f830bcf169ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:54.025380 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-852805bb-c624-4a7c-b0b9-7af94854e5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:54.169153 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765d8fd-f850-4dfb-a5cf-6f8def9e735e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:54.170116 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765d8fd-f850-4dfb-a5cf-6f8def9e735e admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:54.171043 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765d8fd-f850-4dfb-a5cf-6f8def9e735e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:54.171363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765d8fd-f850-4dfb-a5cf-6f8def9e735e admin admin] PATH_INFO: `/v3/projects/731a2829036e4fdcad5a5363d7847334/users/0ebe75b2ad4c4817b716a9544b8b54c9/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:54.201222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 874/1761] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:54.220224 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852805bb-c624-4a7c-b0b9-7af94854e5c7 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:54.230414 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765d8fd-f850-4dfb-a5cf-6f8def9e735e admin admin] RBAC: Authorizing `identity:create_grant(project_id=731a2829036e4fdcad5a5363d7847334, user_id=0ebe75b2ad4c4817b716a9544b8b54c9, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:54.243158 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852805bb-c624-4a7c-b0b9-7af94854e5c7 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:54.249591 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a7ac4-51fe-40a1-bf90-66c42802949d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:54.250586 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a7ac4-51fe-40a1-bf90-66c42802949d admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:54.250722 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a7ac4-51fe-40a1-bf90-66c42802949d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:54.250995 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a7ac4-51fe-40a1-bf90-66c42802949d admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:54.251758 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a7ac4-51fe-40a1-bf90-66c42802949d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:54.253786 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a7ac4-51fe-40a1-bf90-66c42802949d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:54.254713 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765d8fd-f850-4dfb-a5cf-6f8def9e735e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:54.416607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 888/1762] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:53 2022] PUT /identity/v3/projects/731a2829036e4fdcad5a5363d7847334/users/0ebe75b2ad4c4817b716a9544b8b54c9/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:54.418099 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765d8fd-f850-4dfb-a5cf-6f8def9e735e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:54.421156 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 875/1763] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:54 2022] POST /identity/v3/projects => generated 387 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:54.421983 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a7ac4-51fe-40a1-bf90-66c42802949d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:54.423839 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-507a7ac4-51fe-40a1-bf90-66c42802949d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:54.532456 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765d8fd-f850-4dfb-a5cf-6f8def9e735e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:54.533959 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a7ac4-51fe-40a1-bf90-66c42802949d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:54.541299 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b08d9-8a42-4f59-967a-f706ecdabbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:54.542844 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b08d9-8a42-4f59-967a-f706ecdabbc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:54.543246 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b08d9-8a42-4f59-967a-f706ecdabbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:54.543652 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b08d9-8a42-4f59-967a-f706ecdabbc4 admin admin] PATH_INFO: `/v3/projects/241e5308f6f147028433f8b865e84a1c` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:54.545240 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b08d9-8a42-4f59-967a-f706ecdabbc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=241e5308f6f147028433f8b865e84a1c)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:54.548290 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b08d9-8a42-4f59-967a-f706ecdabbc4 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:54.610732 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b067e5-6271-44f2-a4ca-8760298cb003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:54.619227 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b067e5-6271-44f2-a4ca-8760298cb003 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:54.619227 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b067e5-6271-44f2-a4ca-8760298cb003 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:54.619227 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b067e5-6271-44f2-a4ca-8760298cb003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:54.620580 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b067e5-6271-44f2-a4ca-8760298cb003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:54.622220 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b067e5-6271-44f2-a4ca-8760298cb003 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:54.632552 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 889/1764] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:54.633433 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b067e5-6271-44f2-a4ca-8760298cb003 service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:54.647937 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b067e5-6271-44f2-a4ca-8760298cb003 service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:54.659443 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c3121-ef73-457b-a89e-da020a9e76be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:54.660268 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c3121-ef73-457b-a89e-da020a9e76be admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:54.662656 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c3121-ef73-457b-a89e-da020a9e76be admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:54.663406 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c3121-ef73-457b-a89e-da020a9e76be admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:54.667287 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c3121-ef73-457b-a89e-da020a9e76be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:54.669813 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c3121-ef73-457b-a89e-da020a9e76be admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:54.724813 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-1d8b08d9-8a42-4f59-967a-f706ecdabbc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241e5308f6f147028433f8b865e84a1c', 'request_id': 'req-1d8b08d9-8a42-4f59-967a-f706ecdabbc4'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:54.823929 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 890/1765] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:54 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:54.825477 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce43db-66e5-4b2b-a0e4-07374e21607d None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:54.825914 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce43db-66e5-4b2b-a0e4-07374e21607d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:54.827219 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce43db-66e5-4b2b-a0e4-07374e21607d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:54.857193 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-1d8b08d9-8a42-4f59-967a-f706ecdabbc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241e5308f6f147028433f8b865e84a1c', 'request_id': 'req-1d8b08d9-8a42-4f59-967a-f706ecdabbc4'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:54.864977 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-1d8b08d9-8a42-4f59-967a-f706ecdabbc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241e5308f6f147028433f8b865e84a1c', 'request_id': 'req-1d8b08d9-8a42-4f59-967a-f706ecdabbc4'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:54.893848 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-c1ce43db-66e5-4b2b-a0e4-07374e21607d None None] MFA Rules not processed for user `0ebe75b2ad4c4817b716a9544b8b54c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:54.901503 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-c1ce43db-66e5-4b2b-a0e4-07374e21607d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:54.901584 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-1d8b08d9-8a42-4f59-967a-f706ecdabbc4 admin admin] The token cache is being invalidate because project 241e5308f6f147028433f8b865e84a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:09:54.901584 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-1d8b08d9-8a42-4f59-967a-f706ecdabbc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:54.901584 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-1d8b08d9-8a42-4f59-967a-f706ecdabbc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:54.901584 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 876/1766] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:09:54 2022] DELETE /identity/v3/projects/241e5308f6f147028433f8b865e84a1c => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:54.901584 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5def20-07cf-411c-8c46-99f2121d9103 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:54.901880 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5def20-07cf-411c-8c46-99f2121d9103 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:54.901880 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5def20-07cf-411c-8c46-99f2121d9103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:54.938308 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-7f5def20-07cf-411c-8c46-99f2121d9103 None None] MFA Rules not processed for user `db53f0b9c80640dc9e93349861182d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:54.939894 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-7f5def20-07cf-411c-8c46-99f2121d9103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:55.023898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 891/1767] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:55.025074 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce43db-66e5-4b2b-a0e4-07374e21607d None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:55.026553 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-c1ce43db-66e5-4b2b-a0e4-07374e21607d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:55.089190 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 877/1768] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:55.090550 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94690c-d884-4885-8c20-473c70001a83 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:55.090865 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94690c-d884-4885-8c20-473c70001a83 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:55.091234 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94690c-d884-4885-8c20-473c70001a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:55.113680 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-8b94690c-d884-4885-8c20-473c70001a83 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:55.114807 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-8b94690c-d884-4885-8c20-473c70001a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:55.169623 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce43db-66e5-4b2b-a0e4-07374e21607d None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:55.176089 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe559f-8eff-4d54-8a3a-d02a54fbf841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:55.176773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe559f-8eff-4d54-8a3a-d02a54fbf841 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:55.177059 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe559f-8eff-4d54-8a3a-d02a54fbf841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:55.177335 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe559f-8eff-4d54-8a3a-d02a54fbf841 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:55.178067 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe559f-8eff-4d54-8a3a-d02a54fbf841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:55.180539 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe559f-8eff-4d54-8a3a-d02a54fbf841 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:55.205115 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 892/1769] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:55.206028 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe559f-8eff-4d54-8a3a-d02a54fbf841 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:55.211507 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-6afe559f-8eff-4d54-8a3a-d02a54fbf841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:55.237234 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 878/1770] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:55.239289 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94690c-d884-4885-8c20-473c70001a83 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:55.253895 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94690c-d884-4885-8c20-473c70001a83 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:55.260556 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51292896-9257-4c11-8519-ec683c6bd318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:55.261514 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe559f-8eff-4d54-8a3a-d02a54fbf841 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:55.267232 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51292896-9257-4c11-8519-ec683c6bd318 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:55.267232 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51292896-9257-4c11-8519-ec683c6bd318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:55.267232 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51292896-9257-4c11-8519-ec683c6bd318 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:55.267232 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51292896-9257-4c11-8519-ec683c6bd318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:55.267232 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51292896-9257-4c11-8519-ec683c6bd318 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:55.276710 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2613f5-33d7-40a4-89d3-e83319f93a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:55.277394 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2613f5-33d7-40a4-89d3-e83319f93a1c admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:55.277719 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2613f5-33d7-40a4-89d3-e83319f93a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:55.280355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2613f5-33d7-40a4-89d3-e83319f93a1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:55.280482 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 879/1771] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:55.280618 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2613f5-33d7-40a4-89d3-e83319f93a1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:55.282151 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65819bfd-7d88-43ea-982a-a98d5fb334eb None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:55.282472 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65819bfd-7d88-43ea-982a-a98d5fb334eb None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:55.282595 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2613f5-33d7-40a4-89d3-e83319f93a1c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:55.282804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65819bfd-7d88-43ea-982a-a98d5fb334eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:55.306760 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-65819bfd-7d88-43ea-982a-a98d5fb334eb None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:55.308205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-65819bfd-7d88-43ea-982a-a98d5fb334eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:55.319726 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 880/1772] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:55.327419 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65819bfd-7d88-43ea-982a-a98d5fb334eb None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:55.342690 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65819bfd-7d88-43ea-982a-a98d5fb334eb None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:55.348064 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043db2d-630b-47bc-bc01-cf44069e5fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:55.348675 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043db2d-630b-47bc-bc01-cf44069e5fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:55.348955 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043db2d-630b-47bc-bc01-cf44069e5fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:55.349384 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043db2d-630b-47bc-bc01-cf44069e5fd3 admin admin] PATH_INFO: `/v3/projects/d5b68069296e44a98ce5c064b67bf47b/users/3538d9d58d4644378eb55f3edc4a4ec9/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:55.376078 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043db2d-630b-47bc-bc01-cf44069e5fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b68069296e44a98ce5c064b67bf47b, user_id=3538d9d58d4644378eb55f3edc4a4ec9, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:55.376078 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043db2d-630b-47bc-bc01-cf44069e5fd3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:55.477877 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 893/1773] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:55 2022] POST /identity/v3/projects => generated 373 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:55.493781 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2613f5-33d7-40a4-89d3-e83319f93a1c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:55.578046 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 881/1774] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:55 2022] PUT /identity/v3/projects/d5b68069296e44a98ce5c064b67bf47b/users/3538d9d58d4644378eb55f3edc4a4ec9/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:55.578046 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043db2d-630b-47bc-bc01-cf44069e5fd3 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:55.585790 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2613f5-33d7-40a4-89d3-e83319f93a1c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:55.736450 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043db2d-630b-47bc-bc01-cf44069e5fd3 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:55.760196 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad64ae-50aa-4c8d-8132-69416bb8426e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:55.762269 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad64ae-50aa-4c8d-8132-69416bb8426e admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:55.764095 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad64ae-50aa-4c8d-8132-69416bb8426e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:55.765828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad64ae-50aa-4c8d-8132-69416bb8426e admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:55.774506 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad64ae-50aa-4c8d-8132-69416bb8426e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:55.774506 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad64ae-50aa-4c8d-8132-69416bb8426e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:55.794029 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee639c5-03a9-46d5-a583-ce2d1e434dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:55.794751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee639c5-03a9-46d5-a583-ce2d1e434dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:55.795088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee639c5-03a9-46d5-a583-ce2d1e434dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:55.796238 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee639c5-03a9-46d5-a583-ce2d1e434dc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:55.797351 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee639c5-03a9-46d5-a583-ce2d1e434dc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:09:55.797664 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee639c5-03a9-46d5-a583-ce2d1e434dc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:55.799438 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee639c5-03a9-46d5-a583-ce2d1e434dc9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:55.825332 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 894/1775] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:09:55.832034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0ee93-a575-43ee-8350-af0591c93015 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:55.832034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0ee93-a575-43ee-8350-af0591c93015 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:55.832034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0ee93-a575-43ee-8350-af0591c93015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:55.886791 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 882/1776] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:55 2022] POST /identity/v3/users => generated 293 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:55.887803 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad64ae-50aa-4c8d-8132-69416bb8426e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:55.897563 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-0aad64ae-50aa-4c8d-8132-69416bb8426e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:55.915901 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-d8b0ee93-a575-43ee-8350-af0591c93015 None None] MFA Rules not processed for user `3538d9d58d4644378eb55f3edc4a4ec9`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:55.919049 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d8b0ee93-a575-43ee-8350-af0591c93015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:55.935625 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad64ae-50aa-4c8d-8132-69416bb8426e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:55.950764 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e1cbe-eb82-4708-a1bb-ee1e237fbd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:55.951693 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e1cbe-eb82-4708-a1bb-ee1e237fbd66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:55.952092 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e1cbe-eb82-4708-a1bb-ee1e237fbd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:55.952575 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e1cbe-eb82-4708-a1bb-ee1e237fbd66 admin admin] PATH_INFO: `/v3/users/1f585ba25f0649639150f70b07ba3ce2` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:55.958340 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e1cbe-eb82-4708-a1bb-ee1e237fbd66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f585ba25f0649639150f70b07ba3ce2)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:55.960324 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e1cbe-eb82-4708-a1bb-ee1e237fbd66 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:56.062550 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 895/1777] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:56.063562 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0ee93-a575-43ee-8350-af0591c93015 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:56.073997 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0ee93-a575-43ee-8350-af0591c93015 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:56.083572 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4923b7c-a463-4a2f-9bb7-5e2872277f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:56.084231 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4923b7c-a463-4a2f-9bb7-5e2872277f93 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:56.084508 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4923b7c-a463-4a2f-9bb7-5e2872277f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:56.084779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4923b7c-a463-4a2f-9bb7-5e2872277f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:56.085464 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4923b7c-a463-4a2f-9bb7-5e2872277f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:56.087425 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4923b7c-a463-4a2f-9bb7-5e2872277f93 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:56.210367 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 896/1778] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:56 2022] POST /identity/v3/projects => generated 357 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:56.211547 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4923b7c-a463-4a2f-9bb7-5e2872277f93 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:56.256140 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f96e1cbe-eb82-4708-a1bb-ee1e237fbd66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f585ba25f0649639150f70b07ba3ce2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:56.256799 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f96e1cbe-eb82-4708-a1bb-ee1e237fbd66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f585ba25f0649639150f70b07ba3ce2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:56.277433 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f96e1cbe-eb82-4708-a1bb-ee1e237fbd66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f585ba25f0649639150f70b07ba3ce2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:56.287312 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f96e1cbe-eb82-4708-a1bb-ee1e237fbd66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f585ba25f0649639150f70b07ba3ce2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:56.288312 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4923b7c-a463-4a2f-9bb7-5e2872277f93 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:56.292954 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e815918-b7f8-424d-a531-5a069c4bf626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:56.293610 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e815918-b7f8-424d-a531-5a069c4bf626 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:56.293889 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e815918-b7f8-424d-a531-5a069c4bf626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:56.294158 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e815918-b7f8-424d-a531-5a069c4bf626 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:56.294909 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e815918-b7f8-424d-a531-5a069c4bf626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:56.296528 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e815918-b7f8-424d-a531-5a069c4bf626 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:56.306482 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 897/1779] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:56.310431 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e815918-b7f8-424d-a531-5a069c4bf626 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:56.312210 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-1e815918-b7f8-424d-a531-5a069c4bf626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:56.324879 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e815918-b7f8-424d-a531-5a069c4bf626 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:56.331194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b759a-c8e4-485a-bd12-9f27501a2c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:56.331863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b759a-c8e4-485a-bd12-9f27501a2c2f admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:56.333087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b759a-c8e4-485a-bd12-9f27501a2c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:56.333087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b759a-c8e4-485a-bd12-9f27501a2c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:56.333251 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b759a-c8e4-485a-bd12-9f27501a2c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:56.338814 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b759a-c8e4-485a-bd12-9f27501a2c2f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:56.450896 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f96e1cbe-eb82-4708-a1bb-ee1e237fbd66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f585ba25f0649639150f70b07ba3ce2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:56.450896 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 883/1780] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:09:55 2022] DELETE /identity/v3/users/1f585ba25f0649639150f70b07ba3ce2 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:56.450896 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e1cbe-eb82-4708-a1bb-ee1e237fbd66 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:56.450896 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f96e1cbe-eb82-4708-a1bb-ee1e237fbd66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:56.518179 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 898/1781] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:56 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:56.519170 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b759a-c8e4-485a-bd12-9f27501a2c2f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:56.524126 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-394b759a-c8e4-485a-bd12-9f27501a2c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:56.534366 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e1cbe-eb82-4708-a1bb-ee1e237fbd66 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:56.640703 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d58489-7919-45d8-bc69-e0aa4dd56a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:56.641455 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d58489-7919-45d8-bc69-e0aa4dd56a36 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:56.641854 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d58489-7919-45d8-bc69-e0aa4dd56a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:56.642412 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d58489-7919-45d8-bc69-e0aa4dd56a36 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:56.643198 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d58489-7919-45d8-bc69-e0aa4dd56a36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:56.648953 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d58489-7919-45d8-bc69-e0aa4dd56a36 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:56.651356 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b759a-c8e4-485a-bd12-9f27501a2c2f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:56.659771 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32cf04-bcee-4b2e-b352-4b3f1551eeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:56.660978 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32cf04-bcee-4b2e-b352-4b3f1551eeb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:56.661271 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32cf04-bcee-4b2e-b352-4b3f1551eeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:56.661640 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32cf04-bcee-4b2e-b352-4b3f1551eeb9 admin admin] PATH_INFO: `/v3/projects/6635c4402e48453b80d5d8ec8768ef7c/users/dc09c0595ce245c983fa44c82fb28984/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:56.682951 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32cf04-bcee-4b2e-b352-4b3f1551eeb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6635c4402e48453b80d5d8ec8768ef7c, user_id=dc09c0595ce245c983fa44c82fb28984, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:56.685643 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32cf04-bcee-4b2e-b352-4b3f1551eeb9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:56.747075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 884/1782] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:56 2022] POST /identity/v3/users => generated 279 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:56.753850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d545110-0af9-484c-b44f-04ccafd122e4 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:56.753850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d545110-0af9-484c-b44f-04ccafd122e4 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:56.753850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d545110-0af9-484c-b44f-04ccafd122e4 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:56.753850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 885/1783] 10.222.0.42 () {54 vars in 921 bytes} [Wed Feb 16 17:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:09:56.753850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228b0ba-e5e6-4e09-aa66-ece7b38c58a2 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:56.753850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228b0ba-e5e6-4e09-aa66-ece7b38c58a2 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:56.754268 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228b0ba-e5e6-4e09-aa66-ece7b38c58a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:56.770826 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-b228b0ba-e5e6-4e09-aa66-ece7b38c58a2 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:56.772003 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b228b0ba-e5e6-4e09-aa66-ece7b38c58a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:56.780938 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 886/1784] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:56.782545 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228b0ba-e5e6-4e09-aa66-ece7b38c58a2 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:56.797280 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228b0ba-e5e6-4e09-aa66-ece7b38c58a2 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:56.802634 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cd610-c71f-4178-a8d8-4fe7e2dc9e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:56.804300 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cd610-c71f-4178-a8d8-4fe7e2dc9e99 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:56.804300 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cd610-c71f-4178-a8d8-4fe7e2dc9e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:56.804300 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cd610-c71f-4178-a8d8-4fe7e2dc9e99 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:56.804569 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cd610-c71f-4178-a8d8-4fe7e2dc9e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:56.806775 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cd610-c71f-4178-a8d8-4fe7e2dc9e99 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:56.809333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 899/1785] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:56 2022] PUT /identity/v3/projects/6635c4402e48453b80d5d8ec8768ef7c/users/dc09c0595ce245c983fa44c82fb28984/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:56.811834 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec15fcd-2d33-42f7-ba0b-ec19a87193ae None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:56.812296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec15fcd-2d33-42f7-ba0b-ec19a87193ae None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:56.812973 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec15fcd-2d33-42f7-ba0b-ec19a87193ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:56.833744 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-1ec15fcd-2d33-42f7-ba0b-ec19a87193ae None None] MFA Rules not processed for user `9a30603a236e4681a7702eec7029e9db`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:56.834963 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-1ec15fcd-2d33-42f7-ba0b-ec19a87193ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:56.900011 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 900/1786] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Feb 16 17:09:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:56.900891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec15fcd-2d33-42f7-ba0b-ec19a87193ae None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:56.909828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 887/1787] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:56 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:56.911063 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cd610-c71f-4178-a8d8-4fe7e2dc9e99 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:56.914002 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-a22cd610-c71f-4178-a8d8-4fe7e2dc9e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:56.978476 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cd610-c71f-4178-a8d8-4fe7e2dc9e99 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:56.988547 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec15fcd-2d33-42f7-ba0b-ec19a87193ae None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:56.993805 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400a146-85c4-4a4d-a291-ebdf1cefe79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:56.997517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400a146-85c4-4a4d-a291-ebdf1cefe79d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:56.997517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400a146-85c4-4a4d-a291-ebdf1cefe79d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:56.997517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400a146-85c4-4a4d-a291-ebdf1cefe79d admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:56.997517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400a146-85c4-4a4d-a291-ebdf1cefe79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:56.997928 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400a146-85c4-4a4d-a291-ebdf1cefe79d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:57.010379 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 901/1788] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:57.015311 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400a146-85c4-4a4d-a291-ebdf1cefe79d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:57.027545 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400a146-85c4-4a4d-a291-ebdf1cefe79d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:57.033491 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44dc518-38f7-42d0-b7e6-cf4070e796af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:57.034202 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dc518-38f7-42d0-b7e6-cf4070e796af admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:57.034577 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dc518-38f7-42d0-b7e6-cf4070e796af admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:57.034917 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dc518-38f7-42d0-b7e6-cf4070e796af admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:57.035731 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44dc518-38f7-42d0-b7e6-cf4070e796af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:57.037643 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44dc518-38f7-42d0-b7e6-cf4070e796af admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:57.053437 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 902/1789] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:57.054295 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44dc518-38f7-42d0-b7e6-cf4070e796af admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:57.063502 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16509bc-7a66-4329-bf9c-7bb746ade8cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:57.064241 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16509bc-7a66-4329-bf9c-7bb746ade8cb service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:57.064531 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16509bc-7a66-4329-bf9c-7bb746ade8cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:57.064809 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16509bc-7a66-4329-bf9c-7bb746ade8cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:57.068403 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d44dc518-38f7-42d0-b7e6-cf4070e796af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:57.074954 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16509bc-7a66-4329-bf9c-7bb746ade8cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:57.077001 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16509bc-7a66-4329-bf9c-7bb746ade8cb service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:57.091130 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44dc518-38f7-42d0-b7e6-cf4070e796af admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:57.101005 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395c1be-2657-4e1a-8fdb-e7157c53eab1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:57.102867 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395c1be-2657-4e1a-8fdb-e7157c53eab1 service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:57.103176 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395c1be-2657-4e1a-8fdb-e7157c53eab1 service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:57.104999 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395c1be-2657-4e1a-8fdb-e7157c53eab1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:57.107484 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 888/1790] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:57.111725 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16509bc-7a66-4329-bf9c-7bb746ade8cb service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:57.117671 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395c1be-2657-4e1a-8fdb-e7157c53eab1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:57.120218 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395c1be-2657-4e1a-8fdb-e7157c53eab1 service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:57.125442 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16509bc-7a66-4329-bf9c-7bb746ade8cb service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:57.131610 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f4e13-ea78-401b-a2ae-6ca179e3701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:57.132718 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f4e13-ea78-401b-a2ae-6ca179e3701b admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:57.133066 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f4e13-ea78-401b-a2ae-6ca179e3701b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:57.133434 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f4e13-ea78-401b-a2ae-6ca179e3701b admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:57.134757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f4e13-ea78-401b-a2ae-6ca179e3701b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:57.136734 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f4e13-ea78-401b-a2ae-6ca179e3701b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:57.146004 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 903/1791] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:57.147007 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395c1be-2657-4e1a-8fdb-e7157c53eab1 service nova] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:57.157993 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 889/1792] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:57.157993 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f4e13-ea78-401b-a2ae-6ca179e3701b admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:57.165375 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f4e13-ea78-401b-a2ae-6ca179e3701b admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:57.171882 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3a633-7ad2-43b9-8390-dc13e2f87505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:57.173004 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3a633-7ad2-43b9-8390-dc13e2f87505 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:57.173434 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3a633-7ad2-43b9-8390-dc13e2f87505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:57.173856 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3a633-7ad2-43b9-8390-dc13e2f87505 admin admin] PATH_INFO: `/v3/projects/6635c4402e48453b80d5d8ec8768ef7c/users/dc09c0595ce245c983fa44c82fb28984/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:57.176068 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3a633-7ad2-43b9-8390-dc13e2f87505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6635c4402e48453b80d5d8ec8768ef7c, user_id=dc09c0595ce245c983fa44c82fb28984, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:57.179298 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3a633-7ad2-43b9-8390-dc13e2f87505 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:57.179889 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395c1be-2657-4e1a-8fdb-e7157c53eab1 service nova] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:57.187329 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377a003-befc-4c1f-a583-1772a841c353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:57.188461 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377a003-befc-4c1f-a583-1772a841c353 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:57.188835 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377a003-befc-4c1f-a583-1772a841c353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:57.189811 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377a003-befc-4c1f-a583-1772a841c353 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:57.190900 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377a003-befc-4c1f-a583-1772a841c353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:57.195235 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377a003-befc-4c1f-a583-1772a841c353 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:57.207797 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 890/1793] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:57 2022] PUT /identity/v3/projects/6635c4402e48453b80d5d8ec8768ef7c/users/dc09c0595ce245c983fa44c82fb28984/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:57.208901 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3a633-7ad2-43b9-8390-dc13e2f87505 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:57.220039 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 904/1794] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:57.224517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bfee4-fcb8-4e04-99de-99fb6a667d95 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:57.225065 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bfee4-fcb8-4e04-99de-99fb6a667d95 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:57.225512 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bfee4-fcb8-4e04-99de-99fb6a667d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:57.264073 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-7b5bfee4-fcb8-4e04-99de-99fb6a667d95 None None] MFA Rules not processed for user `dc09c0595ce245c983fa44c82fb28984`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:57.266178 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-7b5bfee4-fcb8-4e04-99de-99fb6a667d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:57.321754 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3a633-7ad2-43b9-8390-dc13e2f87505 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:57.329479 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8916b4-bb87-4ec0-943b-0fe2fbab8644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:57.330599 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8916b4-bb87-4ec0-943b-0fe2fbab8644 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:57.330904 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8916b4-bb87-4ec0-943b-0fe2fbab8644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:57.331182 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8916b4-bb87-4ec0-943b-0fe2fbab8644 admin admin] PATH_INFO: `/v3/projects/df8b70464e684b75a4de689d73e2d75d/users/94911c381e37454bada7e60ba111c98a/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:57.347979 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8916b4-bb87-4ec0-943b-0fe2fbab8644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8b70464e684b75a4de689d73e2d75d, user_id=94911c381e37454bada7e60ba111c98a, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:57.350980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8916b4-bb87-4ec0-943b-0fe2fbab8644 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:57.364653 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 905/1795] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:57.368721 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bfee4-fcb8-4e04-99de-99fb6a667d95 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:57.376705 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bfee4-fcb8-4e04-99de-99fb6a667d95 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:57.381478 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1f45b-408d-4fa2-962d-a7afaf3aa070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:57.382676 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1f45b-408d-4fa2-962d-a7afaf3aa070 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:57.382992 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1f45b-408d-4fa2-962d-a7afaf3aa070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:57.383264 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1f45b-408d-4fa2-962d-a7afaf3aa070 admin admin] PATH_INFO: `/v3/projects/d85b6bf169b047c9b0a35bedc960f369/users/8283ff98dbd84317b5b6f3b403592a55/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:57.409176 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1f45b-408d-4fa2-962d-a7afaf3aa070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85b6bf169b047c9b0a35bedc960f369, user_id=8283ff98dbd84317b5b6f3b403592a55, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:57.412411 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1f45b-408d-4fa2-962d-a7afaf3aa070 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:57.474903 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 891/1796] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:57 2022] PUT /identity/v3/projects/df8b70464e684b75a4de689d73e2d75d/users/94911c381e37454bada7e60ba111c98a/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:57.475915 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8916b4-bb87-4ec0-943b-0fe2fbab8644 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:57.479225 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-df8916b4-bb87-4ec0-943b-0fe2fbab8644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:57.504431 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 906/1797] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:57 2022] PUT /identity/v3/projects/d85b6bf169b047c9b0a35bedc960f369/users/8283ff98dbd84317b5b6f3b403592a55/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:57.505966 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1f45b-408d-4fa2-962d-a7afaf3aa070 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:57.618057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8916b4-bb87-4ec0-943b-0fe2fbab8644 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:57.666708 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1f45b-408d-4fa2-962d-a7afaf3aa070 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:57.676968 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb9f0e-7e62-4457-9817-ca04bd6257a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:57.678186 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb9f0e-7e62-4457-9817-ca04bd6257a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:57.679233 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb9f0e-7e62-4457-9817-ca04bd6257a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:57.679763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb9f0e-7e62-4457-9817-ca04bd6257a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:57.681197 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb9f0e-7e62-4457-9817-ca04bd6257a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:57.684170 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb9f0e-7e62-4457-9817-ca04bd6257a9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:57.701168 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 907/1798] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:57.703174 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389916ef-d280-49d0-b6af-4d452b6760cf None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:57.703691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389916ef-d280-49d0-b6af-4d452b6760cf None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:57.704069 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389916ef-d280-49d0-b6af-4d452b6760cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:57.727461 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d8c66-9e2d-48cd-9f1b-3f706a0b6ff1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:57.728245 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d8c66-9e2d-48cd-9f1b-3f706a0b6ff1 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:57.728571 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d8c66-9e2d-48cd-9f1b-3f706a0b6ff1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:57.728870 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d8c66-9e2d-48cd-9f1b-3f706a0b6ff1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:57.762956 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-389916ef-d280-49d0-b6af-4d452b6760cf None None] MFA Rules not processed for user `8283ff98dbd84317b5b6f3b403592a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:57.765796 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-389916ef-d280-49d0-b6af-4d452b6760cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:57.874769 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d8c66-9e2d-48cd-9f1b-3f706a0b6ff1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:57.877019 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d8c66-9e2d-48cd-9f1b-3f706a0b6ff1 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:57.891591 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 892/1799] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:57.892449 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d8c66-9e2d-48cd-9f1b-3f706a0b6ff1 service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:57.905081 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 908/1800] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:57 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:57.906300 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d8c66-9e2d-48cd-9f1b-3f706a0b6ff1 service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:57.913378 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389916ef-d280-49d0-b6af-4d452b6760cf None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:57.913556 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db88f4b-5a27-4c53-8420-32f2adebe9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:57.914440 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db88f4b-5a27-4c53-8420-32f2adebe9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:57.914875 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db88f4b-5a27-4c53-8420-32f2adebe9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:57.918834 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db88f4b-5a27-4c53-8420-32f2adebe9c4 admin admin] PATH_INFO: `/v3/projects/df8b70464e684b75a4de689d73e2d75d/users/94911c381e37454bada7e60ba111c98a/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:57.918834 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db88f4b-5a27-4c53-8420-32f2adebe9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8b70464e684b75a4de689d73e2d75d, user_id=94911c381e37454bada7e60ba111c98a, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:57.921976 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db88f4b-5a27-4c53-8420-32f2adebe9c4 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:57.935574 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 893/1801] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:57 2022] PUT /identity/v3/projects/df8b70464e684b75a4de689d73e2d75d/users/94911c381e37454bada7e60ba111c98a/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:57.953447 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389916ef-d280-49d0-b6af-4d452b6760cf None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:57.953765 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db88f4b-5a27-4c53-8420-32f2adebe9c4 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:57.953765 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-0db88f4b-5a27-4c53-8420-32f2adebe9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:58.052549 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd87e0b-3f64-4144-b86b-d1b1b30dcf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:58.053281 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd87e0b-3f64-4144-b86b-d1b1b30dcf07 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:58.053567 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd87e0b-3f64-4144-b86b-d1b1b30dcf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:58.053904 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd87e0b-3f64-4144-b86b-d1b1b30dcf07 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:58.054710 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd87e0b-3f64-4144-b86b-d1b1b30dcf07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:58.057751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd87e0b-3f64-4144-b86b-d1b1b30dcf07 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:58.075284 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db88f4b-5a27-4c53-8420-32f2adebe9c4 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:58.090212 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d77a65-be70-40de-8357-14d7e9045a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:58.091124 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d77a65-be70-40de-8357-14d7e9045a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:58.091405 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d77a65-be70-40de-8357-14d7e9045a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:58.091681 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d77a65-be70-40de-8357-14d7e9045a5f admin admin] PATH_INFO: `/v3/projects/450fd659900049bbb0e05fb11daf2ae9` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:58.093666 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d77a65-be70-40de-8357-14d7e9045a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=450fd659900049bbb0e05fb11daf2ae9)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:58.095610 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d77a65-be70-40de-8357-14d7e9045a5f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:58.214833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 909/1802] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:09:57 2022] POST /identity/v3/projects => generated 355 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:58.214833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3371975-c8bc-420e-b5ec-2722ab40766c None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:58.214833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3371975-c8bc-420e-b5ec-2722ab40766c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:58.214833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3371975-c8bc-420e-b5ec-2722ab40766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:58.252761 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-f3371975-c8bc-420e-b5ec-2722ab40766c None None] MFA Rules not processed for user `94911c381e37454bada7e60ba111c98a`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:58.252761 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f3371975-c8bc-420e-b5ec-2722ab40766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:58.259655 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e3d77a65-be70-40de-8357-14d7e9045a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '450fd659900049bbb0e05fb11daf2ae9', 'request_id': 'req-e3d77a65-be70-40de-8357-14d7e9045a5f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:58.317807 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 910/1803] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:58.318694 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3371975-c8bc-420e-b5ec-2722ab40766c None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:58.340672 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e3d77a65-be70-40de-8357-14d7e9045a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '450fd659900049bbb0e05fb11daf2ae9', 'request_id': 'req-e3d77a65-be70-40de-8357-14d7e9045a5f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:58.346944 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e3d77a65-be70-40de-8357-14d7e9045a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '450fd659900049bbb0e05fb11daf2ae9', 'request_id': 'req-e3d77a65-be70-40de-8357-14d7e9045a5f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:58.358301 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e3d77a65-be70-40de-8357-14d7e9045a5f admin admin] The token cache is being invalidate because project 450fd659900049bbb0e05fb11daf2ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:09:58.358917 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e3d77a65-be70-40de-8357-14d7e9045a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:58.359591 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e3d77a65-be70-40de-8357-14d7e9045a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:58.361166 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 894/1804] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:09:57 2022] DELETE /identity/v3/projects/450fd659900049bbb0e05fb11daf2ae9 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:09:58.361983 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d77a65-be70-40de-8357-14d7e9045a5f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:58.363327 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e3d77a65-be70-40de-8357-14d7e9045a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:58.376728 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3371975-c8bc-420e-b5ec-2722ab40766c None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:58.380487 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95785e0a-67d4-42c4-aa5d-3d46d64a285f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:58.381123 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95785e0a-67d4-42c4-aa5d-3d46d64a285f service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:58.381401 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95785e0a-67d4-42c4-aa5d-3d46d64a285f service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:58.381671 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95785e0a-67d4-42c4-aa5d-3d46d64a285f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:58.383455 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-95785e0a-67d4-42c4-aa5d-3d46d64a285f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:58.432180 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d77a65-be70-40de-8357-14d7e9045a5f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:58.437940 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef356782-559e-43e9-b3f6-0d0259a04ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:58.438745 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356782-559e-43e9-b3f6-0d0259a04ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:58.439097 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356782-559e-43e9-b3f6-0d0259a04ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:58.439379 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356782-559e-43e9-b3f6-0d0259a04ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:58.440075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef356782-559e-43e9-b3f6-0d0259a04ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:58.441970 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef356782-559e-43e9-b3f6-0d0259a04ea2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:58.449448 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95785e0a-67d4-42c4-aa5d-3d46d64a285f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:58.451544 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95785e0a-67d4-42c4-aa5d-3d46d64a285f service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:58.461073 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 911/1805] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:58.461907 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95785e0a-67d4-42c4-aa5d-3d46d64a285f service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:58.463325 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-95785e0a-67d4-42c4-aa5d-3d46d64a285f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:58.473993 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95785e0a-67d4-42c4-aa5d-3d46d64a285f service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:58.477751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0f462-ef23-4526-a889-6ac5d9ed01e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:58.478433 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0f462-ef23-4526-a889-6ac5d9ed01e7 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:58.478678 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0f462-ef23-4526-a889-6ac5d9ed01e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:58.478968 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0f462-ef23-4526-a889-6ac5d9ed01e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:58.480796 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-7db0f462-ef23-4526-a889-6ac5d9ed01e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:58.493928 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0f462-ef23-4526-a889-6ac5d9ed01e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:58.495444 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0f462-ef23-4526-a889-6ac5d9ed01e7 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:58.506831 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 912/1806] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:58.507542 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0f462-ef23-4526-a889-6ac5d9ed01e7 service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:58.508896 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-7db0f462-ef23-4526-a889-6ac5d9ed01e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:58.522464 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0f462-ef23-4526-a889-6ac5d9ed01e7 service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:58.534621 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed67167-0315-4174-97a9-9da59c1b8894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:58.538287 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed67167-0315-4174-97a9-9da59c1b8894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:58.538287 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed67167-0315-4174-97a9-9da59c1b8894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:58.538287 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed67167-0315-4174-97a9-9da59c1b8894 admin admin] PATH_INFO: `/v3/users/884cabea10684e9c8872d23c570639b9` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:58.538287 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed67167-0315-4174-97a9-9da59c1b8894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=884cabea10684e9c8872d23c570639b9)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:58.543881 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed67167-0315-4174-97a9-9da59c1b8894 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:58.564761 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 895/1807] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:09:58 2022] POST /identity/v3/users => generated 284 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:09:58.566487 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef356782-559e-43e9-b3f6-0d0259a04ea2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:58.579493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef356782-559e-43e9-b3f6-0d0259a04ea2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:58.584668 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d13175-5ce2-471b-bef6-b74edc343ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:58.585339 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d13175-5ce2-471b-bef6-b74edc343ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:58.585676 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d13175-5ce2-471b-bef6-b74edc343ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:58.586180 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d13175-5ce2-471b-bef6-b74edc343ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:58.587314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d13175-5ce2-471b-bef6-b74edc343ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:58.588957 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d13175-5ce2-471b-bef6-b74edc343ab4 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:58.600796 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 896/1808] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:58.604997 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d13175-5ce2-471b-bef6-b74edc343ab4 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:58.616232 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d13175-5ce2-471b-bef6-b74edc343ab4 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:58.627399 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f8733-1d30-41d8-b674-a8a99740352d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:58.628607 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f8733-1d30-41d8-b674-a8a99740352d admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:58.629074 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f8733-1d30-41d8-b674-a8a99740352d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:58.629553 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f8733-1d30-41d8-b674-a8a99740352d admin admin] PATH_INFO: `/v3/projects/eca4dc271b1f441f97e8f863348f3ad9/users/80c7e655d76b46cfadf87dd534165982/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:58.657942 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f8733-1d30-41d8-b674-a8a99740352d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca4dc271b1f441f97e8f863348f3ad9, user_id=80c7e655d76b46cfadf87dd534165982, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:58.663845 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f8733-1d30-41d8-b674-a8a99740352d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:58.760077 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5ed67167-0315-4174-97a9-9da59c1b8894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '884cabea10684e9c8872d23c570639b9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:58.761127 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5ed67167-0315-4174-97a9-9da59c1b8894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '884cabea10684e9c8872d23c570639b9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:58.776376 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5ed67167-0315-4174-97a9-9da59c1b8894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '884cabea10684e9c8872d23c570639b9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:58.781205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 897/1809] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:58 2022] PUT /identity/v3/projects/eca4dc271b1f441f97e8f863348f3ad9/users/80c7e655d76b46cfadf87dd534165982/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:58.788161 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5ed67167-0315-4174-97a9-9da59c1b8894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '884cabea10684e9c8872d23c570639b9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:58.789105 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5ed67167-0315-4174-97a9-9da59c1b8894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '884cabea10684e9c8872d23c570639b9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:58.791368 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f8733-1d30-41d8-b674-a8a99740352d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:58.796004 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-c85f8733-1d30-41d8-b674-a8a99740352d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:58.882457 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 913/1810] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:09:58 2022] DELETE /identity/v3/users/884cabea10684e9c8872d23c570639b9 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:58.928386 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f8733-1d30-41d8-b674-a8a99740352d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:59.018667 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45d3b2-fc00-4796-8265-459840edd9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:59.019273 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45d3b2-fc00-4796-8265-459840edd9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:59.019551 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45d3b2-fc00-4796-8265-459840edd9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:59.019863 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45d3b2-fc00-4796-8265-459840edd9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:59.020846 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45d3b2-fc00-4796-8265-459840edd9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:59.022255 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45d3b2-fc00-4796-8265-459840edd9c8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:59.041833 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 898/1811] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:09:59.042862 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed67167-0315-4174-97a9-9da59c1b8894 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:59.106737 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed67167-0315-4174-97a9-9da59c1b8894 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:59.123044 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bf0e1-2042-4eff-bc1c-02f89f370eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:59.124325 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bf0e1-2042-4eff-bc1c-02f89f370eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:59.124678 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bf0e1-2042-4eff-bc1c-02f89f370eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:59.124961 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bf0e1-2042-4eff-bc1c-02f89f370eaf admin admin] PATH_INFO: `/v3/projects/eca4dc271b1f441f97e8f863348f3ad9/users/80c7e655d76b46cfadf87dd534165982/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:59.128428 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bf0e1-2042-4eff-bc1c-02f89f370eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca4dc271b1f441f97e8f863348f3ad9, user_id=80c7e655d76b46cfadf87dd534165982, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:59.140193 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bf0e1-2042-4eff-bc1c-02f89f370eaf admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:59.165839 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 914/1812] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:09:59 2022] PUT /identity/v3/projects/eca4dc271b1f441f97e8f863348f3ad9/users/80c7e655d76b46cfadf87dd534165982/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:59.181095 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb24b2-1cb8-4ce1-80d0-eeed18c97094 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:59.181095 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb24b2-1cb8-4ce1-80d0-eeed18c97094 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:59.181095 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb24b2-1cb8-4ce1-80d0-eeed18c97094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:59.218969 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-f5bb24b2-1cb8-4ce1-80d0-eeed18c97094 None None] MFA Rules not processed for user `80c7e655d76b46cfadf87dd534165982`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:59.220174 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f5bb24b2-1cb8-4ce1-80d0-eeed18c97094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:59.348701 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bf0e1-2042-4eff-bc1c-02f89f370eaf admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:59.349116 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 899/1813] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:59 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:09:59.350397 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-439bf0e1-2042-4eff-bc1c-02f89f370eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:59.444774 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bf0e1-2042-4eff-bc1c-02f89f370eaf admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:59.445437 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f56d6-ab0f-4aa7-b0b4-f58f1b6a69dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:59.446177 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f56d6-ab0f-4aa7-b0b4-f58f1b6a69dc service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:59.446836 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f56d6-ab0f-4aa7-b0b4-f58f1b6a69dc service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:59.446836 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f56d6-ab0f-4aa7-b0b4-f58f1b6a69dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:59.461791 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f56d6-ab0f-4aa7-b0b4-f58f1b6a69dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:59.463355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f56d6-ab0f-4aa7-b0b4-f58f1b6a69dc service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:59.479059 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 915/1814] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:59 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:59.602577 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb24b2-1cb8-4ce1-80d0-eeed18c97094 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:59.604024 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f5bb24b2-1cb8-4ce1-80d0-eeed18c97094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:59.711112 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f56d6-ab0f-4aa7-b0b4-f58f1b6a69dc service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:59.729116 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f56d6-ab0f-4aa7-b0b4-f58f1b6a69dc service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:59.729520 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb24b2-1cb8-4ce1-80d0-eeed18c97094 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:59.733979 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7bab1-eeac-4302-b741-5627e169509a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:59.734868 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7bab1-eeac-4302-b741-5627e169509a service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:59.735156 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7bab1-eeac-4302-b741-5627e169509a service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:59.735589 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7bab1-eeac-4302-b741-5627e169509a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:59.736730 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88746cc-da85-4982-b2bd-c692e69ac0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:59.737688 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-29e7bab1-eeac-4302-b741-5627e169509a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:59.738732 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88746cc-da85-4982-b2bd-c692e69ac0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:59.739363 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88746cc-da85-4982-b2bd-c692e69ac0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:59.739843 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88746cc-da85-4982-b2bd-c692e69ac0fb admin admin] PATH_INFO: `/v3/projects/8771b220f4f043d0b9e29732596bf106` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:59.741737 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88746cc-da85-4982-b2bd-c692e69ac0fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8771b220f4f043d0b9e29732596bf106)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:59.743938 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88746cc-da85-4982-b2bd-c692e69ac0fb admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:59.810032 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7bab1-eeac-4302-b741-5627e169509a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:59.812141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7bab1-eeac-4302-b741-5627e169509a service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:59.823343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 916/1815] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:59 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:09:59.824185 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7bab1-eeac-4302-b741-5627e169509a service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:09:59.825429 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-29e7bab1-eeac-4302-b741-5627e169509a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:59.837132 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7bab1-eeac-4302-b741-5627e169509a service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:09:59.853809 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d88746cc-da85-4982-b2bd-c692e69ac0fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8771b220f4f043d0b9e29732596bf106', 'request_id': 'req-d88746cc-da85-4982-b2bd-c692e69ac0fb'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:59.902605 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb59a2-bc53-4998-9324-d8b694a6bdf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:09:59.903277 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb59a2-bc53-4998-9324-d8b694a6bdf4 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:59.903556 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb59a2-bc53-4998-9324-d8b694a6bdf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:59.903827 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb59a2-bc53-4998-9324-d8b694a6bdf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:59.905855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-19bb59a2-bc53-4998-9324-d8b694a6bdf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:09:59.948726 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d88746cc-da85-4982-b2bd-c692e69ac0fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8771b220f4f043d0b9e29732596bf106', 'request_id': 'req-d88746cc-da85-4982-b2bd-c692e69ac0fb'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:59.954809 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d88746cc-da85-4982-b2bd-c692e69ac0fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8771b220f4f043d0b9e29732596bf106', 'request_id': 'req-d88746cc-da85-4982-b2bd-c692e69ac0fb'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:59.965439 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb59a2-bc53-4998-9324-d8b694a6bdf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:09:59.966103 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d88746cc-da85-4982-b2bd-c692e69ac0fb admin admin] The token cache is being invalidate because project 8771b220f4f043d0b9e29732596bf106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:09:59.966395 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d88746cc-da85-4982-b2bd-c692e69ac0fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:59.966892 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb59a2-bc53-4998-9324-d8b694a6bdf4 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:09:59.970015 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d88746cc-da85-4982-b2bd-c692e69ac0fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:09:59.970015 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 900/1816] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:09:59 2022] DELETE /identity/v3/projects/8771b220f4f043d0b9e29732596bf106 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:09:59.973603 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84616230-6d38-496f-848b-f9d4bd3a2810 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:09:59.974009 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84616230-6d38-496f-848b-f9d4bd3a2810 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:09:59.974373 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84616230-6d38-496f-848b-f9d4bd3a2810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:09:59.978272 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 917/1817] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:09:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:09:59.993595 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-84616230-6d38-496f-848b-f9d4bd3a2810 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:09:59.994821 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-84616230-6d38-496f-848b-f9d4bd3a2810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:00.055794 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 901/1818] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:10:00.064421 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57b3f3-63b9-4392-ad10-d42b245002f8 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:00.064642 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57b3f3-63b9-4392-ad10-d42b245002f8 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:00.064921 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57b3f3-63b9-4392-ad10-d42b245002f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:00.082206 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-6c57b3f3-63b9-4392-ad10-d42b245002f8 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:00.083434 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-6c57b3f3-63b9-4392-ad10-d42b245002f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:00.091405 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 918/1819] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:00.096314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84616230-6d38-496f-848b-f9d4bd3a2810 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:00.106109 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84616230-6d38-496f-848b-f9d4bd3a2810 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:00.111389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df341b2b-67bf-4486-a4e4-6987be7fcef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:00.112033 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df341b2b-67bf-4486-a4e4-6987be7fcef9 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:00.113145 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df341b2b-67bf-4486-a4e4-6987be7fcef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:00.113145 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df341b2b-67bf-4486-a4e4-6987be7fcef9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:00.113340 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df341b2b-67bf-4486-a4e4-6987be7fcef9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:10:00.113629 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df341b2b-67bf-4486-a4e4-6987be7fcef9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:00.115287 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df341b2b-67bf-4486-a4e4-6987be7fcef9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:00.127807 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 902/1820] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:10:00.132179 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57b3f3-63b9-4392-ad10-d42b245002f8 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:00.141720 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57b3f3-63b9-4392-ad10-d42b245002f8 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:00.146276 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a622a4-05de-4701-baad-21c3e87b24e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:00.146972 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a622a4-05de-4701-baad-21c3e87b24e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:00.147251 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a622a4-05de-4701-baad-21c3e87b24e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:00.147521 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a622a4-05de-4701-baad-21c3e87b24e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:00.148206 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a622a4-05de-4701-baad-21c3e87b24e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:00.150081 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a622a4-05de-4701-baad-21c3e87b24e6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:00.252123 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 919/1821] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:00 2022] POST /identity/v3/projects => generated 399 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:00.255757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df341b2b-67bf-4486-a4e4-6987be7fcef9 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:00.273389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df341b2b-67bf-4486-a4e4-6987be7fcef9 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:00.445590 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa00a-b120-4fb5-9f24-4e85e7a8c9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:00.447035 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa00a-b120-4fb5-9f24-4e85e7a8c9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:00.447589 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa00a-b120-4fb5-9f24-4e85e7a8c9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:00.453488 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa00a-b120-4fb5-9f24-4e85e7a8c9e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:00.453488 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2aa00a-b120-4fb5-9f24-4e85e7a8c9e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:00.453488 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2aa00a-b120-4fb5-9f24-4e85e7a8c9e7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:00.638527 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 903/1822] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:00 2022] POST /identity/v3/users => generated 300 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:10:00.644469 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a622a4-05de-4701-baad-21c3e87b24e6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:00.666436 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a622a4-05de-4701-baad-21c3e87b24e6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:00.674294 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ef56b-4890-4dbe-a797-7f2b4c434336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:00.675043 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef56b-4890-4dbe-a797-7f2b4c434336 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:00.675320 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef56b-4890-4dbe-a797-7f2b4c434336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:00.675594 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef56b-4890-4dbe-a797-7f2b4c434336 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:00.676466 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ef56b-4890-4dbe-a797-7f2b4c434336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:00.678165 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ef56b-4890-4dbe-a797-7f2b4c434336 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:00.701259 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 920/1823] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:00.705700 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa00a-b120-4fb5-9f24-4e85e7a8c9e7 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:00.734230 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa00a-b120-4fb5-9f24-4e85e7a8c9e7 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:00.743179 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b8f2a-2953-4b53-b298-7e5977c2d0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:00.744137 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b8f2a-2953-4b53-b298-7e5977c2d0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:00.744494 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b8f2a-2953-4b53-b298-7e5977c2d0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:00.744847 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b8f2a-2953-4b53-b298-7e5977c2d0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:00.745712 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b8f2a-2953-4b53-b298-7e5977c2d0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:00.747793 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b8f2a-2953-4b53-b298-7e5977c2d0a0 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:00.764468 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 904/1824] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:10:00.769703 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ef56b-4890-4dbe-a797-7f2b4c434336 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:00.792778 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ef56b-4890-4dbe-a797-7f2b4c434336 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:00.792778 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3fefd-50ea-451a-aebd-82749dbaf068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:00.792778 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3fefd-50ea-451a-aebd-82749dbaf068 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:00.792778 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3fefd-50ea-451a-aebd-82749dbaf068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:00.793879 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3fefd-50ea-451a-aebd-82749dbaf068 admin admin] PATH_INFO: `/v3/projects/acbf0575d6254a618573b9ebb6aac37a/users/c984cf23b14e4421b6be986efa74760a/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:00.807645 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3fefd-50ea-451a-aebd-82749dbaf068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbf0575d6254a618573b9ebb6aac37a, user_id=c984cf23b14e4421b6be986efa74760a, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:00.810464 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3fefd-50ea-451a-aebd-82749dbaf068 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:00.921125 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 921/1825] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:00 2022] PUT /identity/v3/projects/acbf0575d6254a618573b9ebb6aac37a/users/c984cf23b14e4421b6be986efa74760a/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:00.932916 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b202a-d0da-4e48-bdc3-70787fe4845e None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:00.932916 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b202a-d0da-4e48-bdc3-70787fe4845e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:00.932916 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b202a-d0da-4e48-bdc3-70787fe4845e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:00.972567 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-e59b202a-d0da-4e48-bdc3-70787fe4845e None None] MFA Rules not processed for user `c984cf23b14e4421b6be986efa74760a`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:00.974219 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e59b202a-d0da-4e48-bdc3-70787fe4845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:01.082604 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 905/1826] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:01.090891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3fefd-50ea-451a-aebd-82749dbaf068 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:01.173526 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3fefd-50ea-451a-aebd-82749dbaf068 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:01.178553 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a7c1e-b226-4f43-bb48-cf2c8e279f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:01.179250 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a7c1e-b226-4f43-bb48-cf2c8e279f08 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:01.179538 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a7c1e-b226-4f43-bb48-cf2c8e279f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:01.179806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a7c1e-b226-4f43-bb48-cf2c8e279f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:01.180509 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a7c1e-b226-4f43-bb48-cf2c8e279f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:01.182419 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a7c1e-b226-4f43-bb48-cf2c8e279f08 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:01.325393 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 922/1827] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:01 2022] POST /identity/v3/projects => generated 399 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:01.331134 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b202a-d0da-4e48-bdc3-70787fe4845e None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:01.342839 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b202a-d0da-4e48-bdc3-70787fe4845e None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:01.448990 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714dfcb-f031-45e9-bfa9-374feec3b96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:01.449963 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714dfcb-f031-45e9-bfa9-374feec3b96c admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:01.450438 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714dfcb-f031-45e9-bfa9-374feec3b96c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:01.450985 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714dfcb-f031-45e9-bfa9-374feec3b96c admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:01.452044 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714dfcb-f031-45e9-bfa9-374feec3b96c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:01.465373 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714dfcb-f031-45e9-bfa9-374feec3b96c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:01.733900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 906/1828] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:01 2022] POST /identity/v3/users => generated 306 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:10:01.736730 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a7c1e-b226-4f43-bb48-cf2c8e279f08 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:01.750757 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a7c1e-b226-4f43-bb48-cf2c8e279f08 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:01.762015 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4510d-4ac2-4cff-a062-fe4047ff6235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:01.763076 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4510d-4ac2-4cff-a062-fe4047ff6235 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:01.763432 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4510d-4ac2-4cff-a062-fe4047ff6235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:01.763800 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4510d-4ac2-4cff-a062-fe4047ff6235 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:01.765475 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4510d-4ac2-4cff-a062-fe4047ff6235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:01.767230 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4510d-4ac2-4cff-a062-fe4047ff6235 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:01.785232 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 923/1829] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:10:01.789656 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714dfcb-f031-45e9-bfa9-374feec3b96c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:01.803254 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714dfcb-f031-45e9-bfa9-374feec3b96c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:01.807898 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b21892-4a6d-45f1-8f11-f1e6f68c8555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:01.808804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b21892-4a6d-45f1-8f11-f1e6f68c8555 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:01.809094 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b21892-4a6d-45f1-8f11-f1e6f68c8555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:01.809392 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b21892-4a6d-45f1-8f11-f1e6f68c8555 admin admin] PATH_INFO: `/v3/projects/df9367fb13bf47a0894198116cfda91b/users/55dafd4b5ac940fd9619d41efce7cf70/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:01.843606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b21892-4a6d-45f1-8f11-f1e6f68c8555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9367fb13bf47a0894198116cfda91b, user_id=55dafd4b5ac940fd9619d41efce7cf70, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:01.846338 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b21892-4a6d-45f1-8f11-f1e6f68c8555 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:02.075217 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 907/1830] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:01 2022] PUT /identity/v3/projects/df9367fb13bf47a0894198116cfda91b/users/55dafd4b5ac940fd9619d41efce7cf70/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:02.079392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4510d-4ac2-4cff-a062-fe4047ff6235 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:02.089800 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4510d-4ac2-4cff-a062-fe4047ff6235 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:02.146611 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23022bd-90b1-4ca2-bda9-0edcd03c56a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:02.147370 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23022bd-90b1-4ca2-bda9-0edcd03c56a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:02.147650 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23022bd-90b1-4ca2-bda9-0edcd03c56a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:02.147921 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23022bd-90b1-4ca2-bda9-0edcd03c56a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:02.148638 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23022bd-90b1-4ca2-bda9-0edcd03c56a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:02.150224 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23022bd-90b1-4ca2-bda9-0edcd03c56a2 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:02.163414 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 924/1831] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:02.164621 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b21892-4a6d-45f1-8f11-f1e6f68c8555 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:02.177119 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b21892-4a6d-45f1-8f11-f1e6f68c8555 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:02.181823 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c90701-cddc-4f14-ace9-0024cf8a4704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:02.182743 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c90701-cddc-4f14-ace9-0024cf8a4704 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:02.183017 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c90701-cddc-4f14-ace9-0024cf8a4704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:02.183285 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c90701-cddc-4f14-ace9-0024cf8a4704 admin admin] PATH_INFO: `/v3/projects/df9367fb13bf47a0894198116cfda91b/users/55dafd4b5ac940fd9619d41efce7cf70/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:02.185281 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c90701-cddc-4f14-ace9-0024cf8a4704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9367fb13bf47a0894198116cfda91b, user_id=55dafd4b5ac940fd9619d41efce7cf70, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:02.188632 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c90701-cddc-4f14-ace9-0024cf8a4704 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:02.204324 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 908/1832] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:02 2022] PUT /identity/v3/projects/df9367fb13bf47a0894198116cfda91b/users/55dafd4b5ac940fd9619d41efce7cf70/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:02.233380 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a97bf-f066-4109-bfd8-da0249fce71f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:02.233853 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a97bf-f066-4109-bfd8-da0249fce71f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:02.234128 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a97bf-f066-4109-bfd8-da0249fce71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:02.264932 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-430a97bf-f066-4109-bfd8-da0249fce71f None None] MFA Rules not processed for user `55dafd4b5ac940fd9619d41efce7cf70`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:02.266376 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-430a97bf-f066-4109-bfd8-da0249fce71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:02.355847 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 925/1833] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:02 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:02.368095 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c90701-cddc-4f14-ace9-0024cf8a4704 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:02.369821 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-03c90701-cddc-4f14-ace9-0024cf8a4704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:02.426968 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c90701-cddc-4f14-ace9-0024cf8a4704 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:02.430603 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d98c86-9380-4787-8dfc-4bf1a91594f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:02.431260 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d98c86-9380-4787-8dfc-4bf1a91594f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:02.431565 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d98c86-9380-4787-8dfc-4bf1a91594f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:02.431838 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d98c86-9380-4787-8dfc-4bf1a91594f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:02.440692 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d98c86-9380-4787-8dfc-4bf1a91594f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:02.442093 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d98c86-9380-4787-8dfc-4bf1a91594f0 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:02.451284 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 909/1834] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:02 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:02.746291 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a97bf-f066-4109-bfd8-da0249fce71f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:02.747746 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-430a97bf-f066-4109-bfd8-da0249fce71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:02.759648 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a97bf-f066-4109-bfd8-da0249fce71f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:02.763710 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad5665-1468-477a-b284-6d9685584e50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:02.765333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad5665-1468-477a-b284-6d9685584e50 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:02.765668 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad5665-1468-477a-b284-6d9685584e50 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:02.765945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad5665-1468-477a-b284-6d9685584e50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:02.845294 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad5665-1468-477a-b284-6d9685584e50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:02.846779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad5665-1468-477a-b284-6d9685584e50 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:02.855865 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 926/1835] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:06.796075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26402390-b7d7-42bf-a631-4aed279bf767 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:06.796572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26402390-b7d7-42bf-a631-4aed279bf767 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:06.796757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26402390-b7d7-42bf-a631-4aed279bf767 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:06.798591 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 910/1836] 10.222.0.42 () {54 vars in 921 bytes} [Wed Feb 16 17:10:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:10:06.808835 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e646ef3-ab55-4ba4-ace5-2dc6f11e9cef None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:06.809877 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e646ef3-ab55-4ba4-ace5-2dc6f11e9cef None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:06.810299 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e646ef3-ab55-4ba4-ace5-2dc6f11e9cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:06.835743 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-5e646ef3-ab55-4ba4-ace5-2dc6f11e9cef None None] MFA Rules not processed for user `9a30603a236e4681a7702eec7029e9db`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:06.837148 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5e646ef3-ab55-4ba4-ace5-2dc6f11e9cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:06.960047 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 927/1837] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Feb 16 17:10:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:07.031951 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26402390-b7d7-42bf-a631-4aed279bf767 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:07.033855 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-26402390-b7d7-42bf-a631-4aed279bf767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:07.056361 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26402390-b7d7-42bf-a631-4aed279bf767 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:07.079786 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6d908-0509-4804-ad62-43f80ea41f6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:07.083126 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6d908-0509-4804-ad62-43f80ea41f6d service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:07.084137 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6d908-0509-4804-ad62-43f80ea41f6d service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:07.084557 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6d908-0509-4804-ad62-43f80ea41f6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:07.097297 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6d908-0509-4804-ad62-43f80ea41f6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:07.099883 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6d908-0509-4804-ad62-43f80ea41f6d service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:07.143710 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 911/1838] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:10:11.426257 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e646ef3-ab55-4ba4-ace5-2dc6f11e9cef None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:11.493674 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e646ef3-ab55-4ba4-ace5-2dc6f11e9cef None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:11.499352 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba99aeb-74a6-4da1-8221-c4e8cb32ed9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:11.500244 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba99aeb-74a6-4da1-8221-c4e8cb32ed9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:11.500529 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba99aeb-74a6-4da1-8221-c4e8cb32ed9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:11.500807 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba99aeb-74a6-4da1-8221-c4e8cb32ed9e admin admin] PATH_INFO: `/v3/users/c984cf23b14e4421b6be986efa74760a` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:11.502036 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba99aeb-74a6-4da1-8221-c4e8cb32ed9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c984cf23b14e4421b6be986efa74760a)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:11.504143 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba99aeb-74a6-4da1-8221-c4e8cb32ed9e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:11.737783 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-eba99aeb-74a6-4da1-8221-c4e8cb32ed9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c984cf23b14e4421b6be986efa74760a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:11.738388 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-eba99aeb-74a6-4da1-8221-c4e8cb32ed9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c984cf23b14e4421b6be986efa74760a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:11.750930 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-eba99aeb-74a6-4da1-8221-c4e8cb32ed9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c984cf23b14e4421b6be986efa74760a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:11.757458 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-eba99aeb-74a6-4da1-8221-c4e8cb32ed9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c984cf23b14e4421b6be986efa74760a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:11.758099 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-eba99aeb-74a6-4da1-8221-c4e8cb32ed9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c984cf23b14e4421b6be986efa74760a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:11.811329 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6d908-0509-4804-ad62-43f80ea41f6d service nova] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:11.820567 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6d908-0509-4804-ad62-43f80ea41f6d service nova] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:11.824215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff68a2-9bee-402e-8fc4-9c2ea5e8b523 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:11.825372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff68a2-9bee-402e-8fc4-9c2ea5e8b523 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:11.825682 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff68a2-9bee-402e-8fc4-9c2ea5e8b523 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:11.826239 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff68a2-9bee-402e-8fc4-9c2ea5e8b523 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:11.828179 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-50ff68a2-9bee-402e-8fc4-9c2ea5e8b523 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:11.834084 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 928/1839] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:11 2022] DELETE /identity/v3/users/c984cf23b14e4421b6be986efa74760a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:11.838762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39ae73-b904-4b5d-a140-ce91538b1ce9 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:11.839160 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39ae73-b904-4b5d-a140-ce91538b1ce9 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:11.839446 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39ae73-b904-4b5d-a140-ce91538b1ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:11.859724 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-aa39ae73-b904-4b5d-a140-ce91538b1ce9 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:11.866016 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-aa39ae73-b904-4b5d-a140-ce91538b1ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:11.896727 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff68a2-9bee-402e-8fc4-9c2ea5e8b523 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:11.898182 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff68a2-9bee-402e-8fc4-9c2ea5e8b523 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:11.908736 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 912/1840] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:11.929637 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 929/1841] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:10:11.949056 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff68a2-9bee-402e-8fc4-9c2ea5e8b523 service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:11.960451 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-50ff68a2-9bee-402e-8fc4-9c2ea5e8b523 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:12.028300 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff68a2-9bee-402e-8fc4-9c2ea5e8b523 service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:12.090690 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74aef4-31fe-4886-9397-60340cba0545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:12.091142 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74aef4-31fe-4886-9397-60340cba0545 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:12.091447 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74aef4-31fe-4886-9397-60340cba0545 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:12.092284 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74aef4-31fe-4886-9397-60340cba0545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:12.103069 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74aef4-31fe-4886-9397-60340cba0545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:12.104515 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74aef4-31fe-4886-9397-60340cba0545 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:12.118260 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 913/1842] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:12.393025 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39ae73-b904-4b5d-a140-ce91538b1ce9 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:12.394588 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-aa39ae73-b904-4b5d-a140-ce91538b1ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:12.413998 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39ae73-b904-4b5d-a140-ce91538b1ce9 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:12.414400 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bbe79-ad0a-4999-a5d2-74d049523577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:12.415315 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bbe79-ad0a-4999-a5d2-74d049523577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:12.415596 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bbe79-ad0a-4999-a5d2-74d049523577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:12.416138 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bbe79-ad0a-4999-a5d2-74d049523577 admin admin] PATH_INFO: `/v3/users/626f86c8841c48988b75066df1fd3474` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:12.417707 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bbe79-ad0a-4999-a5d2-74d049523577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=626f86c8841c48988b75066df1fd3474)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:12.419892 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bbe79-ad0a-4999-a5d2-74d049523577 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:12.591369 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74aef4-31fe-4886-9397-60340cba0545 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:12.593521 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-ee74aef4-31fe-4886-9397-60340cba0545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:12.622181 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74aef4-31fe-4886-9397-60340cba0545 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:12.628655 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fda6d-4a04-40dc-8fcc-c4e41df5a073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:12.629565 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fda6d-4a04-40dc-8fcc-c4e41df5a073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:12.634796 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fda6d-4a04-40dc-8fcc-c4e41df5a073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:12.634796 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fda6d-4a04-40dc-8fcc-c4e41df5a073 admin admin] PATH_INFO: `/v3/projects/acbf0575d6254a618573b9ebb6aac37a` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:12.634796 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fda6d-4a04-40dc-8fcc-c4e41df5a073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acbf0575d6254a618573b9ebb6aac37a)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:12.634796 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fda6d-4a04-40dc-8fcc-c4e41df5a073 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:12.643011 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-122bbe79-ad0a-4999-a5d2-74d049523577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '626f86c8841c48988b75066df1fd3474'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:12.644213 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-122bbe79-ad0a-4999-a5d2-74d049523577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '626f86c8841c48988b75066df1fd3474'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:12.660547 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-122bbe79-ad0a-4999-a5d2-74d049523577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '626f86c8841c48988b75066df1fd3474'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:12.671933 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-122bbe79-ad0a-4999-a5d2-74d049523577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '626f86c8841c48988b75066df1fd3474'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:12.672779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-122bbe79-ad0a-4999-a5d2-74d049523577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '626f86c8841c48988b75066df1fd3474'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:12.780912 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-481fda6d-4a04-40dc-8fcc-c4e41df5a073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acbf0575d6254a618573b9ebb6aac37a', 'request_id': 'req-481fda6d-4a04-40dc-8fcc-c4e41df5a073'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:12.816984 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 930/1843] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:12 2022] DELETE /identity/v3/users/626f86c8841c48988b75066df1fd3474 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:12.821438 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d098e-5daf-4e3a-86dc-8a838d9bbec6 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:12.821785 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d098e-5daf-4e3a-86dc-8a838d9bbec6 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:12.822156 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d098e-5daf-4e3a-86dc-8a838d9bbec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:12.840664 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-e85d098e-5daf-4e3a-86dc-8a838d9bbec6 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:12.841911 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e85d098e-5daf-4e3a-86dc-8a838d9bbec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:12.911445 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-481fda6d-4a04-40dc-8fcc-c4e41df5a073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acbf0575d6254a618573b9ebb6aac37a', 'request_id': 'req-481fda6d-4a04-40dc-8fcc-c4e41df5a073'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:12.911445 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-481fda6d-4a04-40dc-8fcc-c4e41df5a073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acbf0575d6254a618573b9ebb6aac37a', 'request_id': 'req-481fda6d-4a04-40dc-8fcc-c4e41df5a073'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:12.912762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 931/1844] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:10:12.923002 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d098e-5daf-4e3a-86dc-8a838d9bbec6 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:12.924469 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-481fda6d-4a04-40dc-8fcc-c4e41df5a073 admin admin] The token cache is being invalidate because project acbf0575d6254a618573b9ebb6aac37a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:12.924615 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e85d098e-5daf-4e3a-86dc-8a838d9bbec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:12.924967 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-481fda6d-4a04-40dc-8fcc-c4e41df5a073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:12.925635 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-481fda6d-4a04-40dc-8fcc-c4e41df5a073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:12.927380 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 914/1845] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:12 2022] DELETE /identity/v3/projects/acbf0575d6254a618573b9ebb6aac37a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:12.931869 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fda6d-4a04-40dc-8fcc-c4e41df5a073 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:12.933454 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-481fda6d-4a04-40dc-8fcc-c4e41df5a073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:12.988474 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d098e-5daf-4e3a-86dc-8a838d9bbec6 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:12.992644 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e0a01-272e-44cb-9541-acde208b5677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:12.993413 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e0a01-272e-44cb-9541-acde208b5677 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:12.993729 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e0a01-272e-44cb-9541-acde208b5677 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:12.994014 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e0a01-272e-44cb-9541-acde208b5677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:12.995888 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a17e0a01-272e-44cb-9541-acde208b5677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:13.005015 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fda6d-4a04-40dc-8fcc-c4e41df5a073 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:13.009220 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e0a01-272e-44cb-9541-acde208b5677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:13.010356 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fc1ec-e897-4e46-b083-258b52ba0e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:13.010668 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e0a01-272e-44cb-9541-acde208b5677 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:13.011315 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fc1ec-e897-4e46-b083-258b52ba0e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:13.011644 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fc1ec-e897-4e46-b083-258b52ba0e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:13.011925 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fc1ec-e897-4e46-b083-258b52ba0e09 admin admin] PATH_INFO: `/v3/users/55dafd4b5ac940fd9619d41efce7cf70` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:13.013179 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fc1ec-e897-4e46-b083-258b52ba0e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55dafd4b5ac940fd9619d41efce7cf70)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:13.015319 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fc1ec-e897-4e46-b083-258b52ba0e09 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:13.023871 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 932/1846] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:10:13.274266 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6c4fc1ec-e897-4e46-b083-258b52ba0e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55dafd4b5ac940fd9619d41efce7cf70'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:13.277951 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6c4fc1ec-e897-4e46-b083-258b52ba0e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55dafd4b5ac940fd9619d41efce7cf70'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:13.288143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6c4fc1ec-e897-4e46-b083-258b52ba0e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55dafd4b5ac940fd9619d41efce7cf70'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:13.295662 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6c4fc1ec-e897-4e46-b083-258b52ba0e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55dafd4b5ac940fd9619d41efce7cf70'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:13.371785 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6c4fc1ec-e897-4e46-b083-258b52ba0e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55dafd4b5ac940fd9619d41efce7cf70'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:13.379407 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 915/1847] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:12 2022] DELETE /identity/v3/users/55dafd4b5ac940fd9619d41efce7cf70 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:13.549706 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e0a01-272e-44cb-9541-acde208b5677 service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:13.551129 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a17e0a01-272e-44cb-9541-acde208b5677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:13.570864 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e0a01-272e-44cb-9541-acde208b5677 service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:13.732485 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954a679-4ec7-4b73-a6ab-30a646f89553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:13.733494 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954a679-4ec7-4b73-a6ab-30a646f89553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:13.734439 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954a679-4ec7-4b73-a6ab-30a646f89553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:13.735773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954a679-4ec7-4b73-a6ab-30a646f89553 admin admin] PATH_INFO: `/v3/projects/11ce07acf9674b3097f56909b0c4590e` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:13.742101 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954a679-4ec7-4b73-a6ab-30a646f89553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11ce07acf9674b3097f56909b0c4590e)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:13.745746 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954a679-4ec7-4b73-a6ab-30a646f89553 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:13.884461 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d954a679-4ec7-4b73-a6ab-30a646f89553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11ce07acf9674b3097f56909b0c4590e', 'request_id': 'req-d954a679-4ec7-4b73-a6ab-30a646f89553'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:13.983003 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d954a679-4ec7-4b73-a6ab-30a646f89553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11ce07acf9674b3097f56909b0c4590e', 'request_id': 'req-d954a679-4ec7-4b73-a6ab-30a646f89553'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:13.992125 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fc1ec-e897-4e46-b083-258b52ba0e09 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:13.992607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d954a679-4ec7-4b73-a6ab-30a646f89553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11ce07acf9674b3097f56909b0c4590e', 'request_id': 'req-d954a679-4ec7-4b73-a6ab-30a646f89553'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:13.995950 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6c4fc1ec-e897-4e46-b083-258b52ba0e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:14.010365 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fc1ec-e897-4e46-b083-258b52ba0e09 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:14.026940 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d954a679-4ec7-4b73-a6ab-30a646f89553 admin admin] The token cache is being invalidate because project 11ce07acf9674b3097f56909b0c4590e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:14.026940 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d954a679-4ec7-4b73-a6ab-30a646f89553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:14.026940 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d954a679-4ec7-4b73-a6ab-30a646f89553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:14.027189 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 933/1848] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:13 2022] DELETE /identity/v3/projects/11ce07acf9674b3097f56909b0c4590e => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:14.031655 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954a679-4ec7-4b73-a6ab-30a646f89553 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:14.033052 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d954a679-4ec7-4b73-a6ab-30a646f89553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:14.083896 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fc235-3368-4d3d-a337-9a4cf701ea77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:14.084799 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fc235-3368-4d3d-a337-9a4cf701ea77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:14.085076 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fc235-3368-4d3d-a337-9a4cf701ea77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:14.085351 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fc235-3368-4d3d-a337-9a4cf701ea77 admin admin] PATH_INFO: `/v3/projects/df9367fb13bf47a0894198116cfda91b` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:14.086528 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fc235-3368-4d3d-a337-9a4cf701ea77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df9367fb13bf47a0894198116cfda91b)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:14.088430 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fc235-3368-4d3d-a337-9a4cf701ea77 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:14.100595 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954a679-4ec7-4b73-a6ab-30a646f89553 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:14.104613 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b86b14-4de6-47ae-ab80-2a88b016a815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:14.105482 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b86b14-4de6-47ae-ab80-2a88b016a815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:14.105813 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b86b14-4de6-47ae-ab80-2a88b016a815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:14.106095 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b86b14-4de6-47ae-ab80-2a88b016a815 admin admin] PATH_INFO: `/v3/users/a54b06fce77b45d387c5de5762202a34` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:14.108077 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b86b14-4de6-47ae-ab80-2a88b016a815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a54b06fce77b45d387c5de5762202a34)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:14.109976 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b86b14-4de6-47ae-ab80-2a88b016a815 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:14.236888 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-507fc235-3368-4d3d-a337-9a4cf701ea77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df9367fb13bf47a0894198116cfda91b', 'request_id': 'req-507fc235-3368-4d3d-a337-9a4cf701ea77'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:14.329722 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-507fc235-3368-4d3d-a337-9a4cf701ea77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df9367fb13bf47a0894198116cfda91b', 'request_id': 'req-507fc235-3368-4d3d-a337-9a4cf701ea77'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:14.336140 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-507fc235-3368-4d3d-a337-9a4cf701ea77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df9367fb13bf47a0894198116cfda91b', 'request_id': 'req-507fc235-3368-4d3d-a337-9a4cf701ea77'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:14.347834 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-507fc235-3368-4d3d-a337-9a4cf701ea77 admin admin] The token cache is being invalidate because project df9367fb13bf47a0894198116cfda91b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:14.348122 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-507fc235-3368-4d3d-a337-9a4cf701ea77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:14.348778 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-507fc235-3368-4d3d-a337-9a4cf701ea77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:14.350308 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 916/1849] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:13 2022] DELETE /identity/v3/projects/df9367fb13bf47a0894198116cfda91b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:10:14.354987 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5175e-26f9-43f1-9068-5579c6d1599e None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:14.355220 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5175e-26f9-43f1-9068-5579c6d1599e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:14.355501 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5175e-26f9-43f1-9068-5579c6d1599e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:14.377701 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-91d5175e-26f9-43f1-9068-5579c6d1599e None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:14.378997 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-91d5175e-26f9-43f1-9068-5579c6d1599e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:14.436827 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 917/1850] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:10:14.445418 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab854473-9fb2-464d-8b7e-a2a819515002 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:14.445733 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab854473-9fb2-464d-8b7e-a2a819515002 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:14.446035 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab854473-9fb2-464d-8b7e-a2a819515002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:14.453234 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-c6b86b14-4de6-47ae-ab80-2a88b016a815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a54b06fce77b45d387c5de5762202a34'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:14.453970 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-c6b86b14-4de6-47ae-ab80-2a88b016a815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a54b06fce77b45d387c5de5762202a34'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:14.465240 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-ab854473-9fb2-464d-8b7e-a2a819515002 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:14.466519 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-ab854473-9fb2-464d-8b7e-a2a819515002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:14.476860 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 918/1851] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:14.480836 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab854473-9fb2-464d-8b7e-a2a819515002 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:14.492900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab854473-9fb2-464d-8b7e-a2a819515002 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:14.496085 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-c6b86b14-4de6-47ae-ab80-2a88b016a815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a54b06fce77b45d387c5de5762202a34'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:14.499870 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28135036-4159-4440-8125-860c59a53dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:14.500844 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28135036-4159-4440-8125-860c59a53dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:14.501299 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28135036-4159-4440-8125-860c59a53dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:14.501775 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28135036-4159-4440-8125-860c59a53dc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:14.502639 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28135036-4159-4440-8125-860c59a53dc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:10:14.508509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28135036-4159-4440-8125-860c59a53dc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:14.508509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28135036-4159-4440-8125-860c59a53dc5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:14.511728 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-c6b86b14-4de6-47ae-ab80-2a88b016a815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a54b06fce77b45d387c5de5762202a34'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:14.513981 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-c6b86b14-4de6-47ae-ab80-2a88b016a815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a54b06fce77b45d387c5de5762202a34'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:14.520335 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 919/1852] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 17:10:14.524537 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28135036-4159-4440-8125-860c59a53dc5 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:14.538212 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28135036-4159-4440-8125-860c59a53dc5 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:14.544463 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8d2b8-648f-41c4-9e5b-4d82908068d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:14.545493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8d2b8-648f-41c4-9e5b-4d82908068d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:14.546002 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8d2b8-648f-41c4-9e5b-4d82908068d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:14.546484 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8d2b8-648f-41c4-9e5b-4d82908068d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:14.547606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8d2b8-648f-41c4-9e5b-4d82908068d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:14.549770 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8d2b8-648f-41c4-9e5b-4d82908068d2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:14.728344 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 934/1853] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:14 2022] DELETE /identity/v3/users/a54b06fce77b45d387c5de5762202a34 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:10:14.728661 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 920/1854] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:14 2022] POST /identity/v3/projects => generated 389 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:10:14.733180 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b86b14-4de6-47ae-ab80-2a88b016a815 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:14.801038 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b86b14-4de6-47ae-ab80-2a88b016a815 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:14.860541 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7495787-fec3-4a83-8207-0011a7df2781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:14.861150 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7495787-fec3-4a83-8207-0011a7df2781 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:14.861431 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7495787-fec3-4a83-8207-0011a7df2781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:14.861772 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7495787-fec3-4a83-8207-0011a7df2781 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:14.862547 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7495787-fec3-4a83-8207-0011a7df2781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:14.864684 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7495787-fec3-4a83-8207-0011a7df2781 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:14.964954 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 935/1855] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:14 2022] POST /identity/v3/users => generated 295 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:10:14.969879 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8d2b8-648f-41c4-9e5b-4d82908068d2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:14.980366 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8d2b8-648f-41c4-9e5b-4d82908068d2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:14.985961 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06c498-ac1b-40b3-8f2c-e5b2f044b35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:14.986617 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06c498-ac1b-40b3-8f2c-e5b2f044b35a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:14.987224 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06c498-ac1b-40b3-8f2c-e5b2f044b35a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:14.987503 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06c498-ac1b-40b3-8f2c-e5b2f044b35a admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:14.988240 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06c498-ac1b-40b3-8f2c-e5b2f044b35a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:14.989891 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06c498-ac1b-40b3-8f2c-e5b2f044b35a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:15.003464 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 921/1856] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:15.007716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7495787-fec3-4a83-8207-0011a7df2781 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:15.019466 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7495787-fec3-4a83-8207-0011a7df2781 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:15.027366 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78bdf5-55ee-4cf5-a1af-010a5654234f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:15.028100 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78bdf5-55ee-4cf5-a1af-010a5654234f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:15.028391 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78bdf5-55ee-4cf5-a1af-010a5654234f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:15.028660 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78bdf5-55ee-4cf5-a1af-010a5654234f admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:15.030442 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78bdf5-55ee-4cf5-a1af-010a5654234f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:15.032392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78bdf5-55ee-4cf5-a1af-010a5654234f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:15.045387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 936/1857] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:15.050244 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06c498-ac1b-40b3-8f2c-e5b2f044b35a admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:15.063162 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06c498-ac1b-40b3-8f2c-e5b2f044b35a admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:15.069942 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83a119-6e18-40d5-91fd-3ad35da604a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:15.071060 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83a119-6e18-40d5-91fd-3ad35da604a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:15.071741 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83a119-6e18-40d5-91fd-3ad35da604a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:15.072430 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83a119-6e18-40d5-91fd-3ad35da604a0 admin admin] PATH_INFO: `/v3/projects/db1c83b6f3ae4b75a53c5933f2daffd4/users/740e1b6ea6eb48e3b1ca4a31a41dfd36/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:15.088116 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83a119-6e18-40d5-91fd-3ad35da604a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db1c83b6f3ae4b75a53c5933f2daffd4, user_id=740e1b6ea6eb48e3b1ca4a31a41dfd36, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:15.090767 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83a119-6e18-40d5-91fd-3ad35da604a0 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:15.210561 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 922/1858] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:15 2022] PUT /identity/v3/projects/db1c83b6f3ae4b75a53c5933f2daffd4/users/740e1b6ea6eb48e3b1ca4a31a41dfd36/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:15.211687 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78bdf5-55ee-4cf5-a1af-010a5654234f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:15.213520 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-9c78bdf5-55ee-4cf5-a1af-010a5654234f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:15.224033 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7f9ba-6880-4c06-80c0-a5075e299e6e None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:15.224674 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7f9ba-6880-4c06-80c0-a5075e299e6e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:15.225051 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7f9ba-6880-4c06-80c0-a5075e299e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:15.235296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78bdf5-55ee-4cf5-a1af-010a5654234f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:15.264143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-3fb7f9ba-6880-4c06-80c0-a5075e299e6e None None] MFA Rules not processed for user `740e1b6ea6eb48e3b1ca4a31a41dfd36`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:15.266128 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-3fb7f9ba-6880-4c06-80c0-a5075e299e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:15.301425 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41debf25-8e3f-4cc3-973c-23733464f953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:15.302333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41debf25-8e3f-4cc3-973c-23733464f953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:15.302621 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41debf25-8e3f-4cc3-973c-23733464f953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:15.303006 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41debf25-8e3f-4cc3-973c-23733464f953 admin admin] PATH_INFO: `/v3/projects/bb96c01efc47434b968a3f7669a9fb68` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:15.304104 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41debf25-8e3f-4cc3-973c-23733464f953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb96c01efc47434b968a3f7669a9fb68)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:15.306113 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41debf25-8e3f-4cc3-973c-23733464f953 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:15.342370 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 923/1859] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:15.346589 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7f9ba-6880-4c06-80c0-a5075e299e6e None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:15.358540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7f9ba-6880-4c06-80c0-a5075e299e6e None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:15.363468 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e967e-e451-4058-9d3a-42dbfaf81eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:15.364426 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e967e-e451-4058-9d3a-42dbfaf81eee admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:15.364707 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e967e-e451-4058-9d3a-42dbfaf81eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:15.366757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e967e-e451-4058-9d3a-42dbfaf81eee admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:15.366757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e967e-e451-4058-9d3a-42dbfaf81eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:15.368415 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e967e-e451-4058-9d3a-42dbfaf81eee admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:15.451296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-41debf25-8e3f-4cc3-973c-23733464f953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb96c01efc47434b968a3f7669a9fb68', 'request_id': 'req-41debf25-8e3f-4cc3-973c-23733464f953'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:15.465228 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 924/1860] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:15 2022] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:15.469404 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e967e-e451-4058-9d3a-42dbfaf81eee admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:15.530100 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e967e-e451-4058-9d3a-42dbfaf81eee admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:15.534958 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbfc94-f2c1-4d82-871a-054ad4b36184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:15.535618 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbfc94-f2c1-4d82-871a-054ad4b36184 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:15.535898 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbfc94-f2c1-4d82-871a-054ad4b36184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:15.536204 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbfc94-f2c1-4d82-871a-054ad4b36184 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:15.536894 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbfc94-f2c1-4d82-871a-054ad4b36184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:15.538832 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbfc94-f2c1-4d82-871a-054ad4b36184 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:15.542361 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-41debf25-8e3f-4cc3-973c-23733464f953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb96c01efc47434b968a3f7669a9fb68', 'request_id': 'req-41debf25-8e3f-4cc3-973c-23733464f953'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:15.549584 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-41debf25-8e3f-4cc3-973c-23733464f953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb96c01efc47434b968a3f7669a9fb68', 'request_id': 'req-41debf25-8e3f-4cc3-973c-23733464f953'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:15.565896 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-41debf25-8e3f-4cc3-973c-23733464f953 admin admin] The token cache is being invalidate because project bb96c01efc47434b968a3f7669a9fb68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:15.566304 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-41debf25-8e3f-4cc3-973c-23733464f953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:15.567121 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-41debf25-8e3f-4cc3-973c-23733464f953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:15.568785 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 937/1861] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:15 2022] DELETE /identity/v3/projects/bb96c01efc47434b968a3f7669a9fb68 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:10:15.573898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98bec4-5e5c-4d04-8c9d-1840585f4c2c None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:15.574322 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98bec4-5e5c-4d04-8c9d-1840585f4c2c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:15.574723 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98bec4-5e5c-4d04-8c9d-1840585f4c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:15.596002 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-fe98bec4-5e5c-4d04-8c9d-1840585f4c2c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:15.597217 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-fe98bec4-5e5c-4d04-8c9d-1840585f4c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:15.605490 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 938/1862] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:10:15.614716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1570e-26b9-4740-a5a2-89d55705b8cc None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:15.615007 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1570e-26b9-4740-a5a2-89d55705b8cc None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:15.615285 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1570e-26b9-4740-a5a2-89d55705b8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:15.633713 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-d5d1570e-26b9-4740-a5a2-89d55705b8cc None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:15.634977 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d5d1570e-26b9-4740-a5a2-89d55705b8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:15.643731 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 939/1863] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:10:15.648493 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1570e-26b9-4740-a5a2-89d55705b8cc None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:15.661983 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1570e-26b9-4740-a5a2-89d55705b8cc None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:15.668168 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35fc72-10ee-4c4c-a029-31338fef0dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:15.670848 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35fc72-10ee-4c4c-a029-31338fef0dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:15.670848 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35fc72-10ee-4c4c-a029-31338fef0dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:15.670848 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35fc72-10ee-4c4c-a029-31338fef0dc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:15.672209 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35fc72-10ee-4c4c-a029-31338fef0dc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:10:15.672695 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35fc72-10ee-4c4c-a029-31338fef0dc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:15.675025 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35fc72-10ee-4c4c-a029-31338fef0dc3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:15.675241 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 925/1864] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:15 2022] POST /identity/v3/users => generated 301 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:10:15.688239 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbfc94-f2c1-4d82-871a-054ad4b36184 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:15.689771 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-dddbfc94-f2c1-4d82-871a-054ad4b36184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:15.698960 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 940/1865] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:10:15.705135 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35fc72-10ee-4c4c-a029-31338fef0dc3 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:15.718722 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbfc94-f2c1-4d82-871a-054ad4b36184 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:15.719874 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35fc72-10ee-4c4c-a029-31338fef0dc3 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:15.728441 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7d7a4-d578-45da-b3ab-ea26226d4aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:15.729283 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7d7a4-d578-45da-b3ab-ea26226d4aee admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:15.729689 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7d7a4-d578-45da-b3ab-ea26226d4aee admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:15.730120 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7d7a4-d578-45da-b3ab-ea26226d4aee admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:15.731180 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7d7a4-d578-45da-b3ab-ea26226d4aee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:15.736006 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737f438-ca87-45ac-ba1f-2cf8e9378d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:15.737342 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737f438-ca87-45ac-ba1f-2cf8e9378d9c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:15.737342 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737f438-ca87-45ac-ba1f-2cf8e9378d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:15.738009 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737f438-ca87-45ac-ba1f-2cf8e9378d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:15.739022 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737f438-ca87-45ac-ba1f-2cf8e9378d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:15.741398 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737f438-ca87-45ac-ba1f-2cf8e9378d9c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:15.741997 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7d7a4-d578-45da-b3ab-ea26226d4aee admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:15.758307 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 926/1866] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:10:15.764331 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737f438-ca87-45ac-ba1f-2cf8e9378d9c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:15.780780 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737f438-ca87-45ac-ba1f-2cf8e9378d9c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:15.787278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab683cf1-f17b-4095-9b3c-ff212c31beb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:15.788227 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab683cf1-f17b-4095-9b3c-ff212c31beb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:15.788629 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab683cf1-f17b-4095-9b3c-ff212c31beb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:15.789061 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab683cf1-f17b-4095-9b3c-ff212c31beb6 admin admin] PATH_INFO: `/v3/projects/3c94f1f4fc3b4b9097d4071322a6165e/users/1d3b6b795f254804b050e7a2d35d7bbe/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:15.809890 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab683cf1-f17b-4095-9b3c-ff212c31beb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c94f1f4fc3b4b9097d4071322a6165e, user_id=1d3b6b795f254804b050e7a2d35d7bbe, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:15.814298 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab683cf1-f17b-4095-9b3c-ff212c31beb6 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:15.856517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 941/1867] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:15 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:10:15.861811 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7d7a4-d578-45da-b3ab-ea26226d4aee admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:15.931593 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7d7a4-d578-45da-b3ab-ea26226d4aee admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:15.937726 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521ba26-db83-42e0-9c17-9881eb023649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:15.938398 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ba26-db83-42e0-9c17-9881eb023649 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:15.938730 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ba26-db83-42e0-9c17-9881eb023649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:15.939015 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ba26-db83-42e0-9c17-9881eb023649 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:15.941570 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521ba26-db83-42e0-9c17-9881eb023649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:15.941570 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521ba26-db83-42e0-9c17-9881eb023649 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:15.970453 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 927/1868] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:15 2022] PUT /identity/v3/projects/3c94f1f4fc3b4b9097d4071322a6165e/users/1d3b6b795f254804b050e7a2d35d7bbe/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:10:15.974054 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab683cf1-f17b-4095-9b3c-ff212c31beb6 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:16.035587 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 942/1869] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:15 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:16.036870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077146be-61ff-40bc-b93c-71a1e9e9ae8b None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:16.037159 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077146be-61ff-40bc-b93c-71a1e9e9ae8b None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:16.037434 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077146be-61ff-40bc-b93c-71a1e9e9ae8b None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:16.039117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 943/1870] 10.222.0.42 () {54 vars in 921 bytes} [Wed Feb 16 17:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:10:16.039812 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077146be-61ff-40bc-b93c-71a1e9e9ae8b None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:16.065811 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab683cf1-f17b-4095-9b3c-ff212c31beb6 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:16.072361 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3d543-293a-4965-b0ad-dd5f2c576eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:16.073623 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3d543-293a-4965-b0ad-dd5f2c576eff admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:16.074131 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3d543-293a-4965-b0ad-dd5f2c576eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:16.074598 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3d543-293a-4965-b0ad-dd5f2c576eff admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:16.075624 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3d543-293a-4965-b0ad-dd5f2c576eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:16.078381 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3d543-293a-4965-b0ad-dd5f2c576eff admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:16.094215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 928/1871] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:10:16.098036 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3d543-293a-4965-b0ad-dd5f2c576eff admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:16.109522 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3d543-293a-4965-b0ad-dd5f2c576eff admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:16.117923 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e886302-c45e-4dd6-907d-ca549094175c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:16.118976 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e886302-c45e-4dd6-907d-ca549094175c admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:16.119323 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e886302-c45e-4dd6-907d-ca549094175c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:16.119606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e886302-c45e-4dd6-907d-ca549094175c admin admin] PATH_INFO: `/v3/projects/3c94f1f4fc3b4b9097d4071322a6165e/users/1d3b6b795f254804b050e7a2d35d7bbe/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:16.121716 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e886302-c45e-4dd6-907d-ca549094175c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c94f1f4fc3b4b9097d4071322a6165e, user_id=1d3b6b795f254804b050e7a2d35d7bbe, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:16.125286 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e886302-c45e-4dd6-907d-ca549094175c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:16.145027 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 929/1872] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:16 2022] PUT /identity/v3/projects/3c94f1f4fc3b4b9097d4071322a6165e/users/1d3b6b795f254804b050e7a2d35d7bbe/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:16.163832 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077146be-61ff-40bc-b93c-71a1e9e9ae8b None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:16.164307 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b8aad-bd55-4c1b-8023-11f411680397 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:16.164746 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b8aad-bd55-4c1b-8023-11f411680397 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:16.165098 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b8aad-bd55-4c1b-8023-11f411680397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:16.198693 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-2e2b8aad-bd55-4c1b-8023-11f411680397 None None] MFA Rules not processed for user `1d3b6b795f254804b050e7a2d35d7bbe`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:16.199917 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-2e2b8aad-bd55-4c1b-8023-11f411680397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:16.286253 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 930/1873] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:10:16.286415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d6db7-8c58-435b-a21f-f33571e6059d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:16.287175 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6db7-8c58-435b-a21f-f33571e6059d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:16.287518 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6db7-8c58-435b-a21f-f33571e6059d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:16.287861 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6db7-8c58-435b-a21f-f33571e6059d admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:16.288660 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d6db7-8c58-435b-a21f-f33571e6059d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:16.291486 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d6db7-8c58-435b-a21f-f33571e6059d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:16.302698 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85b1bf-5051-46e8-b4a7-ce098a5ccce5 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:16.302988 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85b1bf-5051-46e8-b4a7-ce098a5ccce5 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:16.303268 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85b1bf-5051-46e8-b4a7-ce098a5ccce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:16.305107 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 944/1874] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:16.308950 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d6db7-8c58-435b-a21f-f33571e6059d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:16.320123 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d6db7-8c58-435b-a21f-f33571e6059d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:16.324872 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-1f85b1bf-5051-46e8-b4a7-ce098a5ccce5 None None] MFA Rules not processed for user `9a30603a236e4681a7702eec7029e9db`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:16.325415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d51b2-8ad1-43e9-8490-4d65a4a060c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:16.326218 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d51b2-8ad1-43e9-8490-4d65a4a060c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:16.326487 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-1f85b1bf-5051-46e8-b4a7-ce098a5ccce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:16.326617 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d51b2-8ad1-43e9-8490-4d65a4a060c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:16.326891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d51b2-8ad1-43e9-8490-4d65a4a060c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:16.328120 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d51b2-8ad1-43e9-8490-4d65a4a060c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:16.329769 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d51b2-8ad1-43e9-8490-4d65a4a060c4 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:16.343648 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 945/1875] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:16.348034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d51b2-8ad1-43e9-8490-4d65a4a060c4 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:16.359509 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d51b2-8ad1-43e9-8490-4d65a4a060c4 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:16.364880 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c9a67-1d7d-4115-88c1-1291930b6091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:16.366412 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c9a67-1d7d-4115-88c1-1291930b6091 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:16.366412 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c9a67-1d7d-4115-88c1-1291930b6091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:16.366412 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c9a67-1d7d-4115-88c1-1291930b6091 admin admin] PATH_INFO: `/v3/projects/ad7460bfdae74f73a29f11479521571a/users/1dee4b85fc554f74b33f5ceec3d177e0/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:16.384488 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c9a67-1d7d-4115-88c1-1291930b6091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad7460bfdae74f73a29f11479521571a, user_id=1dee4b85fc554f74b33f5ceec3d177e0, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:16.388180 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c9a67-1d7d-4115-88c1-1291930b6091 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:16.410302 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 931/1876] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Feb 16 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:10:16.429409 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85b1bf-5051-46e8-b4a7-ce098a5ccce5 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:16.431096 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-1f85b1bf-5051-46e8-b4a7-ce098a5ccce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:16.445851 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85b1bf-5051-46e8-b4a7-ce098a5ccce5 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:16.453414 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf7304-9255-40e7-8346-e9ac54c8848f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:16.454302 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf7304-9255-40e7-8346-e9ac54c8848f service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:16.454566 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf7304-9255-40e7-8346-e9ac54c8848f service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:16.459502 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf7304-9255-40e7-8346-e9ac54c8848f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:16.465431 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf7304-9255-40e7-8346-e9ac54c8848f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:16.467764 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf7304-9255-40e7-8346-e9ac54c8848f service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:16.479749 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 932/1877] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:10:16.517710 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 946/1878] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:16 2022] PUT /identity/v3/projects/ad7460bfdae74f73a29f11479521571a/users/1dee4b85fc554f74b33f5ceec3d177e0/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:10:16.530142 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa6f85-afbf-4b98-a539-d74f54540a77 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:16.530508 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa6f85-afbf-4b98-a539-d74f54540a77 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:16.530814 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa6f85-afbf-4b98-a539-d74f54540a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:16.570301 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-c5fa6f85-afbf-4b98-a539-d74f54540a77 None None] MFA Rules not processed for user `1dee4b85fc554f74b33f5ceec3d177e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:16.574314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-c5fa6f85-afbf-4b98-a539-d74f54540a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:16.592726 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c9a67-1d7d-4115-88c1-1291930b6091 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:16.595607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-b72c9a67-1d7d-4115-88c1-1291930b6091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:16.666791 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 933/1879] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:16.672526 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa6f85-afbf-4b98-a539-d74f54540a77 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:16.705096 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c9a67-1d7d-4115-88c1-1291930b6091 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:16.710149 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b5939-ae29-47de-8880-9c865c7cde70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:16.710968 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b5939-ae29-47de-8880-9c865c7cde70 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:16.711431 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b5939-ae29-47de-8880-9c865c7cde70 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:16.711817 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b5939-ae29-47de-8880-9c865c7cde70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:16.786018 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa6f85-afbf-4b98-a539-d74f54540a77 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:16.791068 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe3821-2c12-4c8e-80d7-c8301471cafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:16.791736 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe3821-2c12-4c8e-80d7-c8301471cafa admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:16.792010 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe3821-2c12-4c8e-80d7-c8301471cafa admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:16.792667 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe3821-2c12-4c8e-80d7-c8301471cafa admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:16.793365 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe3821-2c12-4c8e-80d7-c8301471cafa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:16.798201 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe3821-2c12-4c8e-80d7-c8301471cafa admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:16.817970 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b5939-ae29-47de-8880-9c865c7cde70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:16.819447 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b5939-ae29-47de-8880-9c865c7cde70 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:16.829342 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 947/1880] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:16.910545 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 934/1881] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:16 2022] POST /identity/v3/projects => generated 381 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:10:16.916560 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b5939-ae29-47de-8880-9c865c7cde70 service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:16.924913 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe3821-2c12-4c8e-80d7-c8301471cafa admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:16.931374 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b6fe3821-2c12-4c8e-80d7-c8301471cafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:16.935851 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b5939-ae29-47de-8880-9c865c7cde70 service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:17.030942 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe3821-2c12-4c8e-80d7-c8301471cafa admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:17.038201 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51f5d0-ec65-43b7-bf10-4945f4b4694e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:17.039342 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51f5d0-ec65-43b7-bf10-4945f4b4694e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:17.040330 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51f5d0-ec65-43b7-bf10-4945f4b4694e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:17.040772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51f5d0-ec65-43b7-bf10-4945f4b4694e admin admin] PATH_INFO: `/v3/users/feb62185357042e3bb6f830bcf169ddc` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:17.042625 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51f5d0-ec65-43b7-bf10-4945f4b4694e admin admin] RBAC: Authorizing `identity:delete_user(user_id=feb62185357042e3bb6f830bcf169ddc)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:17.046012 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51f5d0-ec65-43b7-bf10-4945f4b4694e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:17.050031 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27f33e-84cc-429c-968e-ce2f84b166e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:17.050387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27f33e-84cc-429c-968e-ce2f84b166e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:17.050687 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27f33e-84cc-429c-968e-ce2f84b166e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:17.050965 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27f33e-84cc-429c-968e-ce2f84b166e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:17.051681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27f33e-84cc-429c-968e-ce2f84b166e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:17.054849 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27f33e-84cc-429c-968e-ce2f84b166e0 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:17.161696 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 948/1882] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:16 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:17.165481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27f33e-84cc-429c-968e-ce2f84b166e0 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:17.177539 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27f33e-84cc-429c-968e-ce2f84b166e0 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:17.183269 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1bcee-c0a8-4af5-bae1-a9ca241e1faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:17.184141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1bcee-c0a8-4af5-bae1-a9ca241e1faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:17.184423 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1bcee-c0a8-4af5-bae1-a9ca241e1faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:17.184696 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1bcee-c0a8-4af5-bae1-a9ca241e1faa admin admin] PATH_INFO: `/v3/users/740e1b6ea6eb48e3b1ca4a31a41dfd36` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:17.187229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1bcee-c0a8-4af5-bae1-a9ca241e1faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=740e1b6ea6eb48e3b1ca4a31a41dfd36)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:17.189208 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1bcee-c0a8-4af5-bae1-a9ca241e1faa admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:17.289763 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6d51f5d0-ec65-43b7-bf10-4945f4b4694e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feb62185357042e3bb6f830bcf169ddc'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:17.290494 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6d51f5d0-ec65-43b7-bf10-4945f4b4694e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feb62185357042e3bb6f830bcf169ddc'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:17.304357 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6d51f5d0-ec65-43b7-bf10-4945f4b4694e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feb62185357042e3bb6f830bcf169ddc'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:17.313259 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6d51f5d0-ec65-43b7-bf10-4945f4b4694e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feb62185357042e3bb6f830bcf169ddc'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:17.445403 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6d51f5d0-ec65-43b7-bf10-4945f4b4694e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feb62185357042e3bb6f830bcf169ddc'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:17.452274 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 935/1883] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:16 2022] DELETE /identity/v3/users/feb62185357042e3bb6f830bcf169ddc => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:17.454819 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51f5d0-ec65-43b7-bf10-4945f4b4694e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:17.454819 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6d51f5d0-ec65-43b7-bf10-4945f4b4694e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:17.503526 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-75e1bcee-c0a8-4af5-bae1-a9ca241e1faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740e1b6ea6eb48e3b1ca4a31a41dfd36'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:17.504206 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-75e1bcee-c0a8-4af5-bae1-a9ca241e1faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740e1b6ea6eb48e3b1ca4a31a41dfd36'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:17.516870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-75e1bcee-c0a8-4af5-bae1-a9ca241e1faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740e1b6ea6eb48e3b1ca4a31a41dfd36'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:17.517679 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51f5d0-ec65-43b7-bf10-4945f4b4694e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:17.522219 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b25a2d-7535-4379-99c0-2895544562df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:17.522908 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b25a2d-7535-4379-99c0-2895544562df admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:17.523193 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b25a2d-7535-4379-99c0-2895544562df admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:17.523458 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b25a2d-7535-4379-99c0-2895544562df admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:17.523738 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-75e1bcee-c0a8-4af5-bae1-a9ca241e1faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740e1b6ea6eb48e3b1ca4a31a41dfd36'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:17.524175 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b25a2d-7535-4379-99c0-2895544562df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:17.524436 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-75e1bcee-c0a8-4af5-bae1-a9ca241e1faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740e1b6ea6eb48e3b1ca4a31a41dfd36'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:17.525746 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b25a2d-7535-4379-99c0-2895544562df admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:17.535892 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 936/1884] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:17.537160 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b71bd-71da-43dd-af65-2e2c7c87dd18 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:17.537440 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b71bd-71da-43dd-af65-2e2c7c87dd18 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:17.537712 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b71bd-71da-43dd-af65-2e2c7c87dd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:17.555373 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-d80b71bd-71da-43dd-af65-2e2c7c87dd18 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:17.556559 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d80b71bd-71da-43dd-af65-2e2c7c87dd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:17.565490 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 937/1885] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:17.566243 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b71bd-71da-43dd-af65-2e2c7c87dd18 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:17.567488 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d80b71bd-71da-43dd-af65-2e2c7c87dd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:17.579112 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b71bd-71da-43dd-af65-2e2c7c87dd18 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:17.583769 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d0357-bb6c-430d-bcf0-8939237af6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:17.584641 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d0357-bb6c-430d-bcf0-8939237af6dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:17.584915 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d0357-bb6c-430d-bcf0-8939237af6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:17.585183 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d0357-bb6c-430d-bcf0-8939237af6dd admin admin] PATH_INFO: `/v3/projects/6c22f90aad714a16ae7f89bc7102c00c/users/1107fe117cea4979bc17c2345edd4842/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:17.600056 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d0357-bb6c-430d-bcf0-8939237af6dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c22f90aad714a16ae7f89bc7102c00c, user_id=1107fe117cea4979bc17c2345edd4842, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:17.603084 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d0357-bb6c-430d-bcf0-8939237af6dd admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:17.691559 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 949/1886] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:17 2022] DELETE /identity/v3/users/740e1b6ea6eb48e3b1ca4a31a41dfd36 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:17.692507 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1bcee-c0a8-4af5-bae1-a9ca241e1faa admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:17.693926 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-75e1bcee-c0a8-4af5-bae1-a9ca241e1faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:17.749326 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1bcee-c0a8-4af5-bae1-a9ca241e1faa admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:17.750101 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 938/1887] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:17 2022] PUT /identity/v3/projects/6c22f90aad714a16ae7f89bc7102c00c/users/1107fe117cea4979bc17c2345edd4842/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:17.751454 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59766baa-fc8a-4bfa-b109-6f2fa75d97c6 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:17.751744 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59766baa-fc8a-4bfa-b109-6f2fa75d97c6 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:17.752029 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59766baa-fc8a-4bfa-b109-6f2fa75d97c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:17.770820 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-59766baa-fc8a-4bfa-b109-6f2fa75d97c6 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:17.772085 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-59766baa-fc8a-4bfa-b109-6f2fa75d97c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:17.802501 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c3c2a-67f3-4651-a161-2bb3ef953927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:17.803190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c3c2a-67f3-4651-a161-2bb3ef953927 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:17.803525 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c3c2a-67f3-4651-a161-2bb3ef953927 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:17.803805 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c3c2a-67f3-4651-a161-2bb3ef953927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:17.844337 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 939/1888] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:17.851364 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59766baa-fc8a-4bfa-b109-6f2fa75d97c6 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:17.863658 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59766baa-fc8a-4bfa-b109-6f2fa75d97c6 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:17.868880 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0fbc6-2e38-4c09-b812-4eb14aff7035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:17.869741 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0fbc6-2e38-4c09-b812-4eb14aff7035 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:17.870020 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0fbc6-2e38-4c09-b812-4eb14aff7035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:17.870294 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0fbc6-2e38-4c09-b812-4eb14aff7035 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:17.871045 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0fbc6-2e38-4c09-b812-4eb14aff7035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:17.873225 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0fbc6-2e38-4c09-b812-4eb14aff7035 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:17.876314 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c3c2a-67f3-4651-a161-2bb3ef953927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:17.877895 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c3c2a-67f3-4651-a161-2bb3ef953927 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:17.890095 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 940/1889] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:17.891383 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0fbc6-2e38-4c09-b812-4eb14aff7035 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:17.897035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 950/1890] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:17.897876 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c3c2a-67f3-4651-a161-2bb3ef953927 service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:17.907772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0fbc6-2e38-4c09-b812-4eb14aff7035 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:17.912920 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c3c2a-67f3-4651-a161-2bb3ef953927 service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:17.917511 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1621670-e2e4-4f12-bd8b-b947b36303aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:17.918307 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621670-e2e4-4f12-bd8b-b947b36303aa service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:17.918798 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621670-e2e4-4f12-bd8b-b947b36303aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:17.919180 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621670-e2e4-4f12-bd8b-b947b36303aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:17.923244 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f03fdf-a889-4c33-9a22-2eab9e1ce1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:17.924273 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f03fdf-a889-4c33-9a22-2eab9e1ce1b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:17.924601 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f03fdf-a889-4c33-9a22-2eab9e1ce1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:17.924873 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f03fdf-a889-4c33-9a22-2eab9e1ce1b8 admin admin] PATH_INFO: `/v3/projects/6c22f90aad714a16ae7f89bc7102c00c/users/1107fe117cea4979bc17c2345edd4842/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:17.927565 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f03fdf-a889-4c33-9a22-2eab9e1ce1b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c22f90aad714a16ae7f89bc7102c00c, user_id=1107fe117cea4979bc17c2345edd4842, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:17.930778 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f03fdf-a889-4c33-9a22-2eab9e1ce1b8 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:17.932986 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1621670-e2e4-4f12-bd8b-b947b36303aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:17.934922 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1621670-e2e4-4f12-bd8b-b947b36303aa service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:17.959506 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 951/1891] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:17 2022] PUT /identity/v3/projects/6c22f90aad714a16ae7f89bc7102c00c/users/1107fe117cea4979bc17c2345edd4842/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:17.959731 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 941/1892] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:17.962625 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba904a72-a334-4a5f-bf48-42d98f6ae8f2 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:17.962958 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba904a72-a334-4a5f-bf48-42d98f6ae8f2 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:17.963210 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba904a72-a334-4a5f-bf48-42d98f6ae8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:17.996384 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-ba904a72-a334-4a5f-bf48-42d98f6ae8f2 None None] MFA Rules not processed for user `1107fe117cea4979bc17c2345edd4842`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:17.997734 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-ba904a72-a334-4a5f-bf48-42d98f6ae8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:18.078994 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 952/1893] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:18.090554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1621670-e2e4-4f12-bd8b-b947b36303aa service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:18.093389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-c1621670-e2e4-4f12-bd8b-b947b36303aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:18.151505 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1621670-e2e4-4f12-bd8b-b947b36303aa service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:18.206396 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba6a55-b907-4184-8a20-d82933f618c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:18.207082 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba6a55-b907-4184-8a20-d82933f618c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:18.207366 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba6a55-b907-4184-8a20-d82933f618c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:18.207666 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba6a55-b907-4184-8a20-d82933f618c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:18.218732 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba6a55-b907-4184-8a20-d82933f618c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:18.224112 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba6a55-b907-4184-8a20-d82933f618c7 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:18.230067 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 942/1894] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:18.613269 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba904a72-a334-4a5f-bf48-42d98f6ae8f2 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:18.616919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-ba904a72-a334-4a5f-bf48-42d98f6ae8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:18.617782 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba6a55-b907-4184-8a20-d82933f618c7 service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:18.619287 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-4fba6a55-b907-4184-8a20-d82933f618c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:18.702750 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba904a72-a334-4a5f-bf48-42d98f6ae8f2 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:18.709546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a6f80-553f-4925-8028-99a757052944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:18.710433 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a6f80-553f-4925-8028-99a757052944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:18.710760 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a6f80-553f-4925-8028-99a757052944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:18.711035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a6f80-553f-4925-8028-99a757052944 admin admin] PATH_INFO: `/v3/projects/db1c83b6f3ae4b75a53c5933f2daffd4` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:18.715849 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a6f80-553f-4925-8028-99a757052944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db1c83b6f3ae4b75a53c5933f2daffd4)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:18.715986 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba6a55-b907-4184-8a20-d82933f618c7 service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:18.716079 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a6f80-553f-4925-8028-99a757052944 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:18.718746 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4d966-377b-4cdd-bf74-2c60c6abf104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:18.719599 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4d966-377b-4cdd-bf74-2c60c6abf104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:18.719878 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4d966-377b-4cdd-bf74-2c60c6abf104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:18.720152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4d966-377b-4cdd-bf74-2c60c6abf104 admin admin] PATH_INFO: `/v3/projects/a2182d0bf14649bfb69555c62178a233` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:18.721333 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4d966-377b-4cdd-bf74-2c60c6abf104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2182d0bf14649bfb69555c62178a233)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:18.723249 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4d966-377b-4cdd-bf74-2c60c6abf104 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:18.823405 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-460a6f80-553f-4925-8028-99a757052944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db1c83b6f3ae4b75a53c5933f2daffd4', 'request_id': 'req-460a6f80-553f-4925-8028-99a757052944'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:18.892365 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-15f4d966-377b-4cdd-bf74-2c60c6abf104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2182d0bf14649bfb69555c62178a233', 'request_id': 'req-15f4d966-377b-4cdd-bf74-2c60c6abf104'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:18.908441 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-460a6f80-553f-4925-8028-99a757052944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db1c83b6f3ae4b75a53c5933f2daffd4', 'request_id': 'req-460a6f80-553f-4925-8028-99a757052944'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:18.915578 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-460a6f80-553f-4925-8028-99a757052944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db1c83b6f3ae4b75a53c5933f2daffd4', 'request_id': 'req-460a6f80-553f-4925-8028-99a757052944'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:18.927458 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-460a6f80-553f-4925-8028-99a757052944 admin admin] The token cache is being invalidate because project db1c83b6f3ae4b75a53c5933f2daffd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:18.927818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-460a6f80-553f-4925-8028-99a757052944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:18.928386 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-460a6f80-553f-4925-8028-99a757052944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:18.931367 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 953/1895] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:18 2022] DELETE /identity/v3/projects/db1c83b6f3ae4b75a53c5933f2daffd4 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:18.933776 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a6f80-553f-4925-8028-99a757052944 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:18.935960 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-460a6f80-553f-4925-8028-99a757052944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:19.002677 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a6f80-553f-4925-8028-99a757052944 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:19.050754 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-15f4d966-377b-4cdd-bf74-2c60c6abf104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2182d0bf14649bfb69555c62178a233', 'request_id': 'req-15f4d966-377b-4cdd-bf74-2c60c6abf104'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:19.057067 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-15f4d966-377b-4cdd-bf74-2c60c6abf104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2182d0bf14649bfb69555c62178a233', 'request_id': 'req-15f4d966-377b-4cdd-bf74-2c60c6abf104'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:19.064513 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd088a-100d-4155-a603-16e15e20e8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:19.065390 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd088a-100d-4155-a603-16e15e20e8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:19.065668 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd088a-100d-4155-a603-16e15e20e8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:19.065940 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd088a-100d-4155-a603-16e15e20e8bf admin admin] PATH_INFO: `/v3/users/1d3b6b795f254804b050e7a2d35d7bbe` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:19.067497 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd088a-100d-4155-a603-16e15e20e8bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d3b6b795f254804b050e7a2d35d7bbe)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:19.069522 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd088a-100d-4155-a603-16e15e20e8bf admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:19.070506 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-15f4d966-377b-4cdd-bf74-2c60c6abf104 admin admin] The token cache is being invalidate because project a2182d0bf14649bfb69555c62178a233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:19.070827 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-15f4d966-377b-4cdd-bf74-2c60c6abf104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:19.071545 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-15f4d966-377b-4cdd-bf74-2c60c6abf104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:19.073121 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 943/1896] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:18 2022] DELETE /identity/v3/projects/a2182d0bf14649bfb69555c62178a233 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:10:19.077044 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4d966-377b-4cdd-bf74-2c60c6abf104 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:19.078611 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-15f4d966-377b-4cdd-bf74-2c60c6abf104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:19.103592 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4d966-377b-4cdd-bf74-2c60c6abf104 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:19.109220 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca9bd4-fbb5-4389-ae31-276ce8a427a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:19.110142 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca9bd4-fbb5-4389-ae31-276ce8a427a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:19.110401 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca9bd4-fbb5-4389-ae31-276ce8a427a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:19.110706 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca9bd4-fbb5-4389-ae31-276ce8a427a1 admin admin] PATH_INFO: `/v3/users/3538d9d58d4644378eb55f3edc4a4ec9` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:19.111923 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca9bd4-fbb5-4389-ae31-276ce8a427a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3538d9d58d4644378eb55f3edc4a4ec9)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:19.113832 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca9bd4-fbb5-4389-ae31-276ce8a427a1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:19.351101 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e8cd088a-100d-4155-a603-16e15e20e8bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d3b6b795f254804b050e7a2d35d7bbe'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:19.351690 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e8cd088a-100d-4155-a603-16e15e20e8bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d3b6b795f254804b050e7a2d35d7bbe'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:19.363883 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e8cd088a-100d-4155-a603-16e15e20e8bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d3b6b795f254804b050e7a2d35d7bbe'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:19.371419 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e8cd088a-100d-4155-a603-16e15e20e8bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d3b6b795f254804b050e7a2d35d7bbe'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:19.371972 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e8cd088a-100d-4155-a603-16e15e20e8bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d3b6b795f254804b050e7a2d35d7bbe'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:19.427565 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-7aca9bd4-fbb5-4389-ae31-276ce8a427a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3538d9d58d4644378eb55f3edc4a4ec9'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:19.428238 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-7aca9bd4-fbb5-4389-ae31-276ce8a427a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3538d9d58d4644378eb55f3edc4a4ec9'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:19.440762 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-7aca9bd4-fbb5-4389-ae31-276ce8a427a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3538d9d58d4644378eb55f3edc4a4ec9'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:19.447629 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-7aca9bd4-fbb5-4389-ae31-276ce8a427a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3538d9d58d4644378eb55f3edc4a4ec9'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:19.624131 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 954/1897] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:18 2022] DELETE /identity/v3/users/1d3b6b795f254804b050e7a2d35d7bbe => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:10:19.650835 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-7aca9bd4-fbb5-4389-ae31-276ce8a427a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3538d9d58d4644378eb55f3edc4a4ec9'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:19.659159 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 944/1898] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:19 2022] DELETE /identity/v3/users/3538d9d58d4644378eb55f3edc4a4ec9 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:10:19.785425 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd088a-100d-4155-a603-16e15e20e8bf admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:19.786956 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e8cd088a-100d-4155-a603-16e15e20e8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:19.927887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd088a-100d-4155-a603-16e15e20e8bf admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:20.047545 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0ab93-2572-4659-a882-d689785bde6c tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1107fe117cea4979bc17c2345edd4842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c22f90aad714a16ae7f89bc7102c00c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:20.048907 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0ab93-2572-4659-a882-d689785bde6c tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:20.049206 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0ab93-2572-4659-a882-d689785bde6c tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:20.049698 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0ab93-2572-4659-a882-d689785bde6c tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:20.050431 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0ab93-2572-4659-a882-d689785bde6c tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:10:20.051308 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0ab93-2572-4659-a882-d689785bde6c tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:20.052382 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0ab93-2572-4659-a882-d689785bde6c tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:20.081972 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 955/1899] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:10:20.083092 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca9bd4-fbb5-4389-ae31-276ce8a427a1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:20.084841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-7aca9bd4-fbb5-4389-ae31-276ce8a427a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:20.104562 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca9bd4-fbb5-4389-ae31-276ce8a427a1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:20.113283 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5454edc-3702-450a-adf2-2bcd920486cd tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1107fe117cea4979bc17c2345edd4842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c22f90aad714a16ae7f89bc7102c00c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:20.113937 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5454edc-3702-450a-adf2-2bcd920486cd tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:20.114266 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5454edc-3702-450a-adf2-2bcd920486cd tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:20.114621 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5454edc-3702-450a-adf2-2bcd920486cd tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:20.115327 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5454edc-3702-450a-adf2-2bcd920486cd tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:20.119585 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5454edc-3702-450a-adf2-2bcd920486cd tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:20.201721 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0ab93-2572-4659-a882-d689785bde6c tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:20.203670 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-4dd0ab93-2572-4659-a882-d689785bde6c tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:20.231518 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 945/1900] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:20 2022] POST /identity/v3/projects => generated 353 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:10:20.234576 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5454edc-3702-450a-adf2-2bcd920486cd tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:20.300785 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0ab93-2572-4659-a882-d689785bde6c tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:20.372684 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63e2bb-8177-4873-bac2-959e57c40ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:20.372684 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63e2bb-8177-4873-bac2-959e57c40ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:20.372684 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63e2bb-8177-4873-bac2-959e57c40ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:20.372684 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63e2bb-8177-4873-bac2-959e57c40ef8 admin admin] PATH_INFO: `/v3/projects/3c94f1f4fc3b4b9097d4071322a6165e` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:20.374281 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63e2bb-8177-4873-bac2-959e57c40ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c94f1f4fc3b4b9097d4071322a6165e)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:20.376454 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63e2bb-8177-4873-bac2-959e57c40ef8 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:20.382481 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5454edc-3702-450a-adf2-2bcd920486cd tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:20.389311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89bad2-c498-462e-855f-fd7096ce989d tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1107fe117cea4979bc17c2345edd4842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c22f90aad714a16ae7f89bc7102c00c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:20.390491 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89bad2-c498-462e-855f-fd7096ce989d tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:20.391004 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89bad2-c498-462e-855f-fd7096ce989d tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:20.391667 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89bad2-c498-462e-855f-fd7096ce989d tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:20.394059 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89bad2-c498-462e-855f-fd7096ce989d tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:10:20.394586 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89bad2-c498-462e-855f-fd7096ce989d tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:20.397316 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89bad2-c498-462e-855f-fd7096ce989d tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:20.414696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 946/1901] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:10:20.415854 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89bad2-c498-462e-855f-fd7096ce989d tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:20.421751 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-cd89bad2-c498-462e-855f-fd7096ce989d tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:20.439956 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89bad2-c498-462e-855f-fd7096ce989d tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:20.446295 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909162d-6d70-4a6b-8749-6f904796a4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:20.447765 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909162d-6d70-4a6b-8749-6f904796a4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:20.448050 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909162d-6d70-4a6b-8749-6f904796a4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:20.448468 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909162d-6d70-4a6b-8749-6f904796a4e1 admin admin] PATH_INFO: `/v3/projects/d5b68069296e44a98ce5c064b67bf47b` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:20.470138 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909162d-6d70-4a6b-8749-6f904796a4e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b68069296e44a98ce5c064b67bf47b)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:20.470138 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909162d-6d70-4a6b-8749-6f904796a4e1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:20.518776 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4c63e2bb-8177-4873-bac2-959e57c40ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c94f1f4fc3b4b9097d4071322a6165e', 'request_id': 'req-4c63e2bb-8177-4873-bac2-959e57c40ef8'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:20.599850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4c63e2bb-8177-4873-bac2-959e57c40ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c94f1f4fc3b4b9097d4071322a6165e', 'request_id': 'req-4c63e2bb-8177-4873-bac2-959e57c40ef8'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:20.606166 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4c63e2bb-8177-4873-bac2-959e57c40ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c94f1f4fc3b4b9097d4071322a6165e', 'request_id': 'req-4c63e2bb-8177-4873-bac2-959e57c40ef8'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:20.629266 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4c63e2bb-8177-4873-bac2-959e57c40ef8 admin admin] The token cache is being invalidate because project 3c94f1f4fc3b4b9097d4071322a6165e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:20.629767 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4c63e2bb-8177-4873-bac2-959e57c40ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:20.630628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4c63e2bb-8177-4873-bac2-959e57c40ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:20.633170 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-1909162d-6d70-4a6b-8749-6f904796a4e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b68069296e44a98ce5c064b67bf47b', 'request_id': 'req-1909162d-6d70-4a6b-8749-6f904796a4e1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:20.633650 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 956/1902] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:20 2022] DELETE /identity/v3/projects/3c94f1f4fc3b4b9097d4071322a6165e => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:10:20.634524 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63e2bb-8177-4873-bac2-959e57c40ef8 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:20.636556 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-4c63e2bb-8177-4873-bac2-959e57c40ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:20.705938 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63e2bb-8177-4873-bac2-959e57c40ef8 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:20.764305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae132f46-c114-4e9e-9049-c0bd24968b7b tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1107fe117cea4979bc17c2345edd4842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c22f90aad714a16ae7f89bc7102c00c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:20.765149 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae132f46-c114-4e9e-9049-c0bd24968b7b tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:20.765432 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae132f46-c114-4e9e-9049-c0bd24968b7b tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:20.765704 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae132f46-c114-4e9e-9049-c0bd24968b7b tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] PATH_INFO: `/v3/projects/dc1452cff0614f96a8d5b474076c38ac` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:20.766903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae132f46-c114-4e9e-9049-c0bd24968b7b tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dc1452cff0614f96a8d5b474076c38ac)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:20.768773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae132f46-c114-4e9e-9049-c0bd24968b7b tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:20.770492 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-1909162d-6d70-4a6b-8749-6f904796a4e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b68069296e44a98ce5c064b67bf47b', 'request_id': 'req-1909162d-6d70-4a6b-8749-6f904796a4e1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:20.776625 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-1909162d-6d70-4a6b-8749-6f904796a4e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b68069296e44a98ce5c064b67bf47b', 'request_id': 'req-1909162d-6d70-4a6b-8749-6f904796a4e1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:20.789091 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-1909162d-6d70-4a6b-8749-6f904796a4e1 admin admin] The token cache is being invalidate because project d5b68069296e44a98ce5c064b67bf47b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:20.789375 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-1909162d-6d70-4a6b-8749-6f904796a4e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:20.790039 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-1909162d-6d70-4a6b-8749-6f904796a4e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:20.791642 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 947/1903] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:20 2022] DELETE /identity/v3/projects/d5b68069296e44a98ce5c064b67bf47b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:20.792952 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b8917-21e5-42c2-8d77-b3f3a63f8457 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:20.793243 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b8917-21e5-42c2-8d77-b3f3a63f8457 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:20.793522 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b8917-21e5-42c2-8d77-b3f3a63f8457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:20.813374 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-e59b8917-21e5-42c2-8d77-b3f3a63f8457 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:20.814571 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e59b8917-21e5-42c2-8d77-b3f3a63f8457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:20.873132 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 948/1904] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:20.879726 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b8917-21e5-42c2-8d77-b3f3a63f8457 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:20.881555 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e59b8917-21e5-42c2-8d77-b3f3a63f8457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:20.884574 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-ae132f46-c114-4e9e-9049-c0bd24968b7b tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc1452cff0614f96a8d5b474076c38ac', 'request_id': 'req-ae132f46-c114-4e9e-9049-c0bd24968b7b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:20.893182 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b8917-21e5-42c2-8d77-b3f3a63f8457 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:20.953411 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366adf22-8f3a-4d98-be68-d8c6d69c90c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:20.954269 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366adf22-8f3a-4d98-be68-d8c6d69c90c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:20.954548 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366adf22-8f3a-4d98-be68-d8c6d69c90c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:20.954864 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366adf22-8f3a-4d98-be68-d8c6d69c90c4 admin admin] PATH_INFO: `/v3/users/94911c381e37454bada7e60ba111c98a` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:20.956053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366adf22-8f3a-4d98-be68-d8c6d69c90c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94911c381e37454bada7e60ba111c98a)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:20.958069 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366adf22-8f3a-4d98-be68-d8c6d69c90c4 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:20.982916 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-ae132f46-c114-4e9e-9049-c0bd24968b7b tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc1452cff0614f96a8d5b474076c38ac', 'request_id': 'req-ae132f46-c114-4e9e-9049-c0bd24968b7b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:20.989011 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-ae132f46-c114-4e9e-9049-c0bd24968b7b tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc1452cff0614f96a8d5b474076c38ac', 'request_id': 'req-ae132f46-c114-4e9e-9049-c0bd24968b7b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:21.000411 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-ae132f46-c114-4e9e-9049-c0bd24968b7b tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] The token cache is being invalidate because project dc1452cff0614f96a8d5b474076c38ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:21.000699 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-ae132f46-c114-4e9e-9049-c0bd24968b7b tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:21.001374 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-ae132f46-c114-4e9e-9049-c0bd24968b7b tempest-VolumeQuotaClassesTest-1173697307 tempest-VolumeQuotaClassesTest-1173697307-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:21.003003 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 957/1905] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:20 2022] DELETE /identity/v3/projects/dc1452cff0614f96a8d5b474076c38ac => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:21.004409 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba58286-c6f1-41ca-a3b0-018bc283ee07 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:21.004692 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba58286-c6f1-41ca-a3b0-018bc283ee07 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:21.005132 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba58286-c6f1-41ca-a3b0-018bc283ee07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:21.023374 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-4ba58286-c6f1-41ca-a3b0-018bc283ee07 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:21.024568 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-4ba58286-c6f1-41ca-a3b0-018bc283ee07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:21.033452 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 958/1906] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:21.037903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba58286-c6f1-41ca-a3b0-018bc283ee07 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:21.048082 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba58286-c6f1-41ca-a3b0-018bc283ee07 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:21.053125 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9de713-09fa-4fd9-9721-88c5fc42d9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:21.053846 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9de713-09fa-4fd9-9721-88c5fc42d9bd admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:21.054322 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9de713-09fa-4fd9-9721-88c5fc42d9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:21.054629 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9de713-09fa-4fd9-9721-88c5fc42d9bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:21.055367 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9de713-09fa-4fd9-9721-88c5fc42d9bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:10:21.055666 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9de713-09fa-4fd9-9721-88c5fc42d9bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:21.057266 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9de713-09fa-4fd9-9721-88c5fc42d9bd admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:21.069235 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 959/1907] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:10:21.073838 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9de713-09fa-4fd9-9721-88c5fc42d9bd admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:21.084054 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9de713-09fa-4fd9-9721-88c5fc42d9bd admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:21.088774 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a801c1-5675-4b79-8652-50bc7d5aea35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:21.089417 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a801c1-5675-4b79-8652-50bc7d5aea35 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:21.089699 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a801c1-5675-4b79-8652-50bc7d5aea35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:21.089972 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a801c1-5675-4b79-8652-50bc7d5aea35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:21.090673 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a801c1-5675-4b79-8652-50bc7d5aea35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:21.094822 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a801c1-5675-4b79-8652-50bc7d5aea35 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:21.163442 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-366adf22-8f3a-4d98-be68-d8c6d69c90c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94911c381e37454bada7e60ba111c98a'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:21.164218 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-366adf22-8f3a-4d98-be68-d8c6d69c90c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94911c381e37454bada7e60ba111c98a'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:21.177415 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-366adf22-8f3a-4d98-be68-d8c6d69c90c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94911c381e37454bada7e60ba111c98a'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:21.185133 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-366adf22-8f3a-4d98-be68-d8c6d69c90c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94911c381e37454bada7e60ba111c98a'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:21.219818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 960/1908] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:21 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:10:21.224499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a801c1-5675-4b79-8652-50bc7d5aea35 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:21.226229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-38a801c1-5675-4b79-8652-50bc7d5aea35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:21.291580 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a801c1-5675-4b79-8652-50bc7d5aea35 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:21.296776 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a4a38-c81a-4c7a-8594-fdf2ff7c6a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:21.297456 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a4a38-c81a-4c7a-8594-fdf2ff7c6a2b admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:21.297812 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a4a38-c81a-4c7a-8594-fdf2ff7c6a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:21.298365 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a4a38-c81a-4c7a-8594-fdf2ff7c6a2b admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:21.298869 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a4a38-c81a-4c7a-8594-fdf2ff7c6a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:21.301117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a4a38-c81a-4c7a-8594-fdf2ff7c6a2b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:21.304156 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-366adf22-8f3a-4d98-be68-d8c6d69c90c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94911c381e37454bada7e60ba111c98a'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:21.313107 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 949/1909] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:20 2022] DELETE /identity/v3/users/94911c381e37454bada7e60ba111c98a => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:21.428823 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 961/1910] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:21 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:10:21.432878 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366adf22-8f3a-4d98-be68-d8c6d69c90c4 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:21.495590 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366adf22-8f3a-4d98-be68-d8c6d69c90c4 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:21.501049 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253eb61-b03b-4f32-a72e-56f38faba0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:21.501708 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253eb61-b03b-4f32-a72e-56f38faba0eb admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:21.501984 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253eb61-b03b-4f32-a72e-56f38faba0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:21.502261 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253eb61-b03b-4f32-a72e-56f38faba0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:21.503019 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253eb61-b03b-4f32-a72e-56f38faba0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:21.504598 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253eb61-b03b-4f32-a72e-56f38faba0eb admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:21.515737 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 950/1911] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:21.519633 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a4a38-c81a-4c7a-8594-fdf2ff7c6a2b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:21.530702 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a4a38-c81a-4c7a-8594-fdf2ff7c6a2b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:21.535560 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97278e50-4b67-4ae9-beea-749f0671c15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:21.536236 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97278e50-4b67-4ae9-beea-749f0671c15a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:21.536522 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97278e50-4b67-4ae9-beea-749f0671c15a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:21.536802 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97278e50-4b67-4ae9-beea-749f0671c15a admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:21.537535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97278e50-4b67-4ae9-beea-749f0671c15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:21.539273 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97278e50-4b67-4ae9-beea-749f0671c15a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:21.562281 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 962/1912] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:21.570964 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253eb61-b03b-4f32-a72e-56f38faba0eb admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:21.590379 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253eb61-b03b-4f32-a72e-56f38faba0eb admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:21.596001 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463bfc6-7a56-4a02-94e1-22fdb3d2d5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:21.596888 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463bfc6-7a56-4a02-94e1-22fdb3d2d5e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:21.597166 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463bfc6-7a56-4a02-94e1-22fdb3d2d5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:21.597829 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463bfc6-7a56-4a02-94e1-22fdb3d2d5e3 admin admin] PATH_INFO: `/v3/projects/f7e8737af392454eac24fdd2549c5469/users/81ebed87f399473dbaa505479a14f09a/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:21.629732 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463bfc6-7a56-4a02-94e1-22fdb3d2d5e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7e8737af392454eac24fdd2549c5469, user_id=81ebed87f399473dbaa505479a14f09a, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:21.643463 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463bfc6-7a56-4a02-94e1-22fdb3d2d5e3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:21.773293 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 951/1913] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:21 2022] PUT /identity/v3/projects/f7e8737af392454eac24fdd2549c5469/users/81ebed87f399473dbaa505479a14f09a/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:21.789265 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abe1d0-0c12-4921-89aa-f3946395eaef None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:21.789487 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abe1d0-0c12-4921-89aa-f3946395eaef None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:21.789777 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abe1d0-0c12-4921-89aa-f3946395eaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:21.820069 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-22abe1d0-0c12-4921-89aa-f3946395eaef None None] MFA Rules not processed for user `81ebed87f399473dbaa505479a14f09a`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:21.821283 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-22abe1d0-0c12-4921-89aa-f3946395eaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:21.869993 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463bfc6-7a56-4a02-94e1-22fdb3d2d5e3 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:21.871696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e463bfc6-7a56-4a02-94e1-22fdb3d2d5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:21.889841 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 963/1914] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:21.894894 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abe1d0-0c12-4921-89aa-f3946395eaef None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:21.965820 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463bfc6-7a56-4a02-94e1-22fdb3d2d5e3 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:21.971791 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab56c74-f8a5-4ef6-bb71-aff50da842d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:21.972833 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab56c74-f8a5-4ef6-bb71-aff50da842d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:21.973201 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab56c74-f8a5-4ef6-bb71-aff50da842d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:21.973538 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab56c74-f8a5-4ef6-bb71-aff50da842d7 admin admin] PATH_INFO: `/v3/projects/df8b70464e684b75a4de689d73e2d75d` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:21.975869 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab56c74-f8a5-4ef6-bb71-aff50da842d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df8b70464e684b75a4de689d73e2d75d)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:21.977377 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab56c74-f8a5-4ef6-bb71-aff50da842d7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:21.982430 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abe1d0-0c12-4921-89aa-f3946395eaef None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:21.987525 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a37da-2021-481a-8d13-fbd01d01b71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:21.988184 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a37da-2021-481a-8d13-fbd01d01b71e admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:21.988463 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a37da-2021-481a-8d13-fbd01d01b71e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:21.988737 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a37da-2021-481a-8d13-fbd01d01b71e admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:21.990141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a37da-2021-481a-8d13-fbd01d01b71e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:21.991668 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a37da-2021-481a-8d13-fbd01d01b71e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:22.153518 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-dab56c74-f8a5-4ef6-bb71-aff50da842d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df8b70464e684b75a4de689d73e2d75d', 'request_id': 'req-dab56c74-f8a5-4ef6-bb71-aff50da842d7'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:22.290952 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-dab56c74-f8a5-4ef6-bb71-aff50da842d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df8b70464e684b75a4de689d73e2d75d', 'request_id': 'req-dab56c74-f8a5-4ef6-bb71-aff50da842d7'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:22.297362 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-dab56c74-f8a5-4ef6-bb71-aff50da842d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df8b70464e684b75a4de689d73e2d75d', 'request_id': 'req-dab56c74-f8a5-4ef6-bb71-aff50da842d7'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:22.301933 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 964/1915] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:21 2022] POST /identity/v3/projects => generated 387 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:22.301933 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a37da-2021-481a-8d13-fbd01d01b71e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:22.301933 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-923a37da-2021-481a-8d13-fbd01d01b71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:22.309617 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-dab56c74-f8a5-4ef6-bb71-aff50da842d7 admin admin] The token cache is being invalidate because project df8b70464e684b75a4de689d73e2d75d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:22.309955 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-dab56c74-f8a5-4ef6-bb71-aff50da842d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:22.310703 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-dab56c74-f8a5-4ef6-bb71-aff50da842d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:22.312311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 952/1916] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:21 2022] DELETE /identity/v3/projects/df8b70464e684b75a4de689d73e2d75d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:10:22.313041 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab56c74-f8a5-4ef6-bb71-aff50da842d7 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:22.314316 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-dab56c74-f8a5-4ef6-bb71-aff50da842d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:22.367781 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a37da-2021-481a-8d13-fbd01d01b71e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:22.373223 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806351c-b318-40f4-a8ff-217aa35480db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:22.374330 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806351c-b318-40f4-a8ff-217aa35480db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:22.374463 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806351c-b318-40f4-a8ff-217aa35480db admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:22.374728 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806351c-b318-40f4-a8ff-217aa35480db admin admin] PATH_INFO: `/v3/users/1dee4b85fc554f74b33f5ceec3d177e0` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:22.376144 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806351c-b318-40f4-a8ff-217aa35480db admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dee4b85fc554f74b33f5ceec3d177e0)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:22.378356 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806351c-b318-40f4-a8ff-217aa35480db admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:22.378468 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab56c74-f8a5-4ef6-bb71-aff50da842d7 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:22.383280 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60233087-fc36-442f-82ae-37eec5cf337c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:22.383945 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60233087-fc36-442f-82ae-37eec5cf337c admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:22.384224 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60233087-fc36-442f-82ae-37eec5cf337c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:22.384495 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60233087-fc36-442f-82ae-37eec5cf337c admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:22.385182 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60233087-fc36-442f-82ae-37eec5cf337c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:22.387141 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60233087-fc36-442f-82ae-37eec5cf337c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:22.531742 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 953/1917] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:22 2022] POST /identity/v3/users => generated 300 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:22.531742 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa3d65-235b-48a0-ba29-59b56eae83c4 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:22.531742 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa3d65-235b-48a0-ba29-59b56eae83c4 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:22.531742 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa3d65-235b-48a0-ba29-59b56eae83c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:22.551653 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-70aa3d65-235b-48a0-ba29-59b56eae83c4 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:22.552892 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-70aa3d65-235b-48a0-ba29-59b56eae83c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:22.561257 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 954/1918] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:22.562019 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa3d65-235b-48a0-ba29-59b56eae83c4 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:22.571131 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa3d65-235b-48a0-ba29-59b56eae83c4 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:22.576133 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbf48f-3364-4e5d-a835-3940d3d50ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:22.576848 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbf48f-3364-4e5d-a835-3940d3d50ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:22.577128 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbf48f-3364-4e5d-a835-3940d3d50ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:22.577402 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbf48f-3364-4e5d-a835-3940d3d50ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:22.578122 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adbf48f-3364-4e5d-a835-3940d3d50ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:22.579802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adbf48f-3364-4e5d-a835-3940d3d50ad7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:22.589981 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 955/1919] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:22.591725 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955f8d3-6546-4176-9b25-775dfdaae84f None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:22.592007 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955f8d3-6546-4176-9b25-775dfdaae84f None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:22.592280 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955f8d3-6546-4176-9b25-775dfdaae84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:22.610177 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-f955f8d3-6546-4176-9b25-775dfdaae84f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:22.611400 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f955f8d3-6546-4176-9b25-775dfdaae84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:22.619534 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 956/1920] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:22.623105 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955f8d3-6546-4176-9b25-775dfdaae84f None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:22.629232 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955f8d3-6546-4176-9b25-775dfdaae84f None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:22.633817 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed13056-56a1-4b80-843f-d8542cf2de77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:22.634677 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed13056-56a1-4b80-843f-d8542cf2de77 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:22.634965 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed13056-56a1-4b80-843f-d8542cf2de77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:22.635238 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed13056-56a1-4b80-843f-d8542cf2de77 admin admin] PATH_INFO: `/v3/projects/0b1633e681ef450893866b2249e48eaf/users/45fd272e2a41402f96d6f596d8bcc233/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:22.649451 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed13056-56a1-4b80-843f-d8542cf2de77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1633e681ef450893866b2249e48eaf, user_id=45fd272e2a41402f96d6f596d8bcc233, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:22.652118 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed13056-56a1-4b80-843f-d8542cf2de77 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:22.700995 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-8806351c-b318-40f4-a8ff-217aa35480db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dee4b85fc554f74b33f5ceec3d177e0'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:22.701743 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-8806351c-b318-40f4-a8ff-217aa35480db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dee4b85fc554f74b33f5ceec3d177e0'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:22.714196 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-8806351c-b318-40f4-a8ff-217aa35480db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dee4b85fc554f74b33f5ceec3d177e0'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:22.722130 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-8806351c-b318-40f4-a8ff-217aa35480db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dee4b85fc554f74b33f5ceec3d177e0'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:22.722942 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-8806351c-b318-40f4-a8ff-217aa35480db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dee4b85fc554f74b33f5ceec3d177e0'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:22.798464 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 957/1921] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:22 2022] PUT /identity/v3/projects/0b1633e681ef450893866b2249e48eaf/users/45fd272e2a41402f96d6f596d8bcc233/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:22.799359 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed13056-56a1-4b80-843f-d8542cf2de77 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:22.802387 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-5ed13056-56a1-4b80-843f-d8542cf2de77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:22.836696 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 965/1922] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:22 2022] DELETE /identity/v3/users/1dee4b85fc554f74b33f5ceec3d177e0 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:22.840430 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806351c-b318-40f4-a8ff-217aa35480db admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:22.840540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8806351c-b318-40f4-a8ff-217aa35480db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:22.877673 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed13056-56a1-4b80-843f-d8542cf2de77 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:22.920627 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806351c-b318-40f4-a8ff-217aa35480db admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:22.926093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011859a-6627-496c-864f-a26bab029bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:22.926811 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011859a-6627-496c-864f-a26bab029bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:22.927273 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011859a-6627-496c-864f-a26bab029bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:22.927549 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011859a-6627-496c-864f-a26bab029bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:22.928335 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011859a-6627-496c-864f-a26bab029bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:22.930143 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011859a-6627-496c-864f-a26bab029bf3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:22.942993 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c3256-841f-443b-ae32-f2478c94ae53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:22.943714 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c3256-841f-443b-ae32-f2478c94ae53 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:22.943945 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c3256-841f-443b-ae32-f2478c94ae53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:22.944228 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c3256-841f-443b-ae32-f2478c94ae53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:22.944770 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 966/1923] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:22.945005 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c3256-841f-443b-ae32-f2478c94ae53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:10:22.945315 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c3256-841f-443b-ae32-f2478c94ae53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:22.946994 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c3256-841f-443b-ae32-f2478c94ae53 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:22.947724 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219d728-f65b-4a49-a33f-e8e7d9203de3 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:22.948257 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219d728-f65b-4a49-a33f-e8e7d9203de3 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:22.948723 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219d728-f65b-4a49-a33f-e8e7d9203de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:22.960624 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 958/1924] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:10:22.961390 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c3256-841f-443b-ae32-f2478c94ae53 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:22.976197 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c3256-841f-443b-ae32-f2478c94ae53 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:22.977474 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-4219d728-f65b-4a49-a33f-e8e7d9203de3 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:22.978840 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-4219d728-f65b-4a49-a33f-e8e7d9203de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:22.982775 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586556b-b14d-4230-b44a-b354467dd9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:22.983812 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586556b-b14d-4230-b44a-b354467dd9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:22.984101 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586556b-b14d-4230-b44a-b354467dd9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:22.984480 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586556b-b14d-4230-b44a-b354467dd9b9 admin admin] PATH_INFO: `/v3/projects/0b1633e681ef450893866b2249e48eaf/users/45fd272e2a41402f96d6f596d8bcc233/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:22.986608 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586556b-b14d-4230-b44a-b354467dd9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1633e681ef450893866b2249e48eaf, user_id=45fd272e2a41402f96d6f596d8bcc233, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:22.988614 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 967/1925] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:22.989305 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586556b-b14d-4230-b44a-b354467dd9b9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:22.990318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219d728-f65b-4a49-a33f-e8e7d9203de3 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:23.003394 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219d728-f65b-4a49-a33f-e8e7d9203de3 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:23.003575 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 959/1926] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:22 2022] PUT /identity/v3/projects/0b1633e681ef450893866b2249e48eaf/users/45fd272e2a41402f96d6f596d8bcc233/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:23.004503 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586556b-b14d-4230-b44a-b354467dd9b9 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:23.014678 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b586556b-b14d-4230-b44a-b354467dd9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:23.091861 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759dc7a-0c59-47ef-8342-b7ff842495e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:23.092640 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759dc7a-0c59-47ef-8342-b7ff842495e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:23.093119 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759dc7a-0c59-47ef-8342-b7ff842495e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:23.093764 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759dc7a-0c59-47ef-8342-b7ff842495e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:23.095063 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759dc7a-0c59-47ef-8342-b7ff842495e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:23.098573 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759dc7a-0c59-47ef-8342-b7ff842495e4 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:23.099509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586556b-b14d-4230-b44a-b354467dd9b9 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:23.107835 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96376fd9-6403-4b6a-8229-6febcdaecebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:23.108500 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96376fd9-6403-4b6a-8229-6febcdaecebf service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:23.108784 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96376fd9-6403-4b6a-8229-6febcdaecebf service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:23.109347 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96376fd9-6403-4b6a-8229-6febcdaecebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:23.119854 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96376fd9-6403-4b6a-8229-6febcdaecebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:23.121299 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96376fd9-6403-4b6a-8229-6febcdaecebf service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:23.131492 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 960/1927] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:23.132862 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc4527-aa32-474f-bedf-be3f343afecf None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:23.133153 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc4527-aa32-474f-bedf-be3f343afecf None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:23.133433 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc4527-aa32-474f-bedf-be3f343afecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:23.163990 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-e6dc4527-aa32-474f-bedf-be3f343afecf None None] MFA Rules not processed for user `45fd272e2a41402f96d6f596d8bcc233`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:23.165345 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e6dc4527-aa32-474f-bedf-be3f343afecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:23.200946 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 968/1928] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:22 2022] POST /identity/v3/projects => generated 381 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:23.205900 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759dc7a-0c59-47ef-8342-b7ff842495e4 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:23.266970 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 961/1929] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:23.284337 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759dc7a-0c59-47ef-8342-b7ff842495e4 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:23.289582 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f451eb-fcbb-44b3-aa84-f66be0ed344a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:23.290453 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f451eb-fcbb-44b3-aa84-f66be0ed344a admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:23.290607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f451eb-fcbb-44b3-aa84-f66be0ed344a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:23.291064 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f451eb-fcbb-44b3-aa84-f66be0ed344a admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:23.291940 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f451eb-fcbb-44b3-aa84-f66be0ed344a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:23.293799 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f451eb-fcbb-44b3-aa84-f66be0ed344a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:23.315651 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc4527-aa32-474f-bedf-be3f343afecf None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:23.317146 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e6dc4527-aa32-474f-bedf-be3f343afecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:23.397974 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc4527-aa32-474f-bedf-be3f343afecf None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:23.446169 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 969/1930] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:23 2022] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:23.447876 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f451eb-fcbb-44b3-aa84-f66be0ed344a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:23.461877 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f451eb-fcbb-44b3-aa84-f66be0ed344a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:23.469975 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538bafd-228a-4f26-a7d8-3fb7df813ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:23.470844 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538bafd-228a-4f26-a7d8-3fb7df813ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:23.471060 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538bafd-228a-4f26-a7d8-3fb7df813ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:23.471331 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538bafd-228a-4f26-a7d8-3fb7df813ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:23.472191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538bafd-228a-4f26-a7d8-3fb7df813ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:23.473341 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1b371-ee8b-42c4-8b12-9c30017e2567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:23.473782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538bafd-228a-4f26-a7d8-3fb7df813ec5 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:23.474184 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1b371-ee8b-42c4-8b12-9c30017e2567 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:23.474574 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1b371-ee8b-42c4-8b12-9c30017e2567 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:23.475002 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1b371-ee8b-42c4-8b12-9c30017e2567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:23.490451 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 970/1931] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:23.492000 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538bafd-228a-4f26-a7d8-3fb7df813ec5 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:23.521512 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538bafd-228a-4f26-a7d8-3fb7df813ec5 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:23.536854 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1184787-7eed-4b5c-8226-de2581200274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:23.538495 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1184787-7eed-4b5c-8226-de2581200274 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:23.538994 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1184787-7eed-4b5c-8226-de2581200274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:23.540605 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1184787-7eed-4b5c-8226-de2581200274 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:23.541589 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1184787-7eed-4b5c-8226-de2581200274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:23.548708 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1184787-7eed-4b5c-8226-de2581200274 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:23.573039 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 971/1932] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:23.578698 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1184787-7eed-4b5c-8226-de2581200274 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:23.598389 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1184787-7eed-4b5c-8226-de2581200274 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:23.602672 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1b371-ee8b-42c4-8b12-9c30017e2567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:23.604521 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1b371-ee8b-42c4-8b12-9c30017e2567 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:23.605451 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5cfd7-8671-44ed-9aa6-ac41892d39ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:23.606428 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5cfd7-8671-44ed-9aa6-ac41892d39ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:23.607439 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5cfd7-8671-44ed-9aa6-ac41892d39ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:23.607848 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5cfd7-8671-44ed-9aa6-ac41892d39ad admin admin] PATH_INFO: `/v3/projects/d2d40afae4124f4cb2a09aceaf75e917/users/c5497c8db2f243e6ab5c89c440575e10/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:23.623682 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 962/1933] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:10:23.635294 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5cfd7-8671-44ed-9aa6-ac41892d39ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d40afae4124f4cb2a09aceaf75e917, user_id=c5497c8db2f243e6ab5c89c440575e10, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:23.640393 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5cfd7-8671-44ed-9aa6-ac41892d39ad admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:23.827601 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 972/1934] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:23 2022] PUT /identity/v3/projects/d2d40afae4124f4cb2a09aceaf75e917/users/c5497c8db2f243e6ab5c89c440575e10/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:23.830038 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc748355-71c4-404f-9861-77f7273b4883 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:23.830514 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc748355-71c4-404f-9861-77f7273b4883 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:23.830601 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc748355-71c4-404f-9861-77f7273b4883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:23.863260 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-fc748355-71c4-404f-9861-77f7273b4883 None None] MFA Rules not processed for user `c5497c8db2f243e6ab5c89c440575e10`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:23.864541 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-fc748355-71c4-404f-9861-77f7273b4883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:23.940775 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 963/1935] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:23.942319 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5cfd7-8671-44ed-9aa6-ac41892d39ad admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:24.036121 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5cfd7-8671-44ed-9aa6-ac41892d39ad admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:24.043088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce918bb-d00c-4d17-a20a-6084770a685b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:24.043961 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce918bb-d00c-4d17-a20a-6084770a685b admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:24.044870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce918bb-d00c-4d17-a20a-6084770a685b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:24.046359 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce918bb-d00c-4d17-a20a-6084770a685b admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:24.046628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce918bb-d00c-4d17-a20a-6084770a685b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:24.048805 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce918bb-d00c-4d17-a20a-6084770a685b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:24.153246 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 973/1936] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:23 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:10:24.158101 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc748355-71c4-404f-9861-77f7273b4883 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:24.175042 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc748355-71c4-404f-9861-77f7273b4883 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:24.242474 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e903cd-6263-476e-ac0f-ef6cf3edc5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:24.243146 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e903cd-6263-476e-ac0f-ef6cf3edc5dd admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:24.243422 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e903cd-6263-476e-ac0f-ef6cf3edc5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:24.243688 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e903cd-6263-476e-ac0f-ef6cf3edc5dd admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:24.244373 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e903cd-6263-476e-ac0f-ef6cf3edc5dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:24.246270 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e903cd-6263-476e-ac0f-ef6cf3edc5dd admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:24.370189 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 964/1937] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:24 2022] POST /identity/v3/users => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:24.371038 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce918bb-d00c-4d17-a20a-6084770a685b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:24.378593 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e903cd-6263-476e-ac0f-ef6cf3edc5dd admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:24.381179 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-15e903cd-6263-476e-ac0f-ef6cf3edc5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:24.382799 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce918bb-d00c-4d17-a20a-6084770a685b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:24.395013 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba589b7a-dfa7-4b7c-8273-9ab03669838d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:24.395845 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba589b7a-dfa7-4b7c-8273-9ab03669838d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:24.396129 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba589b7a-dfa7-4b7c-8273-9ab03669838d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:24.396435 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba589b7a-dfa7-4b7c-8273-9ab03669838d admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:24.397119 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba589b7a-dfa7-4b7c-8273-9ab03669838d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:24.398855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba589b7a-dfa7-4b7c-8273-9ab03669838d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:24.410412 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e903cd-6263-476e-ac0f-ef6cf3edc5dd admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:24.414818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 974/1938] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:24.418806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba589b7a-dfa7-4b7c-8273-9ab03669838d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:24.426576 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edca0a-da83-4eae-9e9a-e78b291966af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:24.427585 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edca0a-da83-4eae-9e9a-e78b291966af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:24.427766 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edca0a-da83-4eae-9e9a-e78b291966af admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:24.428101 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edca0a-da83-4eae-9e9a-e78b291966af admin admin] PATH_INFO: `/v3/projects/ad7460bfdae74f73a29f11479521571a` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:24.429380 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edca0a-da83-4eae-9e9a-e78b291966af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad7460bfdae74f73a29f11479521571a)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:24.431300 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edca0a-da83-4eae-9e9a-e78b291966af admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:24.434368 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba589b7a-dfa7-4b7c-8273-9ab03669838d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:24.447177 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd276bd-03b5-4d3d-b0e2-48620bfc3a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:24.448675 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd276bd-03b5-4d3d-b0e2-48620bfc3a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:24.449085 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd276bd-03b5-4d3d-b0e2-48620bfc3a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:24.449851 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd276bd-03b5-4d3d-b0e2-48620bfc3a5d admin admin] PATH_INFO: `/v3/projects/5a6dedb9f3354ec6b3050dbd0990f6c0/users/46252e6dd32e423a89a044b4cd76c411/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:24.470210 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd276bd-03b5-4d3d-b0e2-48620bfc3a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6dedb9f3354ec6b3050dbd0990f6c0, user_id=46252e6dd32e423a89a044b4cd76c411, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:24.472951 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd276bd-03b5-4d3d-b0e2-48620bfc3a5d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:24.746423 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 975/1939] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:24 2022] PUT /identity/v3/projects/5a6dedb9f3354ec6b3050dbd0990f6c0/users/46252e6dd32e423a89a044b4cd76c411/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:24.752027 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd276bd-03b5-4d3d-b0e2-48620bfc3a5d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:24.768057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f0edca0a-da83-4eae-9e9a-e78b291966af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad7460bfdae74f73a29f11479521571a', 'request_id': 'req-f0edca0a-da83-4eae-9e9a-e78b291966af'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:24.871157 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd276bd-03b5-4d3d-b0e2-48620bfc3a5d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:24.894849 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f0edca0a-da83-4eae-9e9a-e78b291966af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad7460bfdae74f73a29f11479521571a', 'request_id': 'req-f0edca0a-da83-4eae-9e9a-e78b291966af'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:24.905254 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f0edca0a-da83-4eae-9e9a-e78b291966af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad7460bfdae74f73a29f11479521571a', 'request_id': 'req-f0edca0a-da83-4eae-9e9a-e78b291966af'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:24.921357 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f0edca0a-da83-4eae-9e9a-e78b291966af admin admin] The token cache is being invalidate because project ad7460bfdae74f73a29f11479521571a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:24.922067 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f0edca0a-da83-4eae-9e9a-e78b291966af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:24.923113 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f0edca0a-da83-4eae-9e9a-e78b291966af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:24.925474 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 965/1940] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:24 2022] DELETE /identity/v3/projects/ad7460bfdae74f73a29f11479521571a => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:24.930840 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edca0a-da83-4eae-9e9a-e78b291966af admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:24.932512 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f0edca0a-da83-4eae-9e9a-e78b291966af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:24.961701 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd70f6e-7eb1-444a-95a5-9624b63f756c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:24.963456 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd70f6e-7eb1-444a-95a5-9624b63f756c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:24.963891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd70f6e-7eb1-444a-95a5-9624b63f756c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:24.964872 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd70f6e-7eb1-444a-95a5-9624b63f756c admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:24.966786 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd70f6e-7eb1-444a-95a5-9624b63f756c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:24.969181 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd70f6e-7eb1-444a-95a5-9624b63f756c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:24.982713 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 976/1941] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:24.986451 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd70f6e-7eb1-444a-95a5-9624b63f756c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:24.988244 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-fbd70f6e-7eb1-444a-95a5-9624b63f756c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:25.000523 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd70f6e-7eb1-444a-95a5-9624b63f756c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:25.005233 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949b618-a48b-4bde-acbb-65d46a4bc0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:25.006187 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949b618-a48b-4bde-acbb-65d46a4bc0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:25.006489 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949b618-a48b-4bde-acbb-65d46a4bc0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:25.006765 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949b618-a48b-4bde-acbb-65d46a4bc0fe admin admin] PATH_INFO: `/v3/projects/5a6dedb9f3354ec6b3050dbd0990f6c0/users/46252e6dd32e423a89a044b4cd76c411/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:25.014511 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949b618-a48b-4bde-acbb-65d46a4bc0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6dedb9f3354ec6b3050dbd0990f6c0, user_id=46252e6dd32e423a89a044b4cd76c411, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:25.014511 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949b618-a48b-4bde-acbb-65d46a4bc0fe admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:25.014977 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edca0a-da83-4eae-9e9a-e78b291966af admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:25.020075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6d38d-095f-43e4-9673-e09c131f88a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:25.021049 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6d38d-095f-43e4-9673-e09c131f88a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:25.021395 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6d38d-095f-43e4-9673-e09c131f88a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:25.021733 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6d38d-095f-43e4-9673-e09c131f88a6 admin admin] PATH_INFO: `/v3/users/1107fe117cea4979bc17c2345edd4842` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:25.023279 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6d38d-095f-43e4-9673-e09c131f88a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1107fe117cea4979bc17c2345edd4842)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:25.026766 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 977/1942] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:24 2022] PUT /identity/v3/projects/5a6dedb9f3354ec6b3050dbd0990f6c0/users/46252e6dd32e423a89a044b4cd76c411/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:25.026905 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6d38d-095f-43e4-9673-e09c131f88a6 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:25.035548 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b2568-ef76-47d1-a871-979fa3dc6075 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:25.036192 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b2568-ef76-47d1-a871-979fa3dc6075 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:25.037074 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b2568-ef76-47d1-a871-979fa3dc6075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:25.086032 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-e00b2568-ef76-47d1-a871-979fa3dc6075 None None] MFA Rules not processed for user `46252e6dd32e423a89a044b4cd76c411`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:25.090170 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e00b2568-ef76-47d1-a871-979fa3dc6075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:25.171511 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 978/1943] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:25.416205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-27e6d38d-095f-43e4-9673-e09c131f88a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1107fe117cea4979bc17c2345edd4842'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:25.417930 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-27e6d38d-095f-43e4-9673-e09c131f88a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1107fe117cea4979bc17c2345edd4842'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:25.430109 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b2568-ef76-47d1-a871-979fa3dc6075 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:25.434380 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e00b2568-ef76-47d1-a871-979fa3dc6075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:25.455784 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-27e6d38d-095f-43e4-9673-e09c131f88a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1107fe117cea4979bc17c2345edd4842'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:25.470846 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-27e6d38d-095f-43e4-9673-e09c131f88a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1107fe117cea4979bc17c2345edd4842'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:25.511639 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b2568-ef76-47d1-a871-979fa3dc6075 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:25.516868 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d207c-78f6-4cf6-95a5-26369038f963 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:25.517527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d207c-78f6-4cf6-95a5-26369038f963 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:25.517806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d207c-78f6-4cf6-95a5-26369038f963 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:25.518076 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d207c-78f6-4cf6-95a5-26369038f963 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:25.519945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-da8d207c-78f6-4cf6-95a5-26369038f963 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:25.538541 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d207c-78f6-4cf6-95a5-26369038f963 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:25.540077 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d207c-78f6-4cf6-95a5-26369038f963 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:25.551890 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 979/1944] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:10:25.591616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d207c-78f6-4cf6-95a5-26369038f963 service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:25.595976 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-da8d207c-78f6-4cf6-95a5-26369038f963 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:25.596081 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-27e6d38d-095f-43e4-9673-e09c131f88a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1107fe117cea4979bc17c2345edd4842'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:25.602694 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 966/1945] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:24 2022] DELETE /identity/v3/users/1107fe117cea4979bc17c2345edd4842 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:25.723632 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d207c-78f6-4cf6-95a5-26369038f963 service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:25.852986 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119fc54-87f2-4449-88e9-f006d7b18746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:25.854967 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119fc54-87f2-4449-88e9-f006d7b18746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:25.855277 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119fc54-87f2-4449-88e9-f006d7b18746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:25.855559 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119fc54-87f2-4449-88e9-f006d7b18746 admin admin] PATH_INFO: `/v3/users/81ebed87f399473dbaa505479a14f09a` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:25.860082 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119fc54-87f2-4449-88e9-f006d7b18746 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81ebed87f399473dbaa505479a14f09a)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:25.865540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119fc54-87f2-4449-88e9-f006d7b18746 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:26.248061 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6d38d-095f-43e4-9673-e09c131f88a6 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:26.250272 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-27e6d38d-095f-43e4-9673-e09c131f88a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:26.254279 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d119fc54-87f2-4449-88e9-f006d7b18746 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81ebed87f399473dbaa505479a14f09a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:26.256144 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d119fc54-87f2-4449-88e9-f006d7b18746 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81ebed87f399473dbaa505479a14f09a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:26.273108 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d119fc54-87f2-4449-88e9-f006d7b18746 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81ebed87f399473dbaa505479a14f09a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:26.285419 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d119fc54-87f2-4449-88e9-f006d7b18746 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81ebed87f399473dbaa505479a14f09a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:26.286215 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d119fc54-87f2-4449-88e9-f006d7b18746 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81ebed87f399473dbaa505479a14f09a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:26.342465 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6d38d-095f-43e4-9673-e09c131f88a6 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:26.346345 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cdd6a-24d3-4f14-9769-3c4bb8b3fe48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:26.347358 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cdd6a-24d3-4f14-9769-3c4bb8b3fe48 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:26.347822 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cdd6a-24d3-4f14-9769-3c4bb8b3fe48 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:26.348253 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cdd6a-24d3-4f14-9769-3c4bb8b3fe48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:26.350496 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-cf2cdd6a-24d3-4f14-9769-3c4bb8b3fe48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:26.422284 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 980/1946] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:25 2022] DELETE /identity/v3/users/81ebed87f399473dbaa505479a14f09a => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:10:26.423511 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119fc54-87f2-4449-88e9-f006d7b18746 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:26.425301 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d119fc54-87f2-4449-88e9-f006d7b18746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:26.426552 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cdd6a-24d3-4f14-9769-3c4bb8b3fe48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:26.428205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cdd6a-24d3-4f14-9769-3c4bb8b3fe48 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:26.458127 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 967/1947] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:10:26.460942 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545f580-b4f8-4616-bd66-effb3c35e615 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:26.461243 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545f580-b4f8-4616-bd66-effb3c35e615 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:26.461530 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545f580-b4f8-4616-bd66-effb3c35e615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:26.489079 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-8545f580-b4f8-4616-bd66-effb3c35e615 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:26.492349 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-8545f580-b4f8-4616-bd66-effb3c35e615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:26.577658 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119fc54-87f2-4449-88e9-f006d7b18746 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:26.587995 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21701a-306a-4d32-a366-08a595cfbf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:26.588875 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21701a-306a-4d32-a366-08a595cfbf82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:26.589158 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21701a-306a-4d32-a366-08a595cfbf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:26.589436 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21701a-306a-4d32-a366-08a595cfbf82 admin admin] PATH_INFO: `/v3/projects/6c22f90aad714a16ae7f89bc7102c00c` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:26.590759 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21701a-306a-4d32-a366-08a595cfbf82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c22f90aad714a16ae7f89bc7102c00c)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:26.593583 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21701a-306a-4d32-a366-08a595cfbf82 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:26.649988 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 968/1948] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:26.658234 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545f580-b4f8-4616-bd66-effb3c35e615 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:26.659719 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-8545f580-b4f8-4616-bd66-effb3c35e615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:26.735853 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545f580-b4f8-4616-bd66-effb3c35e615 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:26.740455 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3eb41d-5c40-4756-84f8-d5df04d697d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:26.741692 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eb41d-5c40-4756-84f8-d5df04d697d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:26.745738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eb41d-5c40-4756-84f8-d5df04d697d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:26.745738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eb41d-5c40-4756-84f8-d5df04d697d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:26.757157 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3eb41d-5c40-4756-84f8-d5df04d697d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:26.758983 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-7e21701a-306a-4d32-a366-08a595cfbf82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c22f90aad714a16ae7f89bc7102c00c', 'request_id': 'req-7e21701a-306a-4d32-a366-08a595cfbf82'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:26.759259 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3eb41d-5c40-4756-84f8-d5df04d697d2 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:26.775410 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 969/1949] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:26.885477 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-7e21701a-306a-4d32-a366-08a595cfbf82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c22f90aad714a16ae7f89bc7102c00c', 'request_id': 'req-7e21701a-306a-4d32-a366-08a595cfbf82'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:26.893222 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-7e21701a-306a-4d32-a366-08a595cfbf82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c22f90aad714a16ae7f89bc7102c00c', 'request_id': 'req-7e21701a-306a-4d32-a366-08a595cfbf82'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:26.907614 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-7e21701a-306a-4d32-a366-08a595cfbf82 admin admin] The token cache is being invalidate because project 6c22f90aad714a16ae7f89bc7102c00c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:26.908011 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-7e21701a-306a-4d32-a366-08a595cfbf82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:26.908882 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-7e21701a-306a-4d32-a366-08a595cfbf82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:26.910759 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 981/1950] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:26 2022] DELETE /identity/v3/projects/6c22f90aad714a16ae7f89bc7102c00c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:26.915854 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40ebc1-4631-4023-a0a7-4365f4c468da None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:26.916378 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40ebc1-4631-4023-a0a7-4365f4c468da None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:26.916775 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40ebc1-4631-4023-a0a7-4365f4c468da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:26.938049 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-df40ebc1-4631-4023-a0a7-4365f4c468da None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:26.939437 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-df40ebc1-4631-4023-a0a7-4365f4c468da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:27.046720 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 970/1951] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:27.067620 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a8764-955a-4780-a582-4fa9c9565a75 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:27.067914 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a8764-955a-4780-a582-4fa9c9565a75 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:27.068198 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a8764-955a-4780-a582-4fa9c9565a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:27.113433 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-a49a8764-955a-4780-a582-4fa9c9565a75 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:27.121289 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a49a8764-955a-4780-a582-4fa9c9565a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:27.131607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 982/1952] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:27.135671 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40ebc1-4631-4023-a0a7-4365f4c468da None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:27.157249 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40ebc1-4631-4023-a0a7-4365f4c468da None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:27.163061 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f329434-f52a-4855-8928-9e0d0d9d73df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:27.163858 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f329434-f52a-4855-8928-9e0d0d9d73df admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:27.164247 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f329434-f52a-4855-8928-9e0d0d9d73df admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:27.164955 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f329434-f52a-4855-8928-9e0d0d9d73df admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:27.165458 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f329434-f52a-4855-8928-9e0d0d9d73df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:10:27.165886 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f329434-f52a-4855-8928-9e0d0d9d73df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:27.167751 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f329434-f52a-4855-8928-9e0d0d9d73df admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:27.190285 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a8764-955a-4780-a582-4fa9c9565a75 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:27.202752 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 971/1953] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:10:27.204176 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a8764-955a-4780-a582-4fa9c9565a75 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:27.215017 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c966d-c58f-44d5-990e-997b25becc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:27.215805 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c966d-c58f-44d5-990e-997b25becc45 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:27.217580 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c966d-c58f-44d5-990e-997b25becc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:27.218697 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c966d-c58f-44d5-990e-997b25becc45 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:27.220976 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f329434-f52a-4855-8928-9e0d0d9d73df admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:27.223320 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-0f329434-f52a-4855-8928-9e0d0d9d73df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:27.228788 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c966d-c58f-44d5-990e-997b25becc45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:27.239219 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c966d-c58f-44d5-990e-997b25becc45 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:27.255823 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f329434-f52a-4855-8928-9e0d0d9d73df admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:27.270695 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab871b-f97b-43b9-805a-3a6ecb57cef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:27.276314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab871b-f97b-43b9-805a-3a6ecb57cef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:27.277942 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab871b-f97b-43b9-805a-3a6ecb57cef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:27.278308 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab871b-f97b-43b9-805a-3a6ecb57cef7 admin admin] PATH_INFO: `/v3/users/8283ff98dbd84317b5b6f3b403592a55` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:27.282821 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab871b-f97b-43b9-805a-3a6ecb57cef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8283ff98dbd84317b5b6f3b403592a55)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:27.286592 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab871b-f97b-43b9-805a-3a6ecb57cef7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:27.453186 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 983/1954] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:27 2022] POST /identity/v3/projects => generated 377 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:27.457248 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c966d-c58f-44d5-990e-997b25becc45 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:27.569768 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c966d-c58f-44d5-990e-997b25becc45 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:27.582054 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019d7f7-2041-4be3-9525-2bcd0aedec40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:27.582990 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019d7f7-2041-4be3-9525-2bcd0aedec40 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:27.583685 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019d7f7-2041-4be3-9525-2bcd0aedec40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:27.584328 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019d7f7-2041-4be3-9525-2bcd0aedec40 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:27.584975 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019d7f7-2041-4be3-9525-2bcd0aedec40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:27.587648 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019d7f7-2041-4be3-9525-2bcd0aedec40 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:27.664982 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-baab871b-f97b-43b9-805a-3a6ecb57cef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8283ff98dbd84317b5b6f3b403592a55'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:27.667055 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-baab871b-f97b-43b9-805a-3a6ecb57cef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8283ff98dbd84317b5b6f3b403592a55'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:27.689821 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 984/1955] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:27 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:10:27.689821 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019d7f7-2041-4be3-9525-2bcd0aedec40 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:27.690091 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-baab871b-f97b-43b9-805a-3a6ecb57cef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8283ff98dbd84317b5b6f3b403592a55'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:27.692670 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-b019d7f7-2041-4be3-9525-2bcd0aedec40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:27.707613 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-baab871b-f97b-43b9-805a-3a6ecb57cef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8283ff98dbd84317b5b6f3b403592a55'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:27.720062 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019d7f7-2041-4be3-9525-2bcd0aedec40 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:27.741493 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50ff5c-357a-45bf-b33e-e5ddaa9d1c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:27.743046 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50ff5c-357a-45bf-b33e-e5ddaa9d1c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:27.743331 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50ff5c-357a-45bf-b33e-e5ddaa9d1c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:27.743658 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50ff5c-357a-45bf-b33e-e5ddaa9d1c76 admin admin] PATH_INFO: `/v3/projects/f7e8737af392454eac24fdd2549c5469` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:27.746995 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50ff5c-357a-45bf-b33e-e5ddaa9d1c76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7e8737af392454eac24fdd2549c5469)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:27.751901 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50ff5c-357a-45bf-b33e-e5ddaa9d1c76 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:27.855280 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-baab871b-f97b-43b9-805a-3a6ecb57cef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8283ff98dbd84317b5b6f3b403592a55'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:27.868855 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 972/1956] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:27 2022] DELETE /identity/v3/users/8283ff98dbd84317b5b6f3b403592a55 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:10:27.870280 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab871b-f97b-43b9-805a-3a6ecb57cef7 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:27.872053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-baab871b-f97b-43b9-805a-3a6ecb57cef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:27.931469 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1e50ff5c-357a-45bf-b33e-e5ddaa9d1c76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7e8737af392454eac24fdd2549c5469', 'request_id': 'req-1e50ff5c-357a-45bf-b33e-e5ddaa9d1c76'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:27.949148 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab871b-f97b-43b9-805a-3a6ecb57cef7 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:28.008862 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd92a0a-0a40-4907-a38c-be7655765017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:28.009583 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd92a0a-0a40-4907-a38c-be7655765017 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:28.009946 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd92a0a-0a40-4907-a38c-be7655765017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:28.010285 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd92a0a-0a40-4907-a38c-be7655765017 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:28.011115 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd92a0a-0a40-4907-a38c-be7655765017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:28.013345 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd92a0a-0a40-4907-a38c-be7655765017 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:28.027491 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 973/1957] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:28.027491 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4e590-e593-432c-a36d-5da77bae3b3e None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:28.027491 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4e590-e593-432c-a36d-5da77bae3b3e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:28.027491 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4e590-e593-432c-a36d-5da77bae3b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:28.049098 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1e50ff5c-357a-45bf-b33e-e5ddaa9d1c76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7e8737af392454eac24fdd2549c5469', 'request_id': 'req-1e50ff5c-357a-45bf-b33e-e5ddaa9d1c76'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:28.057239 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-75f4e590-e593-432c-a36d-5da77bae3b3e None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:28.057239 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-75f4e590-e593-432c-a36d-5da77bae3b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:28.057841 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1e50ff5c-357a-45bf-b33e-e5ddaa9d1c76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7e8737af392454eac24fdd2549c5469', 'request_id': 'req-1e50ff5c-357a-45bf-b33e-e5ddaa9d1c76'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:28.063572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 974/1958] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:28.064845 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4e590-e593-432c-a36d-5da77bae3b3e None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:28.074231 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1e50ff5c-357a-45bf-b33e-e5ddaa9d1c76 admin admin] The token cache is being invalidate because project f7e8737af392454eac24fdd2549c5469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:28.074518 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1e50ff5c-357a-45bf-b33e-e5ddaa9d1c76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:28.075865 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1e50ff5c-357a-45bf-b33e-e5ddaa9d1c76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:28.077910 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4e590-e593-432c-a36d-5da77bae3b3e None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:28.078392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 985/1959] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:27 2022] DELETE /identity/v3/projects/f7e8737af392454eac24fdd2549c5469 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:28.079346 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50ff5c-357a-45bf-b33e-e5ddaa9d1c76 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:28.080718 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-1e50ff5c-357a-45bf-b33e-e5ddaa9d1c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:28.088425 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f6e0f-2563-4c07-90e8-4820c81bd2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:28.089450 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f6e0f-2563-4c07-90e8-4820c81bd2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:28.089789 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f6e0f-2563-4c07-90e8-4820c81bd2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:28.090138 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f6e0f-2563-4c07-90e8-4820c81bd2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:28.092291 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f6e0f-2563-4c07-90e8-4820c81bd2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:28.098035 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f6e0f-2563-4c07-90e8-4820c81bd2a4 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:28.108783 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 975/1960] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:28.108783 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f6e0f-2563-4c07-90e8-4820c81bd2a4 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:28.111402 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-5f9f6e0f-2563-4c07-90e8-4820c81bd2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:28.126160 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f6e0f-2563-4c07-90e8-4820c81bd2a4 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:28.132860 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23bba0-e29b-45ae-9bfe-391c5612919f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:28.133486 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23bba0-e29b-45ae-9bfe-391c5612919f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:28.133909 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23bba0-e29b-45ae-9bfe-391c5612919f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:28.134420 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23bba0-e29b-45ae-9bfe-391c5612919f admin admin] PATH_INFO: `/v3/users/45fd272e2a41402f96d6f596d8bcc233` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:28.145690 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23bba0-e29b-45ae-9bfe-391c5612919f admin admin] RBAC: Authorizing `identity:delete_user(user_id=45fd272e2a41402f96d6f596d8bcc233)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:28.145690 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23bba0-e29b-45ae-9bfe-391c5612919f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:28.158101 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50ff5c-357a-45bf-b33e-e5ddaa9d1c76 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:28.162114 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b47fa-1372-4306-b616-ec90832c60de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:28.162826 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b47fa-1372-4306-b616-ec90832c60de service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:28.163445 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b47fa-1372-4306-b616-ec90832c60de service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:28.163554 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b47fa-1372-4306-b616-ec90832c60de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:28.165641 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-043b47fa-1372-4306-b616-ec90832c60de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:28.181050 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b47fa-1372-4306-b616-ec90832c60de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:28.182554 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b47fa-1372-4306-b616-ec90832c60de service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:28.194969 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 986/1961] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:28.196216 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b47fa-1372-4306-b616-ec90832c60de service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:28.198390 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-043b47fa-1372-4306-b616-ec90832c60de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:28.216977 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b47fa-1372-4306-b616-ec90832c60de service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:28.222956 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75b151-d12f-4f99-9050-372e250061d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:28.223943 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75b151-d12f-4f99-9050-372e250061d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:28.224230 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75b151-d12f-4f99-9050-372e250061d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:28.224505 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75b151-d12f-4f99-9050-372e250061d4 admin admin] PATH_INFO: `/v3/projects/676f9103593c45b4a31daa80ff164f6a/users/5f6a8844a7724b0485f0b8d38946ef71/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:28.241643 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75b151-d12f-4f99-9050-372e250061d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676f9103593c45b4a31daa80ff164f6a, user_id=5f6a8844a7724b0485f0b8d38946ef71, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:28.244382 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75b151-d12f-4f99-9050-372e250061d4 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:28.395616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 987/1962] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:28 2022] PUT /identity/v3/projects/676f9103593c45b4a31daa80ff164f6a/users/5f6a8844a7724b0485f0b8d38946ef71/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:28.406485 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bf199-cb38-4acd-9261-49aa5644af2c None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:28.406855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bf199-cb38-4acd-9261-49aa5644af2c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:28.407139 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bf199-cb38-4acd-9261-49aa5644af2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:28.438199 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-077bf199-cb38-4acd-9261-49aa5644af2c None None] MFA Rules not processed for user `5f6a8844a7724b0485f0b8d38946ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:28.439578 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-077bf199-cb38-4acd-9261-49aa5644af2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:28.470151 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-dd23bba0-e29b-45ae-9bfe-391c5612919f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45fd272e2a41402f96d6f596d8bcc233'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:28.471134 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-dd23bba0-e29b-45ae-9bfe-391c5612919f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45fd272e2a41402f96d6f596d8bcc233'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:28.487977 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-dd23bba0-e29b-45ae-9bfe-391c5612919f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45fd272e2a41402f96d6f596d8bcc233'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:28.499369 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-dd23bba0-e29b-45ae-9bfe-391c5612919f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45fd272e2a41402f96d6f596d8bcc233'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:28.567918 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 988/1963] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:10:28.572644 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-dd23bba0-e29b-45ae-9bfe-391c5612919f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45fd272e2a41402f96d6f596d8bcc233'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:28.579227 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bf199-cb38-4acd-9261-49aa5644af2c None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:28.581282 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 976/1964] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:28 2022] DELETE /identity/v3/users/45fd272e2a41402f96d6f596d8bcc233 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:28.582350 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-077bf199-cb38-4acd-9261-49aa5644af2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:28.663540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bf199-cb38-4acd-9261-49aa5644af2c None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:28.723935 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6eb81-685f-4e2a-a085-f57232eb21a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:28.724628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6eb81-685f-4e2a-a085-f57232eb21a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:28.724905 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6eb81-685f-4e2a-a085-f57232eb21a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:28.725174 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6eb81-685f-4e2a-a085-f57232eb21a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:28.725860 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6eb81-685f-4e2a-a085-f57232eb21a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:28.727764 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6eb81-685f-4e2a-a085-f57232eb21a7 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:28.843391 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23bba0-e29b-45ae-9bfe-391c5612919f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:28.845057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-dd23bba0-e29b-45ae-9bfe-391c5612919f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:28.847437 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 989/1965] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:28 2022] POST /identity/v3/projects => generated 377 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:28.851188 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6eb81-685f-4e2a-a085-f57232eb21a7 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:28.894096 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23bba0-e29b-45ae-9bfe-391c5612919f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:28.954082 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6eb81-685f-4e2a-a085-f57232eb21a7 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:28.962191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad210b-90f9-4d36-9f0d-9d8a3eaddc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:28.962747 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad210b-90f9-4d36-9f0d-9d8a3eaddc2c admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:28.963033 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad210b-90f9-4d36-9f0d-9d8a3eaddc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:28.963667 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad210b-90f9-4d36-9f0d-9d8a3eaddc2c admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:28.964339 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad210b-90f9-4d36-9f0d-9d8a3eaddc2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:28.966981 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad210b-90f9-4d36-9f0d-9d8a3eaddc2c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:28.981820 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf241a-6dc4-432f-9f83-c324ca931e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:28.982985 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf241a-6dc4-432f-9f83-c324ca931e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:28.983263 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf241a-6dc4-432f-9f83-c324ca931e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:28.983536 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf241a-6dc4-432f-9f83-c324ca931e92 admin admin] PATH_INFO: `/v3/projects/d85b6bf169b047c9b0a35bedc960f369` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:28.984765 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf241a-6dc4-432f-9f83-c324ca931e92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85b6bf169b047c9b0a35bedc960f369)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:28.986628 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf241a-6dc4-432f-9f83-c324ca931e92 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:29.066170 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 990/1966] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:28 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:29.067483 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad210b-90f9-4d36-9f0d-9d8a3eaddc2c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:29.078442 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad210b-90f9-4d36-9f0d-9d8a3eaddc2c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:29.083451 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b39be-1192-49d4-ae2c-aad3a0fc1f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:29.084189 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b39be-1192-49d4-ae2c-aad3a0fc1f9f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:29.084476 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b39be-1192-49d4-ae2c-aad3a0fc1f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:29.084756 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b39be-1192-49d4-ae2c-aad3a0fc1f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:29.085475 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b39be-1192-49d4-ae2c-aad3a0fc1f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:29.087103 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b39be-1192-49d4-ae2c-aad3a0fc1f9f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:29.097506 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 991/1967] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:29.101403 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b39be-1192-49d4-ae2c-aad3a0fc1f9f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:29.112027 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b39be-1192-49d4-ae2c-aad3a0fc1f9f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:29.126005 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-60bf241a-6dc4-432f-9f83-c324ca931e92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85b6bf169b047c9b0a35bedc960f369', 'request_id': 'req-60bf241a-6dc4-432f-9f83-c324ca931e92'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:29.172919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a222e6-07c0-4598-84e0-47b39d540595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:29.176072 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a222e6-07c0-4598-84e0-47b39d540595 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:29.176072 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a222e6-07c0-4598-84e0-47b39d540595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:29.176072 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a222e6-07c0-4598-84e0-47b39d540595 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:29.176072 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a222e6-07c0-4598-84e0-47b39d540595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:29.176578 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a222e6-07c0-4598-84e0-47b39d540595 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:29.186773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 992/1968] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:10:29.187653 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a222e6-07c0-4598-84e0-47b39d540595 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:29.189369 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-97a222e6-07c0-4598-84e0-47b39d540595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:29.201660 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a222e6-07c0-4598-84e0-47b39d540595 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:29.206424 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc7540-d26b-44f1-9339-c8b49cce5347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:29.207293 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc7540-d26b-44f1-9339-c8b49cce5347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:29.207648 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc7540-d26b-44f1-9339-c8b49cce5347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:29.207960 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc7540-d26b-44f1-9339-c8b49cce5347 admin admin] PATH_INFO: `/v3/projects/0b1633e681ef450893866b2249e48eaf` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:29.209138 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc7540-d26b-44f1-9339-c8b49cce5347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1633e681ef450893866b2249e48eaf)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:29.211103 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc7540-d26b-44f1-9339-c8b49cce5347 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:29.239305 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-60bf241a-6dc4-432f-9f83-c324ca931e92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85b6bf169b047c9b0a35bedc960f369', 'request_id': 'req-60bf241a-6dc4-432f-9f83-c324ca931e92'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:29.245641 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-60bf241a-6dc4-432f-9f83-c324ca931e92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85b6bf169b047c9b0a35bedc960f369', 'request_id': 'req-60bf241a-6dc4-432f-9f83-c324ca931e92'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:29.256404 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-60bf241a-6dc4-432f-9f83-c324ca931e92 admin admin] The token cache is being invalidate because project d85b6bf169b047c9b0a35bedc960f369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:29.256684 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-60bf241a-6dc4-432f-9f83-c324ca931e92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:29.257307 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-60bf241a-6dc4-432f-9f83-c324ca931e92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:29.258886 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 977/1969] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:28 2022] DELETE /identity/v3/projects/d85b6bf169b047c9b0a35bedc960f369 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:29.259682 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf241a-6dc4-432f-9f83-c324ca931e92 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:29.260878 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-60bf241a-6dc4-432f-9f83-c324ca931e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:29.272915 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf241a-6dc4-432f-9f83-c324ca931e92 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:29.277437 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec91e78-e0d8-4fb7-891d-5ea18fdf16fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:29.278303 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec91e78-e0d8-4fb7-891d-5ea18fdf16fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:29.279121 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec91e78-e0d8-4fb7-891d-5ea18fdf16fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:29.279426 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec91e78-e0d8-4fb7-891d-5ea18fdf16fb admin admin] PATH_INFO: `/v3/projects/15c6d32ccb814011923fef954f65fbb4/users/f367a246e5364af4a691822cfb6ee74a/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:29.294628 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec91e78-e0d8-4fb7-891d-5ea18fdf16fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c6d32ccb814011923fef954f65fbb4, user_id=f367a246e5364af4a691822cfb6ee74a, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:29.297489 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec91e78-e0d8-4fb7-891d-5ea18fdf16fb admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:29.411604 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 978/1970] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:29 2022] PUT /identity/v3/projects/15c6d32ccb814011923fef954f65fbb4/users/f367a246e5364af4a691822cfb6ee74a/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:29.412462 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec91e78-e0d8-4fb7-891d-5ea18fdf16fb admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:29.417971 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-7ec91e78-e0d8-4fb7-891d-5ea18fdf16fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:29.428475 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-62cc7540-d26b-44f1-9339-c8b49cce5347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1633e681ef450893866b2249e48eaf', 'request_id': 'req-62cc7540-d26b-44f1-9339-c8b49cce5347'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:29.486158 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec91e78-e0d8-4fb7-891d-5ea18fdf16fb admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:29.542775 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0d873-619e-4854-a445-468cb0a6cb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:29.543691 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0d873-619e-4854-a445-468cb0a6cb1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:29.544040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0d873-619e-4854-a445-468cb0a6cb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:29.544512 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0d873-619e-4854-a445-468cb0a6cb1d admin admin] PATH_INFO: `/v3/users/80c7e655d76b46cfadf87dd534165982` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:29.545728 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0d873-619e-4854-a445-468cb0a6cb1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=80c7e655d76b46cfadf87dd534165982)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:29.547761 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0d873-619e-4854-a445-468cb0a6cb1d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:29.571150 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-62cc7540-d26b-44f1-9339-c8b49cce5347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1633e681ef450893866b2249e48eaf', 'request_id': 'req-62cc7540-d26b-44f1-9339-c8b49cce5347'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:29.571150 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-62cc7540-d26b-44f1-9339-c8b49cce5347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1633e681ef450893866b2249e48eaf', 'request_id': 'req-62cc7540-d26b-44f1-9339-c8b49cce5347'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:29.584979 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-62cc7540-d26b-44f1-9339-c8b49cce5347 admin admin] The token cache is being invalidate because project 0b1633e681ef450893866b2249e48eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:29.585397 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-62cc7540-d26b-44f1-9339-c8b49cce5347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:29.586117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-62cc7540-d26b-44f1-9339-c8b49cce5347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:29.587731 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 993/1971] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:29 2022] DELETE /identity/v3/projects/0b1633e681ef450893866b2249e48eaf => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:29.589043 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31151f78-6235-4962-bc18-fbd202eadf95 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:29.589332 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31151f78-6235-4962-bc18-fbd202eadf95 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:29.589651 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31151f78-6235-4962-bc18-fbd202eadf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:29.616554 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-31151f78-6235-4962-bc18-fbd202eadf95 None None] MFA Rules not processed for user `f367a246e5364af4a691822cfb6ee74a`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:29.617788 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-31151f78-6235-4962-bc18-fbd202eadf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:29.682269 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 994/1972] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:29.683518 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbeaca-7954-45ae-a0d5-561f719aae0e None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:29.683807 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbeaca-7954-45ae-a0d5-561f719aae0e None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:29.684079 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbeaca-7954-45ae-a0d5-561f719aae0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:29.704035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-dedbeaca-7954-45ae-a0d5-561f719aae0e None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:29.705230 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-dedbeaca-7954-45ae-a0d5-561f719aae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:29.713262 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 995/1973] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:29.713991 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbeaca-7954-45ae-a0d5-561f719aae0e None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:29.715201 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-dedbeaca-7954-45ae-a0d5-561f719aae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:29.727814 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbeaca-7954-45ae-a0d5-561f719aae0e None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:29.732795 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02d7ba-8b82-48eb-8277-649fda58f6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:29.733435 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02d7ba-8b82-48eb-8277-649fda58f6fc admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:29.733717 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02d7ba-8b82-48eb-8277-649fda58f6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:29.733990 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02d7ba-8b82-48eb-8277-649fda58f6fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:29.734759 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02d7ba-8b82-48eb-8277-649fda58f6fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:29.738934 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02d7ba-8b82-48eb-8277-649fda58f6fc admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:29.858018 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 996/1974] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:29 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:29.859489 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74377c65-7883-4a8a-afb1-10007ef4ed03 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:29.859771 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74377c65-7883-4a8a-afb1-10007ef4ed03 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:29.860047 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74377c65-7883-4a8a-afb1-10007ef4ed03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:29.878338 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-74377c65-7883-4a8a-afb1-10007ef4ed03 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:29.879543 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-74377c65-7883-4a8a-afb1-10007ef4ed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:29.902917 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b4b0d873-619e-4854-a445-468cb0a6cb1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80c7e655d76b46cfadf87dd534165982'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:29.903648 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b4b0d873-619e-4854-a445-468cb0a6cb1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80c7e655d76b46cfadf87dd534165982'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:29.915371 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b4b0d873-619e-4854-a445-468cb0a6cb1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80c7e655d76b46cfadf87dd534165982'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:29.922176 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b4b0d873-619e-4854-a445-468cb0a6cb1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80c7e655d76b46cfadf87dd534165982'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:29.936322 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 997/1975] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:29.937139 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74377c65-7883-4a8a-afb1-10007ef4ed03 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:29.938396 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-74377c65-7883-4a8a-afb1-10007ef4ed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:29.949762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74377c65-7883-4a8a-afb1-10007ef4ed03 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:29.955455 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ba4bf-fe18-46af-93be-a0b006561b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:29.956097 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ba4bf-fe18-46af-93be-a0b006561b6b admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:29.962782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ba4bf-fe18-46af-93be-a0b006561b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:29.962782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ba4bf-fe18-46af-93be-a0b006561b6b admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:29.962782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ba4bf-fe18-46af-93be-a0b006561b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:29.962782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ba4bf-fe18-46af-93be-a0b006561b6b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:30.015229 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b4b0d873-619e-4854-a445-468cb0a6cb1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80c7e655d76b46cfadf87dd534165982'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:30.021585 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 979/1976] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:29 2022] DELETE /identity/v3/users/80c7e655d76b46cfadf87dd534165982 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:30.024546 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0d873-619e-4854-a445-468cb0a6cb1d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:30.073942 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 998/1977] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:29 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:30.078104 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ba4bf-fe18-46af-93be-a0b006561b6b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:30.088273 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ba4bf-fe18-46af-93be-a0b006561b6b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:30.100590 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0d873-619e-4854-a445-468cb0a6cb1d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:30.105758 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53057b-d264-4d08-9efd-63a67abef2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:30.106461 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53057b-d264-4d08-9efd-63a67abef2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:30.106971 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53057b-d264-4d08-9efd-63a67abef2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:30.107455 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53057b-d264-4d08-9efd-63a67abef2d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:30.108241 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53057b-d264-4d08-9efd-63a67abef2d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:10:30.108555 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53057b-d264-4d08-9efd-63a67abef2d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:30.110162 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53057b-d264-4d08-9efd-63a67abef2d2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:30.128977 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 980/1978] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:10:30.133500 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53057b-d264-4d08-9efd-63a67abef2d2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:30.143954 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53057b-d264-4d08-9efd-63a67abef2d2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:30.148039 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b5c38-3856-4d72-8db0-51c939c14b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:30.148588 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f1df3-702a-41e9-bdc3-1498786400a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:30.148702 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b5c38-3856-4d72-8db0-51c939c14b95 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:30.148971 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b5c38-3856-4d72-8db0-51c939c14b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:30.149475 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f1df3-702a-41e9-bdc3-1498786400a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:30.149762 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f1df3-702a-41e9-bdc3-1498786400a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:30.149862 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b5c38-3856-4d72-8db0-51c939c14b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:30.150039 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f1df3-702a-41e9-bdc3-1498786400a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:30.150590 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b5c38-3856-4d72-8db0-51c939c14b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:30.150936 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f1df3-702a-41e9-bdc3-1498786400a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:30.152149 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b5c38-3856-4d72-8db0-51c939c14b95 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:30.152800 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f1df3-702a-41e9-bdc3-1498786400a8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:30.163442 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 999/1979] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:30.168125 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b5c38-3856-4d72-8db0-51c939c14b95 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:30.180932 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b5c38-3856-4d72-8db0-51c939c14b95 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:30.188304 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d83907-de40-4c09-be35-741c6635c65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:30.189269 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d83907-de40-4c09-be35-741c6635c65d admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:30.189551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d83907-de40-4c09-be35-741c6635c65d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:30.189831 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d83907-de40-4c09-be35-741c6635c65d admin admin] PATH_INFO: `/v3/projects/a755006aa0634fd4a3591c454a1f2b4f/users/dfa65fba039049beb91137127a998566/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:30.208421 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d83907-de40-4c09-be35-741c6635c65d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a755006aa0634fd4a3591c454a1f2b4f, user_id=dfa65fba039049beb91137127a998566, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:30.211092 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d83907-de40-4c09-be35-741c6635c65d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:30.287332 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 981/1980] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:30 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:10:30.288258 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f1df3-702a-41e9-bdc3-1498786400a8 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:30.290218 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-709f1df3-702a-41e9-bdc3-1498786400a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:30.350060 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1000/1981] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:30 2022] PUT /identity/v3/projects/a755006aa0634fd4a3591c454a1f2b4f/users/dfa65fba039049beb91137127a998566/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:30.350060 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d83907-de40-4c09-be35-741c6635c65d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:30.355362 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f1df3-702a-41e9-bdc3-1498786400a8 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:30.414758 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5355c-0a08-4ed0-9a3d-9759be49f540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:30.415757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5355c-0a08-4ed0-9a3d-9759be49f540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:30.416126 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5355c-0a08-4ed0-9a3d-9759be49f540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:30.416944 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5355c-0a08-4ed0-9a3d-9759be49f540 admin admin] PATH_INFO: `/v3/users/c5497c8db2f243e6ab5c89c440575e10` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:30.418226 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5355c-0a08-4ed0-9a3d-9759be49f540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5497c8db2f243e6ab5c89c440575e10)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:30.421088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d83907-de40-4c09-be35-741c6635c65d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:30.424217 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5355c-0a08-4ed0-9a3d-9759be49f540 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:30.425868 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2989a-d062-49e4-8741-230778629676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:30.426528 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2989a-d062-49e4-8741-230778629676 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:30.426849 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2989a-d062-49e4-8741-230778629676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:30.427118 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2989a-d062-49e4-8741-230778629676 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:30.427803 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2989a-d062-49e4-8741-230778629676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:30.429687 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2989a-d062-49e4-8741-230778629676 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:30.549297 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1001/1982] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:30 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:30.550019 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2989a-d062-49e4-8741-230778629676 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:30.561452 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2989a-d062-49e4-8741-230778629676 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:30.566303 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf1bd1-7641-4677-9d5f-948b7954a33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:30.567018 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf1bd1-7641-4677-9d5f-948b7954a33f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:30.567295 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf1bd1-7641-4677-9d5f-948b7954a33f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:30.567570 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf1bd1-7641-4677-9d5f-948b7954a33f admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:30.568277 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf1bd1-7641-4677-9d5f-948b7954a33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:30.569841 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf1bd1-7641-4677-9d5f-948b7954a33f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:30.581926 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1002/1983] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:30.582925 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf1bd1-7641-4677-9d5f-948b7954a33f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:30.584621 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-bfcf1bd1-7641-4677-9d5f-948b7954a33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:30.598099 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf1bd1-7641-4677-9d5f-948b7954a33f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:30.602837 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d15161-22c9-4d78-9a04-4ab9e28f9d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:30.603685 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d15161-22c9-4d78-9a04-4ab9e28f9d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:30.603969 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d15161-22c9-4d78-9a04-4ab9e28f9d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:30.604242 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d15161-22c9-4d78-9a04-4ab9e28f9d36 admin admin] PATH_INFO: `/v3/projects/eca4dc271b1f441f97e8f863348f3ad9` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:30.605449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d15161-22c9-4d78-9a04-4ab9e28f9d36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eca4dc271b1f441f97e8f863348f3ad9)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:30.608491 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d15161-22c9-4d78-9a04-4ab9e28f9d36 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:30.720849 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6db5355c-0a08-4ed0-9a3d-9759be49f540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5497c8db2f243e6ab5c89c440575e10'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:30.721506 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6db5355c-0a08-4ed0-9a3d-9759be49f540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5497c8db2f243e6ab5c89c440575e10'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:30.734514 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6db5355c-0a08-4ed0-9a3d-9759be49f540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5497c8db2f243e6ab5c89c440575e10'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:30.736880 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f8d15161-22c9-4d78-9a04-4ab9e28f9d36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eca4dc271b1f441f97e8f863348f3ad9', 'request_id': 'req-f8d15161-22c9-4d78-9a04-4ab9e28f9d36'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:30.741658 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6db5355c-0a08-4ed0-9a3d-9759be49f540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5497c8db2f243e6ab5c89c440575e10'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:30.826334 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f8d15161-22c9-4d78-9a04-4ab9e28f9d36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eca4dc271b1f441f97e8f863348f3ad9', 'request_id': 'req-f8d15161-22c9-4d78-9a04-4ab9e28f9d36'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:30.832423 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f8d15161-22c9-4d78-9a04-4ab9e28f9d36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eca4dc271b1f441f97e8f863348f3ad9', 'request_id': 'req-f8d15161-22c9-4d78-9a04-4ab9e28f9d36'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:30.846475 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f8d15161-22c9-4d78-9a04-4ab9e28f9d36 admin admin] The token cache is being invalidate because project eca4dc271b1f441f97e8f863348f3ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:30.846790 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f8d15161-22c9-4d78-9a04-4ab9e28f9d36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:30.847445 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f8d15161-22c9-4d78-9a04-4ab9e28f9d36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:30.849180 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1003/1984] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:30 2022] DELETE /identity/v3/projects/eca4dc271b1f441f97e8f863348f3ad9 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:30.849987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d15161-22c9-4d78-9a04-4ab9e28f9d36 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:30.851316 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f8d15161-22c9-4d78-9a04-4ab9e28f9d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:30.877517 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6db5355c-0a08-4ed0-9a3d-9759be49f540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5497c8db2f243e6ab5c89c440575e10'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:30.883808 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 982/1985] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:30 2022] DELETE /identity/v3/users/c5497c8db2f243e6ab5c89c440575e10 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:30.884572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5355c-0a08-4ed0-9a3d-9759be49f540 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:30.886036 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6db5355c-0a08-4ed0-9a3d-9759be49f540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:30.915066 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d15161-22c9-4d78-9a04-4ab9e28f9d36 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:30.948907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5355c-0a08-4ed0-9a3d-9759be49f540 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:30.953670 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb050b65-723c-473d-9588-9b219c9b3a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:30.954601 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb050b65-723c-473d-9588-9b219c9b3a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:30.954925 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb050b65-723c-473d-9588-9b219c9b3a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:30.955195 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb050b65-723c-473d-9588-9b219c9b3a64 admin admin] PATH_INFO: `/v3/projects/a755006aa0634fd4a3591c454a1f2b4f/users/dfa65fba039049beb91137127a998566/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:30.957292 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb050b65-723c-473d-9588-9b219c9b3a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a755006aa0634fd4a3591c454a1f2b4f, user_id=dfa65fba039049beb91137127a998566, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:30.959922 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb050b65-723c-473d-9588-9b219c9b3a64 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:30.971039 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 983/1986] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:30 2022] PUT /identity/v3/projects/a755006aa0634fd4a3591c454a1f2b4f/users/dfa65fba039049beb91137127a998566/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:30.972386 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadda4c9-22a9-4144-b93d-69b92ca470dd None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:30.972736 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadda4c9-22a9-4144-b93d-69b92ca470dd None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:30.973078 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadda4c9-22a9-4144-b93d-69b92ca470dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:30.981083 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18d6fe-077e-4c5d-acac-02b1c8cb0e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:30.981750 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18d6fe-077e-4c5d-acac-02b1c8cb0e7b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:30.982028 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18d6fe-077e-4c5d-acac-02b1c8cb0e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:30.982323 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18d6fe-077e-4c5d-acac-02b1c8cb0e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:30.984131 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18d6fe-077e-4c5d-acac-02b1c8cb0e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:30.985819 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18d6fe-077e-4c5d-acac-02b1c8cb0e7b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:30.991702 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-cadda4c9-22a9-4144-b93d-69b92ca470dd None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:30.992893 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-cadda4c9-22a9-4144-b93d-69b92ca470dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:30.996196 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1004/1987] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:30.997490 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e28931-de64-47a5-be08-ce83eace03c5 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:30.998429 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e28931-de64-47a5-be08-ce83eace03c5 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:30.998429 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e28931-de64-47a5-be08-ce83eace03c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:31.014945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-f1e28931-de64-47a5-be08-ce83eace03c5 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:31.016164 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f1e28931-de64-47a5-be08-ce83eace03c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:31.050847 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 984/1988] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:31.052151 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fb318-65be-4524-816f-b171684849c8 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:31.052429 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fb318-65be-4524-816f-b171684849c8 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:31.052702 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fb318-65be-4524-816f-b171684849c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:31.075340 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1005/1989] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:31.081837 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e28931-de64-47a5-be08-ce83eace03c5 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:31.081957 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-034fb318-65be-4524-816f-b171684849c8 None None] MFA Rules not processed for user `dfa65fba039049beb91137127a998566`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:31.081957 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-034fb318-65be-4524-816f-b171684849c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:31.087449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e28931-de64-47a5-be08-ce83eace03c5 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:31.092845 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f102c5-92e6-462a-b956-923321f97b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:31.093622 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f102c5-92e6-462a-b956-923321f97b40 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:31.093907 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f102c5-92e6-462a-b956-923321f97b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:31.094181 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f102c5-92e6-462a-b956-923321f97b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:31.094986 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f102c5-92e6-462a-b956-923321f97b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:31.096576 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f102c5-92e6-462a-b956-923321f97b40 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:31.106699 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1006/1990] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:31.108697 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f0d46-9649-4ccf-a8d8-5686c0c29e06 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:31.109034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f0d46-9649-4ccf-a8d8-5686c0c29e06 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:31.109312 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f0d46-9649-4ccf-a8d8-5686c0c29e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:31.127818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-6e3f0d46-9649-4ccf-a8d8-5686c0c29e06 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:31.129220 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-6e3f0d46-9649-4ccf-a8d8-5686c0c29e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:31.137164 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1007/1991] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:31.137921 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f0d46-9649-4ccf-a8d8-5686c0c29e06 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:31.139434 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-6e3f0d46-9649-4ccf-a8d8-5686c0c29e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:31.155983 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 985/1992] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:31.156695 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fb318-65be-4524-816f-b171684849c8 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:31.166543 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fb318-65be-4524-816f-b171684849c8 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:31.172002 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb1445-5a8b-43b7-a650-408c3e883579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:31.172897 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb1445-5a8b-43b7-a650-408c3e883579 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:31.173178 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb1445-5a8b-43b7-a650-408c3e883579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:31.173454 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb1445-5a8b-43b7-a650-408c3e883579 admin admin] PATH_INFO: `/v3/projects/f0d8c9de26d94de69ee0c49bc53101db/users/0b99dcc03d864d5aa9070aaf30a1c9e2/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:31.188449 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb1445-5a8b-43b7-a650-408c3e883579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0d8c9de26d94de69ee0c49bc53101db, user_id=0b99dcc03d864d5aa9070aaf30a1c9e2, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:31.191120 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb1445-5a8b-43b7-a650-408c3e883579 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:31.197934 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f0d46-9649-4ccf-a8d8-5686c0c29e06 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:31.201588 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba5f0a-6a74-4198-a8c4-6a7fab646c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:31.202224 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba5f0a-6a74-4198-a8c4-6a7fab646c42 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:31.202502 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba5f0a-6a74-4198-a8c4-6a7fab646c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:31.202892 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba5f0a-6a74-4198-a8c4-6a7fab646c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:31.212001 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba5f0a-6a74-4198-a8c4-6a7fab646c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:31.213413 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba5f0a-6a74-4198-a8c4-6a7fab646c42 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:31.223214 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1008/1993] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:31.224069 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba5f0a-6a74-4198-a8c4-6a7fab646c42 service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:31.234175 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba5f0a-6a74-4198-a8c4-6a7fab646c42 service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:31.239210 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f07f2f-f0fc-48ec-8f40-ae71bbba2c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:31.239797 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f07f2f-f0fc-48ec-8f40-ae71bbba2c2f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:31.240074 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f07f2f-f0fc-48ec-8f40-ae71bbba2c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:31.240340 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f07f2f-f0fc-48ec-8f40-ae71bbba2c2f admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:31.241038 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f07f2f-f0fc-48ec-8f40-ae71bbba2c2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:10:31.241610 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f07f2f-f0fc-48ec-8f40-ae71bbba2c2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:31.243343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f07f2f-f0fc-48ec-8f40-ae71bbba2c2f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:31.256636 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1009/1994] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:10:31.256636 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f07f2f-f0fc-48ec-8f40-ae71bbba2c2f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:31.259509 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-72f07f2f-f0fc-48ec-8f40-ae71bbba2c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:31.299416 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 986/1995] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:31 2022] PUT /identity/v3/projects/f0d8c9de26d94de69ee0c49bc53101db/users/0b99dcc03d864d5aa9070aaf30a1c9e2/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:31.300406 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb1445-5a8b-43b7-a650-408c3e883579 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:31.318594 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f07f2f-f0fc-48ec-8f40-ae71bbba2c2f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:31.367825 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076db0fb-c5ea-43f6-b20b-be11891bf2d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:31.368499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076db0fb-c5ea-43f6-b20b-be11891bf2d7 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:31.368848 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076db0fb-c5ea-43f6-b20b-be11891bf2d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:31.369114 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb1445-5a8b-43b7-a650-408c3e883579 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:31.369261 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076db0fb-c5ea-43f6-b20b-be11891bf2d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:31.374914 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b0a01-a7a6-4303-9fc4-012808702007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:31.375564 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b0a01-a7a6-4303-9fc4-012808702007 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:31.375843 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b0a01-a7a6-4303-9fc4-012808702007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:31.379697 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b0a01-a7a6-4303-9fc4-012808702007 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:31.379697 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b0a01-a7a6-4303-9fc4-012808702007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:31.379697 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b0a01-a7a6-4303-9fc4-012808702007 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:31.430523 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076db0fb-c5ea-43f6-b20b-be11891bf2d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:31.431073 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076db0fb-c5ea-43f6-b20b-be11891bf2d7 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:31.442495 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1010/1996] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:31.443972 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a8442-4f13-491d-98fa-ded4a6df6c37 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:31.444137 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a8442-4f13-491d-98fa-ded4a6df6c37 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:31.444389 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a8442-4f13-491d-98fa-ded4a6df6c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:31.472275 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-824a8442-4f13-491d-98fa-ded4a6df6c37 None None] MFA Rules not processed for user `0b99dcc03d864d5aa9070aaf30a1c9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:31.473521 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-824a8442-4f13-491d-98fa-ded4a6df6c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:31.522697 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 987/1997] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:31 2022] POST /identity/v3/projects => generated 375 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:31.527199 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b0a01-a7a6-4303-9fc4-012808702007 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:31.594134 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1011/1998] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:31.595516 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a8442-4f13-491d-98fa-ded4a6df6c37 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:31.611731 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a8442-4f13-491d-98fa-ded4a6df6c37 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:31.655797 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b0a01-a7a6-4303-9fc4-012808702007 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:31.661663 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be2742-51e7-4605-a088-aea410bfde5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:31.662440 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be2742-51e7-4605-a088-aea410bfde5a admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:31.662829 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be2742-51e7-4605-a088-aea410bfde5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:31.663192 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be2742-51e7-4605-a088-aea410bfde5a admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:31.663955 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be2742-51e7-4605-a088-aea410bfde5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:31.666236 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be2742-51e7-4605-a088-aea410bfde5a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:31.690752 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f068fc0-8eeb-4409-bc46-d0e8fd59f5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:31.691438 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f068fc0-8eeb-4409-bc46-d0e8fd59f5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:31.691744 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f068fc0-8eeb-4409-bc46-d0e8fd59f5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:31.692014 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f068fc0-8eeb-4409-bc46-d0e8fd59f5b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:31.692691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f068fc0-8eeb-4409-bc46-d0e8fd59f5b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:31.694565 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f068fc0-8eeb-4409-bc46-d0e8fd59f5b3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:31.800799 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 988/1999] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:31 2022] POST /identity/v3/users => generated 288 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:31.805701 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be2742-51e7-4605-a088-aea410bfde5a admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:31.805823 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1012/2000] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:31 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:31.805914 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-90be2742-51e7-4605-a088-aea410bfde5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:31.805996 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f068fc0-8eeb-4409-bc46-d0e8fd59f5b3 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:31.812321 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-1f068fc0-8eeb-4409-bc46-d0e8fd59f5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:31.866088 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be2742-51e7-4605-a088-aea410bfde5a admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:31.879871 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f068fc0-8eeb-4409-bc46-d0e8fd59f5b3 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:31.884712 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592f704-b44e-4a3e-977a-d4d0a0aa32dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:31.885569 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592f704-b44e-4a3e-977a-d4d0a0aa32dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:31.885849 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592f704-b44e-4a3e-977a-d4d0a0aa32dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:31.886120 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592f704-b44e-4a3e-977a-d4d0a0aa32dd admin admin] PATH_INFO: `/v3/projects/d2d40afae4124f4cb2a09aceaf75e917` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:31.887318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592f704-b44e-4a3e-977a-d4d0a0aa32dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d40afae4124f4cb2a09aceaf75e917)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:31.890520 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592f704-b44e-4a3e-977a-d4d0a0aa32dd admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:31.913709 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e390d-2da6-4fc1-88c1-8216420f9634 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:31.914350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e390d-2da6-4fc1-88c1-8216420f9634 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:31.914635 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e390d-2da6-4fc1-88c1-8216420f9634 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:31.914925 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e390d-2da6-4fc1-88c1-8216420f9634 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:31.916751 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b57e390d-2da6-4fc1-88c1-8216420f9634 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:31.972403 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e390d-2da6-4fc1-88c1-8216420f9634 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:31.973888 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e390d-2da6-4fc1-88c1-8216420f9634 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:31.982929 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 989/2001] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:31.983595 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e390d-2da6-4fc1-88c1-8216420f9634 service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:31.989180 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4592f704-b44e-4a3e-977a-d4d0a0aa32dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d40afae4124f4cb2a09aceaf75e917', 'request_id': 'req-4592f704-b44e-4a3e-977a-d4d0a0aa32dd'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:31.993742 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e390d-2da6-4fc1-88c1-8216420f9634 service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:32.049358 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbd51f-d1cc-4d32-bc17-cac9086d5ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:32.049935 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbd51f-d1cc-4d32-bc17-cac9086d5ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:32.050207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbd51f-d1cc-4d32-bc17-cac9086d5ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:32.050475 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbd51f-d1cc-4d32-bc17-cac9086d5ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:32.051174 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbd51f-d1cc-4d32-bc17-cac9086d5ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:32.053053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbd51f-d1cc-4d32-bc17-cac9086d5ad7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:32.067474 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4592f704-b44e-4a3e-977a-d4d0a0aa32dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d40afae4124f4cb2a09aceaf75e917', 'request_id': 'req-4592f704-b44e-4a3e-977a-d4d0a0aa32dd'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:32.073529 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4592f704-b44e-4a3e-977a-d4d0a0aa32dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d40afae4124f4cb2a09aceaf75e917', 'request_id': 'req-4592f704-b44e-4a3e-977a-d4d0a0aa32dd'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:32.084713 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4592f704-b44e-4a3e-977a-d4d0a0aa32dd admin admin] The token cache is being invalidate because project d2d40afae4124f4cb2a09aceaf75e917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:32.085003 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4592f704-b44e-4a3e-977a-d4d0a0aa32dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:32.085661 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4592f704-b44e-4a3e-977a-d4d0a0aa32dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:32.087401 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1013/2002] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:31 2022] DELETE /identity/v3/projects/d2d40afae4124f4cb2a09aceaf75e917 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:32.088165 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592f704-b44e-4a3e-977a-d4d0a0aa32dd admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:32.089472 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-4592f704-b44e-4a3e-977a-d4d0a0aa32dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:32.102117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592f704-b44e-4a3e-977a-d4d0a0aa32dd admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:32.107137 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bd301-92a3-4dbe-b6e7-4049272f065c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:32.108334 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bd301-92a3-4dbe-b6e7-4049272f065c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:32.108714 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bd301-92a3-4dbe-b6e7-4049272f065c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:32.108991 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bd301-92a3-4dbe-b6e7-4049272f065c admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:32.109718 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bd301-92a3-4dbe-b6e7-4049272f065c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:32.111369 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bd301-92a3-4dbe-b6e7-4049272f065c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:32.121876 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1014/2003] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:32.122699 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bd301-92a3-4dbe-b6e7-4049272f065c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:32.125115 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-724bd301-92a3-4dbe-b6e7-4049272f065c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:32.137644 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bd301-92a3-4dbe-b6e7-4049272f065c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:32.142979 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838947d-365e-47e1-8848-cd3be5668e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:32.143841 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838947d-365e-47e1-8848-cd3be5668e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:32.144122 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838947d-365e-47e1-8848-cd3be5668e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:32.144400 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838947d-365e-47e1-8848-cd3be5668e56 admin admin] PATH_INFO: `/v3/users/46252e6dd32e423a89a044b4cd76c411` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:32.145616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838947d-365e-47e1-8848-cd3be5668e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46252e6dd32e423a89a044b4cd76c411)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:32.147772 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838947d-365e-47e1-8848-cd3be5668e56 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:32.153976 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 990/2004] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:31 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:32.155700 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbd51f-d1cc-4d32-bc17-cac9086d5ad7 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:32.165681 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbd51f-d1cc-4d32-bc17-cac9086d5ad7 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:32.171399 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877652eb-4da5-44ba-bed3-edf9930bfe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:32.172128 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877652eb-4da5-44ba-bed3-edf9930bfe5c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:32.172437 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877652eb-4da5-44ba-bed3-edf9930bfe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:32.172713 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877652eb-4da5-44ba-bed3-edf9930bfe5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:32.173443 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877652eb-4da5-44ba-bed3-edf9930bfe5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:32.175072 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877652eb-4da5-44ba-bed3-edf9930bfe5c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:32.185372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 991/2005] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:32.187126 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877652eb-4da5-44ba-bed3-edf9930bfe5c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:32.188812 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-877652eb-4da5-44ba-bed3-edf9930bfe5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:32.201494 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877652eb-4da5-44ba-bed3-edf9930bfe5c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:32.206222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5f580-508b-4952-adc2-ec189b329dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:32.206893 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5f580-508b-4952-adc2-ec189b329dbe admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:32.207169 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5f580-508b-4952-adc2-ec189b329dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:32.207439 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5f580-508b-4952-adc2-ec189b329dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:32.208147 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5f580-508b-4952-adc2-ec189b329dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:32.209699 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5f580-508b-4952-adc2-ec189b329dbe admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:32.220110 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 992/2006] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:32.223515 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5f580-508b-4952-adc2-ec189b329dbe admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:32.230600 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5f580-508b-4952-adc2-ec189b329dbe admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:32.235902 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522555e-fbc7-4e3d-846f-bbbea249e27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:32.236758 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522555e-fbc7-4e3d-846f-bbbea249e27c admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:32.237032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522555e-fbc7-4e3d-846f-bbbea249e27c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:32.237303 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522555e-fbc7-4e3d-846f-bbbea249e27c admin admin] PATH_INFO: `/v3/projects/1efe4df95d184169be887339bb080213/users/9f81460fb7204916be2da0091c88e365/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:32.252113 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522555e-fbc7-4e3d-846f-bbbea249e27c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1efe4df95d184169be887339bb080213, user_id=9f81460fb7204916be2da0091c88e365, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:32.254822 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522555e-fbc7-4e3d-846f-bbbea249e27c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:32.359672 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 993/2007] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:32 2022] PUT /identity/v3/projects/1efe4df95d184169be887339bb080213/users/9f81460fb7204916be2da0091c88e365/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:32.360402 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522555e-fbc7-4e3d-846f-bbbea249e27c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:32.368510 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f838947d-365e-47e1-8848-cd3be5668e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46252e6dd32e423a89a044b4cd76c411'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:32.369451 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f838947d-365e-47e1-8848-cd3be5668e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46252e6dd32e423a89a044b4cd76c411'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:32.383371 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f838947d-365e-47e1-8848-cd3be5668e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46252e6dd32e423a89a044b4cd76c411'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:32.391164 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f838947d-365e-47e1-8848-cd3be5668e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46252e6dd32e423a89a044b4cd76c411'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:32.391919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f838947d-365e-47e1-8848-cd3be5668e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46252e6dd32e423a89a044b4cd76c411'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:32.422740 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522555e-fbc7-4e3d-846f-bbbea249e27c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:32.426992 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3bcb7-35d2-4a7f-b6d8-a347b04ee38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:32.427864 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3bcb7-35d2-4a7f-b6d8-a347b04ee38f admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:32.428137 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3bcb7-35d2-4a7f-b6d8-a347b04ee38f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:32.428409 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3bcb7-35d2-4a7f-b6d8-a347b04ee38f admin admin] PATH_INFO: `/v3/projects/9c4fefdd8ea34e39951197da08287d4d/users/465c17ccdf9c4bfa8aa74c4b42e8f2bc/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:32.442737 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3bcb7-35d2-4a7f-b6d8-a347b04ee38f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4fefdd8ea34e39951197da08287d4d, user_id=465c17ccdf9c4bfa8aa74c4b42e8f2bc, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:32.445362 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3bcb7-35d2-4a7f-b6d8-a347b04ee38f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:32.531498 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1015/2008] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:32 2022] DELETE /identity/v3/users/46252e6dd32e423a89a044b4cd76c411 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:32.532905 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3aebc-4cf2-4845-a246-e07e81bad4e7 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:32.534293 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3aebc-4cf2-4845-a246-e07e81bad4e7 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:32.534293 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3aebc-4cf2-4845-a246-e07e81bad4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:32.560746 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 994/2009] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:32 2022] PUT /identity/v3/projects/9c4fefdd8ea34e39951197da08287d4d/users/465c17ccdf9c4bfa8aa74c4b42e8f2bc/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:32.564890 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3bcb7-35d2-4a7f-b6d8-a347b04ee38f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:32.566908 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-77d3bcb7-35d2-4a7f-b6d8-a347b04ee38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:32.599439 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-bff3aebc-4cf2-4845-a246-e07e81bad4e7 None None] MFA Rules not processed for user `9f81460fb7204916be2da0091c88e365`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:32.602068 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-bff3aebc-4cf2-4845-a246-e07e81bad4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:32.677035 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3bcb7-35d2-4a7f-b6d8-a347b04ee38f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:32.682130 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245c80f-f71f-4b6d-ad8b-3684c3bb4d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:32.682833 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245c80f-f71f-4b6d-ad8b-3684c3bb4d6b admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:32.683101 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245c80f-f71f-4b6d-ad8b-3684c3bb4d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:32.683393 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245c80f-f71f-4b6d-ad8b-3684c3bb4d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:32.684128 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245c80f-f71f-4b6d-ad8b-3684c3bb4d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:32.685818 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245c80f-f71f-4b6d-ad8b-3684c3bb4d6b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:32.702477 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1016/2010] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:32.702602 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 995/2011] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:10:32.707436 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3aebc-4cf2-4845-a246-e07e81bad4e7 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:32.707575 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245c80f-f71f-4b6d-ad8b-3684c3bb4d6b admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:32.709515 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-c245c80f-f71f-4b6d-ad8b-3684c3bb4d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:32.721061 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3aebc-4cf2-4845-a246-e07e81bad4e7 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:32.723632 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245c80f-f71f-4b6d-ad8b-3684c3bb4d6b admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:32.725977 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118b647-6a49-45fb-9241-c43cc14b133a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:32.727008 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118b647-6a49-45fb-9241-c43cc14b133a admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:32.727289 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118b647-6a49-45fb-9241-c43cc14b133a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:32.727560 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118b647-6a49-45fb-9241-c43cc14b133a admin admin] PATH_INFO: `/v3/projects/9c4fefdd8ea34e39951197da08287d4d/users/465c17ccdf9c4bfa8aa74c4b42e8f2bc/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:32.728373 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd82cc-9c1d-4538-894b-4714582589f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:32.729182 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd82cc-9c1d-4538-894b-4714582589f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:32.729459 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd82cc-9c1d-4538-894b-4714582589f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:32.729742 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd82cc-9c1d-4538-894b-4714582589f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:32.729880 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118b647-6a49-45fb-9241-c43cc14b133a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4fefdd8ea34e39951197da08287d4d, user_id=465c17ccdf9c4bfa8aa74c4b42e8f2bc, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:32.730423 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd82cc-9c1d-4538-894b-4714582589f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:32.732440 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd82cc-9c1d-4538-894b-4714582589f3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:32.733923 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118b647-6a49-45fb-9241-c43cc14b133a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:32.744998 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1017/2012] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:32 2022] PUT /identity/v3/projects/9c4fefdd8ea34e39951197da08287d4d/users/465c17ccdf9c4bfa8aa74c4b42e8f2bc/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:10:32.756237 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fed760-3206-48b5-9788-3bc1fd420ed0 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:32.756523 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fed760-3206-48b5-9788-3bc1fd420ed0 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:32.756799 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fed760-3206-48b5-9788-3bc1fd420ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:32.787838 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-20fed760-3206-48b5-9788-3bc1fd420ed0 None None] MFA Rules not processed for user `465c17ccdf9c4bfa8aa74c4b42e8f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:32.789055 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-20fed760-3206-48b5-9788-3bc1fd420ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:32.882732 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1018/2013] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:10:32.905104 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 996/2014] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:32 2022] POST /identity/v3/projects => generated 375 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:10:32.913193 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fed760-3206-48b5-9788-3bc1fd420ed0 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:32.930240 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd82cc-9c1d-4538-894b-4714582589f3 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:32.932154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-23dd82cc-9c1d-4538-894b-4714582589f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:32.991679 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fed760-3206-48b5-9788-3bc1fd420ed0 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:32.991952 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd82cc-9c1d-4538-894b-4714582589f3 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:32.995900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62aba3-7447-46b5-bd5a-536609b01da4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:32.996597 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62aba3-7447-46b5-bd5a-536609b01da4 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:32.996880 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62aba3-7447-46b5-bd5a-536609b01da4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:32.997157 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62aba3-7447-46b5-bd5a-536609b01da4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:32.999702 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6e62aba3-7447-46b5-bd5a-536609b01da4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:33.046628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b89b5d-b75d-4cdf-9e23-45468ee139ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:33.047318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b89b5d-b75d-4cdf-9e23-45468ee139ed admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:33.047595 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b89b5d-b75d-4cdf-9e23-45468ee139ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:33.047866 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b89b5d-b75d-4cdf-9e23-45468ee139ed admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:33.048543 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b89b5d-b75d-4cdf-9e23-45468ee139ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:33.050779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b89b5d-b75d-4cdf-9e23-45468ee139ed admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:33.057212 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62aba3-7447-46b5-bd5a-536609b01da4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:33.058635 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62aba3-7447-46b5-bd5a-536609b01da4 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:33.068332 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 997/2015] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:10:33.333917 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62aba3-7447-46b5-bd5a-536609b01da4 service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:33.333917 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6e62aba3-7447-46b5-bd5a-536609b01da4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:33.346101 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62aba3-7447-46b5-bd5a-536609b01da4 service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:33.350807 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3632b0-db61-41ec-a90f-756bd3b7f826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:33.351654 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3632b0-db61-41ec-a90f-756bd3b7f826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:33.351924 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3632b0-db61-41ec-a90f-756bd3b7f826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:33.352188 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3632b0-db61-41ec-a90f-756bd3b7f826 admin admin] PATH_INFO: `/v3/projects/5a6dedb9f3354ec6b3050dbd0990f6c0` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:33.353364 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3632b0-db61-41ec-a90f-756bd3b7f826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a6dedb9f3354ec6b3050dbd0990f6c0)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:33.355288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3632b0-db61-41ec-a90f-756bd3b7f826 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:33.549114 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1019/2016] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:32 2022] POST /identity/v3/users => generated 294 bytes in 636 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:33.571315 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b89b5d-b75d-4cdf-9e23-45468ee139ed admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:33.581999 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b89b5d-b75d-4cdf-9e23-45468ee139ed admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:33.586777 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aeff03-02e4-4c16-bcf9-4a2d44c2bf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:33.587439 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeff03-02e4-4c16-bcf9-4a2d44c2bf21 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:33.587720 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeff03-02e4-4c16-bcf9-4a2d44c2bf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:33.587996 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeff03-02e4-4c16-bcf9-4a2d44c2bf21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:33.588716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aeff03-02e4-4c16-bcf9-4a2d44c2bf21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:33.590329 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aeff03-02e4-4c16-bcf9-4a2d44c2bf21 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:33.618919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1020/2017] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:10:33.619960 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aeff03-02e4-4c16-bcf9-4a2d44c2bf21 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:33.630811 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aeff03-02e4-4c16-bcf9-4a2d44c2bf21 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:33.635728 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31205c4-e0bb-4ce9-99fe-0dcb5392407a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:33.636732 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31205c4-e0bb-4ce9-99fe-0dcb5392407a admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:33.637127 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31205c4-e0bb-4ce9-99fe-0dcb5392407a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:33.637429 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31205c4-e0bb-4ce9-99fe-0dcb5392407a admin admin] PATH_INFO: `/v3/projects/8b937e4230a94b30bf0024e3646465a2/users/488e2757f22d4b89a7747b909e83c6ba/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:33.653132 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31205c4-e0bb-4ce9-99fe-0dcb5392407a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b937e4230a94b30bf0024e3646465a2, user_id=488e2757f22d4b89a7747b909e83c6ba, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:33.660328 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31205c4-e0bb-4ce9-99fe-0dcb5392407a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:33.825793 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1021/2018] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:33 2022] PUT /identity/v3/projects/8b937e4230a94b30bf0024e3646465a2/users/488e2757f22d4b89a7747b909e83c6ba/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:33.830325 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31205c4-e0bb-4ce9-99fe-0dcb5392407a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:33.833957 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-aa3632b0-db61-41ec-a90f-756bd3b7f826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a6dedb9f3354ec6b3050dbd0990f6c0', 'request_id': 'req-aa3632b0-db61-41ec-a90f-756bd3b7f826'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:33.895952 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31205c4-e0bb-4ce9-99fe-0dcb5392407a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:33.947731 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-aa3632b0-db61-41ec-a90f-756bd3b7f826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a6dedb9f3354ec6b3050dbd0990f6c0', 'request_id': 'req-aa3632b0-db61-41ec-a90f-756bd3b7f826'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:33.950780 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52b4b7-9df5-45bd-a3fa-6bfb178cec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:33.952436 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52b4b7-9df5-45bd-a3fa-6bfb178cec72 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:33.952735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52b4b7-9df5-45bd-a3fa-6bfb178cec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:33.953016 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52b4b7-9df5-45bd-a3fa-6bfb178cec72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:33.953779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52b4b7-9df5-45bd-a3fa-6bfb178cec72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:33.954533 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-aa3632b0-db61-41ec-a90f-756bd3b7f826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a6dedb9f3354ec6b3050dbd0990f6c0', 'request_id': 'req-aa3632b0-db61-41ec-a90f-756bd3b7f826'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:33.955418 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52b4b7-9df5-45bd-a3fa-6bfb178cec72 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:33.965426 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-aa3632b0-db61-41ec-a90f-756bd3b7f826 admin admin] The token cache is being invalidate because project 5a6dedb9f3354ec6b3050dbd0990f6c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:33.965616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1022/2019] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:10:33.965703 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-aa3632b0-db61-41ec-a90f-756bd3b7f826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:33.966414 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-aa3632b0-db61-41ec-a90f-756bd3b7f826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:33.968756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 998/2020] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:33 2022] DELETE /identity/v3/projects/5a6dedb9f3354ec6b3050dbd0990f6c0 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:10:33.969801 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52b4b7-9df5-45bd-a3fa-6bfb178cec72 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:33.971481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-7e52b4b7-9df5-45bd-a3fa-6bfb178cec72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:33.973273 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dec746-c077-4fd5-9274-195514f72829 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:33.973554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dec746-c077-4fd5-9274-195514f72829 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:33.973844 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dec746-c077-4fd5-9274-195514f72829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:33.984068 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52b4b7-9df5-45bd-a3fa-6bfb178cec72 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:33.988760 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848eb1b5-6f28-4e01-836d-7e8a75711b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:33.989637 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eb1b5-6f28-4e01-836d-7e8a75711b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:33.989947 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eb1b5-6f28-4e01-836d-7e8a75711b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:33.990218 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eb1b5-6f28-4e01-836d-7e8a75711b13 admin admin] PATH_INFO: `/v3/projects/8b937e4230a94b30bf0024e3646465a2/users/488e2757f22d4b89a7747b909e83c6ba/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:33.991076 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-44dec746-c077-4fd5-9274-195514f72829 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:33.992498 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-44dec746-c077-4fd5-9274-195514f72829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:33.992639 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848eb1b5-6f28-4e01-836d-7e8a75711b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b937e4230a94b30bf0024e3646465a2, user_id=488e2757f22d4b89a7747b909e83c6ba, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:33.995352 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848eb1b5-6f28-4e01-836d-7e8a75711b13 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:34.001110 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 999/2021] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:10:34.006695 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1023/2022] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:33 2022] PUT /identity/v3/projects/8b937e4230a94b30bf0024e3646465a2/users/488e2757f22d4b89a7747b909e83c6ba/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:34.013700 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424243b2-e904-40ed-8d9a-57854bee9700 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:34.013700 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424243b2-e904-40ed-8d9a-57854bee9700 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:34.013700 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424243b2-e904-40ed-8d9a-57854bee9700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:34.024120 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5842b-d768-4714-9a44-6a9a8b6024be None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:34.024417 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5842b-d768-4714-9a44-6a9a8b6024be None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:34.024700 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5842b-d768-4714-9a44-6a9a8b6024be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:34.027621 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-424243b2-e904-40ed-8d9a-57854bee9700 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:34.028800 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-424243b2-e904-40ed-8d9a-57854bee9700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:34.058153 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-aaf5842b-d768-4714-9a44-6a9a8b6024be None None] MFA Rules not processed for user `488e2757f22d4b89a7747b909e83c6ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:34.059516 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-aaf5842b-d768-4714-9a44-6a9a8b6024be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:34.093310 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1000/2023] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:34.097498 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424243b2-e904-40ed-8d9a-57854bee9700 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:34.106447 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424243b2-e904-40ed-8d9a-57854bee9700 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:34.112000 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bf108-54f6-4d09-983a-b21d600a8f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:34.112640 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bf108-54f6-4d09-983a-b21d600a8f51 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:34.112922 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bf108-54f6-4d09-983a-b21d600a8f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:34.113191 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bf108-54f6-4d09-983a-b21d600a8f51 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:34.113905 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bf108-54f6-4d09-983a-b21d600a8f51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:10:34.114205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bf108-54f6-4d09-983a-b21d600a8f51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:34.115815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bf108-54f6-4d09-983a-b21d600a8f51 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:34.127600 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1001/2024] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 17:10:34.128211 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1024/2025] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:34.132316 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bf108-54f6-4d09-983a-b21d600a8f51 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:34.142361 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bf108-54f6-4d09-983a-b21d600a8f51 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:34.147050 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31f39b-968c-4a6f-bc56-0de6d30e194b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:34.147679 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31f39b-968c-4a6f-bc56-0de6d30e194b admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:34.147956 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31f39b-968c-4a6f-bc56-0de6d30e194b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:34.148227 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31f39b-968c-4a6f-bc56-0de6d30e194b admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:34.148903 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31f39b-968c-4a6f-bc56-0de6d30e194b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:34.150798 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31f39b-968c-4a6f-bc56-0de6d30e194b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:34.233214 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5842b-d768-4714-9a44-6a9a8b6024be None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:34.234883 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-aaf5842b-d768-4714-9a44-6a9a8b6024be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:34.295902 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5842b-d768-4714-9a44-6a9a8b6024be None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:34.299868 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a383c9-b673-4381-9711-9caacc0aeb1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:34.300562 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a383c9-b673-4381-9711-9caacc0aeb1d service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:34.300844 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a383c9-b673-4381-9711-9caacc0aeb1d service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:34.301186 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a383c9-b673-4381-9711-9caacc0aeb1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:34.303101 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-35a383c9-b673-4381-9711-9caacc0aeb1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:34.310069 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1002/2026] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:34 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:34.314444 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31f39b-968c-4a6f-bc56-0de6d30e194b admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:34.384787 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a383c9-b673-4381-9711-9caacc0aeb1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:34.385418 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31f39b-968c-4a6f-bc56-0de6d30e194b admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:34.386591 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a383c9-b673-4381-9711-9caacc0aeb1d service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:34.391933 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e526e7-fa49-4cb0-bf81-15f506bc1caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:34.393272 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e526e7-fa49-4cb0-bf81-15f506bc1caf admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:34.393272 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e526e7-fa49-4cb0-bf81-15f506bc1caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:34.393272 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e526e7-fa49-4cb0-bf81-15f506bc1caf admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:34.393832 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e526e7-fa49-4cb0-bf81-15f506bc1caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:34.395802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e526e7-fa49-4cb0-bf81-15f506bc1caf admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:34.398386 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1025/2027] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:34.542786 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1003/2028] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:34 2022] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:34.551018 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a383c9-b673-4381-9711-9caacc0aeb1d service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:34.562945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a383c9-b673-4381-9711-9caacc0aeb1d service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:34.567518 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ad9bc-5148-41a6-9119-2de5115efedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:34.568169 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ad9bc-5148-41a6-9119-2de5115efedc admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:34.568445 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ad9bc-5148-41a6-9119-2de5115efedc admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:34.568714 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ad9bc-5148-41a6-9119-2de5115efedc admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:34.569505 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ad9bc-5148-41a6-9119-2de5115efedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:34.571124 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ad9bc-5148-41a6-9119-2de5115efedc admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:34.582199 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1026/2029] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:34.586033 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e526e7-fa49-4cb0-bf81-15f506bc1caf admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:34.597055 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e526e7-fa49-4cb0-bf81-15f506bc1caf admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:34.601899 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45142db3-b6b3-4253-a836-4f72f50685b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:34.602495 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45142db3-b6b3-4253-a836-4f72f50685b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:34.602843 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45142db3-b6b3-4253-a836-4f72f50685b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:34.603158 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45142db3-b6b3-4253-a836-4f72f50685b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:34.603912 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45142db3-b6b3-4253-a836-4f72f50685b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:34.605481 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45142db3-b6b3-4253-a836-4f72f50685b4 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:34.616840 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1004/2030] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:34.620978 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ad9bc-5148-41a6-9119-2de5115efedc admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:34.630904 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ad9bc-5148-41a6-9119-2de5115efedc admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:34.635607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7173d-fdc8-492b-a6db-d5db018db95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:34.636475 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7173d-fdc8-492b-a6db-d5db018db95a admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:34.636751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7173d-fdc8-492b-a6db-d5db018db95a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:34.637020 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7173d-fdc8-492b-a6db-d5db018db95a admin admin] PATH_INFO: `/v3/projects/c4af4ab43163437b8f0413517fcfa9b9/users/bb1d6cd3209b42e9805c5947f25dcbc2/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:34.652475 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7173d-fdc8-492b-a6db-d5db018db95a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4af4ab43163437b8f0413517fcfa9b9, user_id=bb1d6cd3209b42e9805c5947f25dcbc2, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:34.656043 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7173d-fdc8-492b-a6db-d5db018db95a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:34.827006 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1027/2031] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:34 2022] PUT /identity/v3/projects/c4af4ab43163437b8f0413517fcfa9b9/users/bb1d6cd3209b42e9805c5947f25dcbc2/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:10:34.838657 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc46e3-352f-47a7-b154-6702b23c73f0 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:34.839002 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc46e3-352f-47a7-b154-6702b23c73f0 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:34.839278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc46e3-352f-47a7-b154-6702b23c73f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:34.865297 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-eefc46e3-352f-47a7-b154-6702b23c73f0 None None] MFA Rules not processed for user `bb1d6cd3209b42e9805c5947f25dcbc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:34.866816 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-eefc46e3-352f-47a7-b154-6702b23c73f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:34.931347 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1005/2032] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:34.936937 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7173d-fdc8-492b-a6db-d5db018db95a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:34.997618 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7173d-fdc8-492b-a6db-d5db018db95a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:35.003292 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f010edc-fa17-448e-873a-c182e7b98fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:35.004043 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f010edc-fa17-448e-873a-c182e7b98fae admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:35.005082 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f010edc-fa17-448e-873a-c182e7b98fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:35.005354 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f010edc-fa17-448e-873a-c182e7b98fae admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:35.006043 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f010edc-fa17-448e-873a-c182e7b98fae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:35.007969 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f010edc-fa17-448e-873a-c182e7b98fae admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:35.115583 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1028/2033] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:34 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:35.120094 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc46e3-352f-47a7-b154-6702b23c73f0 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:35.131936 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc46e3-352f-47a7-b154-6702b23c73f0 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:35.190481 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7303f38-d477-449b-b1bf-b264844e3f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:35.191262 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7303f38-d477-449b-b1bf-b264844e3f12 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:35.191547 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7303f38-d477-449b-b1bf-b264844e3f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:35.191820 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7303f38-d477-449b-b1bf-b264844e3f12 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:35.192509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7303f38-d477-449b-b1bf-b264844e3f12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:35.194446 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7303f38-d477-449b-b1bf-b264844e3f12 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:35.294675 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1006/2034] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:35 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:35.303473 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f010edc-fa17-448e-873a-c182e7b98fae admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:35.315143 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f010edc-fa17-448e-873a-c182e7b98fae admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:35.320109 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47eb1b-49e7-492e-b193-2447bca8cf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:35.320788 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47eb1b-49e7-492e-b193-2447bca8cf8d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:35.321057 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47eb1b-49e7-492e-b193-2447bca8cf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:35.321335 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47eb1b-49e7-492e-b193-2447bca8cf8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:35.322061 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47eb1b-49e7-492e-b193-2447bca8cf8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:35.323752 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47eb1b-49e7-492e-b193-2447bca8cf8d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:35.337605 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1029/2035] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:35.339280 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7303f38-d477-449b-b1bf-b264844e3f12 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:35.350615 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7303f38-d477-449b-b1bf-b264844e3f12 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:35.357055 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2a54a-f5dd-49b7-9b1a-38ee5d888de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:35.358529 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2a54a-f5dd-49b7-9b1a-38ee5d888de7 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:35.359587 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2a54a-f5dd-49b7-9b1a-38ee5d888de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:35.360084 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2a54a-f5dd-49b7-9b1a-38ee5d888de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:35.362813 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2a54a-f5dd-49b7-9b1a-38ee5d888de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:35.364831 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2a54a-f5dd-49b7-9b1a-38ee5d888de7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:35.377046 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1007/2036] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:35.381462 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47eb1b-49e7-492e-b193-2447bca8cf8d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:35.393342 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47eb1b-49e7-492e-b193-2447bca8cf8d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:35.398042 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fb0b4-ecfd-4bc0-abbb-a8be4d183b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:35.398955 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fb0b4-ecfd-4bc0-abbb-a8be4d183b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:35.399256 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fb0b4-ecfd-4bc0-abbb-a8be4d183b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:35.399600 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fb0b4-ecfd-4bc0-abbb-a8be4d183b44 admin admin] PATH_INFO: `/v3/projects/ff0d5a80ab20424baf0fc1c208b38958/users/4c1be89a6bab49bcbed6e02f9b9d8fca/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:35.419578 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fb0b4-ecfd-4bc0-abbb-a8be4d183b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0d5a80ab20424baf0fc1c208b38958, user_id=4c1be89a6bab49bcbed6e02f9b9d8fca, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:35.422606 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fb0b4-ecfd-4bc0-abbb-a8be4d183b44 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:35.520529 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1030/2037] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:35 2022] PUT /identity/v3/projects/ff0d5a80ab20424baf0fc1c208b38958/users/4c1be89a6bab49bcbed6e02f9b9d8fca/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:35.531073 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf40fc8-f72e-46c6-8b59-9a063284ea86 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:35.531234 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf40fc8-f72e-46c6-8b59-9a063284ea86 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:35.531510 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf40fc8-f72e-46c6-8b59-9a063284ea86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:35.559647 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-aaf40fc8-f72e-46c6-8b59-9a063284ea86 None None] MFA Rules not processed for user `4c1be89a6bab49bcbed6e02f9b9d8fca`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:35.561579 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-aaf40fc8-f72e-46c6-8b59-9a063284ea86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:35.628119 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1008/2038] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:35.632676 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fb0b4-ecfd-4bc0-abbb-a8be4d183b44 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:35.703508 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fb0b4-ecfd-4bc0-abbb-a8be4d183b44 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:35.708331 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735df0d-c916-4858-8ef9-eaab2b65a563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:35.708983 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735df0d-c916-4858-8ef9-eaab2b65a563 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:35.709265 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735df0d-c916-4858-8ef9-eaab2b65a563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:35.709540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735df0d-c916-4858-8ef9-eaab2b65a563 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:35.710258 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735df0d-c916-4858-8ef9-eaab2b65a563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:35.712178 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735df0d-c916-4858-8ef9-eaab2b65a563 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:35.859061 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1031/2039] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:35 2022] POST /identity/v3/projects => generated 383 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:35.863122 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf40fc8-f72e-46c6-8b59-9a063284ea86 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:35.874676 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf40fc8-f72e-46c6-8b59-9a063284ea86 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:35.940772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d19f21-cd4c-4476-ba08-9a20ab795e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:35.940772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d19f21-cd4c-4476-ba08-9a20ab795e96 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:35.940772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d19f21-cd4c-4476-ba08-9a20ab795e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:35.940772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d19f21-cd4c-4476-ba08-9a20ab795e96 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:35.941207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d19f21-cd4c-4476-ba08-9a20ab795e96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:35.941207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d19f21-cd4c-4476-ba08-9a20ab795e96 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:36.038765 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1009/2040] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:35 2022] POST /identity/v3/users => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:36.042785 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735df0d-c916-4858-8ef9-eaab2b65a563 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:36.053705 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735df0d-c916-4858-8ef9-eaab2b65a563 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:36.059492 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b66e9-16c3-492b-8748-384dce8b09ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:36.060152 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b66e9-16c3-492b-8748-384dce8b09ec admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:36.060469 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b66e9-16c3-492b-8748-384dce8b09ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:36.060957 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b66e9-16c3-492b-8748-384dce8b09ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:36.061816 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b66e9-16c3-492b-8748-384dce8b09ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:36.063432 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b66e9-16c3-492b-8748-384dce8b09ec admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:36.074041 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1032/2041] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:36.079311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d19f21-cd4c-4476-ba08-9a20ab795e96 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:36.090396 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d19f21-cd4c-4476-ba08-9a20ab795e96 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:36.095950 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63c989-b204-4a74-b6a3-da36af8f818c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:36.096831 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63c989-b204-4a74-b6a3-da36af8f818c admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:36.097113 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63c989-b204-4a74-b6a3-da36af8f818c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:36.097389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63c989-b204-4a74-b6a3-da36af8f818c admin admin] PATH_INFO: `/v3/projects/33f58921b0814d27bb7241e4914a9399/users/2cf24d4a560d4b4b9b77b71620e80e4e/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:36.111870 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63c989-b204-4a74-b6a3-da36af8f818c admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f58921b0814d27bb7241e4914a9399, user_id=2cf24d4a560d4b4b9b77b71620e80e4e, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:36.114488 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63c989-b204-4a74-b6a3-da36af8f818c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:36.211460 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1010/2042] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:36 2022] PUT /identity/v3/projects/33f58921b0814d27bb7241e4914a9399/users/2cf24d4a560d4b4b9b77b71620e80e4e/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:36.221856 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b66e9-16c3-492b-8748-384dce8b09ec admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:36.231767 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b66e9-16c3-492b-8748-384dce8b09ec admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:36.287311 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a111b-701a-46a4-8110-f8f965acfa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:36.287978 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a111b-701a-46a4-8110-f8f965acfa24 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:36.288257 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a111b-701a-46a4-8110-f8f965acfa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:36.288531 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a111b-701a-46a4-8110-f8f965acfa24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:36.289315 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a111b-701a-46a4-8110-f8f965acfa24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:36.290953 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a111b-701a-46a4-8110-f8f965acfa24 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:36.301332 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1033/2043] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:36.305556 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63c989-b204-4a74-b6a3-da36af8f818c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:36.316925 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63c989-b204-4a74-b6a3-da36af8f818c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:36.321873 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ecacf-aa26-44ef-a8b1-ee6a28798b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:36.322775 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ecacf-aa26-44ef-a8b1-ee6a28798b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:36.323052 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ecacf-aa26-44ef-a8b1-ee6a28798b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:36.323327 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ecacf-aa26-44ef-a8b1-ee6a28798b94 admin admin] PATH_INFO: `/v3/projects/33f58921b0814d27bb7241e4914a9399/users/2cf24d4a560d4b4b9b77b71620e80e4e/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:36.325292 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ecacf-aa26-44ef-a8b1-ee6a28798b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f58921b0814d27bb7241e4914a9399, user_id=2cf24d4a560d4b4b9b77b71620e80e4e, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:36.328680 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ecacf-aa26-44ef-a8b1-ee6a28798b94 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:36.338918 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1011/2044] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:36 2022] PUT /identity/v3/projects/33f58921b0814d27bb7241e4914a9399/users/2cf24d4a560d4b4b9b77b71620e80e4e/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:36.349939 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2628f-3943-4442-81a3-9c836e39d2ee None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:36.350226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2628f-3943-4442-81a3-9c836e39d2ee None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:36.350498 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2628f-3943-4442-81a3-9c836e39d2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:36.378060 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-0db2628f-3943-4442-81a3-9c836e39d2ee None None] MFA Rules not processed for user `2cf24d4a560d4b4b9b77b71620e80e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:36.379276 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0db2628f-3943-4442-81a3-9c836e39d2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:36.446674 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1034/2045] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:36.457012 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ecacf-aa26-44ef-a8b1-ee6a28798b94 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:36.510169 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ecacf-aa26-44ef-a8b1-ee6a28798b94 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:36.514516 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052b7c1-1cf6-412e-b779-e50465cb54db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:36.518987 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052b7c1-1cf6-412e-b779-e50465cb54db service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:36.518987 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052b7c1-1cf6-412e-b779-e50465cb54db service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:36.518987 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052b7c1-1cf6-412e-b779-e50465cb54db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:36.570091 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052b7c1-1cf6-412e-b779-e50465cb54db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:36.571581 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052b7c1-1cf6-412e-b779-e50465cb54db service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:36.581288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1012/2046] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:47.455030 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2628f-3943-4442-81a3-9c836e39d2ee None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:47.456459 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0db2628f-3943-4442-81a3-9c836e39d2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:47.468959 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2628f-3943-4442-81a3-9c836e39d2ee None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:47.472502 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60beb426-d309-4304-9eaa-cafa797b8d83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:47.473129 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60beb426-d309-4304-9eaa-cafa797b8d83 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:47.473410 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60beb426-d309-4304-9eaa-cafa797b8d83 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:47.473683 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60beb426-d309-4304-9eaa-cafa797b8d83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:47.528211 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60beb426-d309-4304-9eaa-cafa797b8d83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:47.530615 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60beb426-d309-4304-9eaa-cafa797b8d83 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:47.539602 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1035/2047] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:51.323667 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052b7c1-1cf6-412e-b779-e50465cb54db service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:51.333217 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052b7c1-1cf6-412e-b779-e50465cb54db service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:51.336974 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd6565-0f21-4a10-8e03-cf14cb52269a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:51.337606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd6565-0f21-4a10-8e03-cf14cb52269a service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:51.337903 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd6565-0f21-4a10-8e03-cf14cb52269a service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:51.338172 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd6565-0f21-4a10-8e03-cf14cb52269a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:51.347397 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd6565-0f21-4a10-8e03-cf14cb52269a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:51.348796 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd6565-0f21-4a10-8e03-cf14cb52269a service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:51.358376 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1013/2048] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:52.215190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60beb426-d309-4304-9eaa-cafa797b8d83 service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:52.224322 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60beb426-d309-4304-9eaa-cafa797b8d83 service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:52.228016 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb98be-f258-4133-91b4-32dd436c6a6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:52.228646 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb98be-f258-4133-91b4-32dd436c6a6b service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:52.228916 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb98be-f258-4133-91b4-32dd436c6a6b service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:52.229184 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb98be-f258-4133-91b4-32dd436c6a6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:52.289730 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb98be-f258-4133-91b4-32dd436c6a6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:52.291194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb98be-f258-4133-91b4-32dd436c6a6b service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:52.301033 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1036/2049] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:52 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:52.381648 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd6565-0f21-4a10-8e03-cf14cb52269a service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:52.383501 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b7cd6565-0f21-4a10-8e03-cf14cb52269a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:52.410346 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb98be-f258-4133-91b4-32dd436c6a6b service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:52.411981 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5ceb98be-f258-4133-91b4-32dd436c6a6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:52.451224 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd6565-0f21-4a10-8e03-cf14cb52269a service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:52.456249 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd0a26-2114-4ccc-8d20-0ec4f2ca99cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:52.457221 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd0a26-2114-4ccc-8d20-0ec4f2ca99cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:52.457509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd0a26-2114-4ccc-8d20-0ec4f2ca99cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:52.457788 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd0a26-2114-4ccc-8d20-0ec4f2ca99cd admin admin] PATH_INFO: `/v3/users/0b99dcc03d864d5aa9070aaf30a1c9e2` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:52.459068 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd0a26-2114-4ccc-8d20-0ec4f2ca99cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b99dcc03d864d5aa9070aaf30a1c9e2)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:52.461207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd0a26-2114-4ccc-8d20-0ec4f2ca99cd admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:52.480905 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb98be-f258-4133-91b4-32dd436c6a6b service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:52.486375 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfb99d-b865-4a07-81ac-f891f78d81f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:52.487309 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfb99d-b865-4a07-81ac-f891f78d81f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:52.487589 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfb99d-b865-4a07-81ac-f891f78d81f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:52.487863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfb99d-b865-4a07-81ac-f891f78d81f5 admin admin] PATH_INFO: `/v3/users/5f6a8844a7724b0485f0b8d38946ef71` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:52.489297 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfb99d-b865-4a07-81ac-f891f78d81f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f6a8844a7724b0485f0b8d38946ef71)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:52.491100 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfb99d-b865-4a07-81ac-f891f78d81f5 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:52.655081 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e8fd0a26-2114-4ccc-8d20-0ec4f2ca99cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b99dcc03d864d5aa9070aaf30a1c9e2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:52.655724 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e8fd0a26-2114-4ccc-8d20-0ec4f2ca99cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b99dcc03d864d5aa9070aaf30a1c9e2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:52.667490 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e8fd0a26-2114-4ccc-8d20-0ec4f2ca99cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b99dcc03d864d5aa9070aaf30a1c9e2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:52.674308 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e8fd0a26-2114-4ccc-8d20-0ec4f2ca99cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b99dcc03d864d5aa9070aaf30a1c9e2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:52.761149 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-45bfb99d-b865-4a07-81ac-f891f78d81f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f6a8844a7724b0485f0b8d38946ef71'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:52.762251 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-45bfb99d-b865-4a07-81ac-f891f78d81f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f6a8844a7724b0485f0b8d38946ef71'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:52.773503 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-45bfb99d-b865-4a07-81ac-f891f78d81f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f6a8844a7724b0485f0b8d38946ef71'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:52.781051 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-45bfb99d-b865-4a07-81ac-f891f78d81f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f6a8844a7724b0485f0b8d38946ef71'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:52.781837 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-45bfb99d-b865-4a07-81ac-f891f78d81f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f6a8844a7724b0485f0b8d38946ef71'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:52.828051 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e8fd0a26-2114-4ccc-8d20-0ec4f2ca99cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b99dcc03d864d5aa9070aaf30a1c9e2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:52.841017 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1014/2050] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:52 2022] DELETE /identity/v3/users/0b99dcc03d864d5aa9070aaf30a1c9e2 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:52.844472 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094b508-150a-4ea5-af0b-55539ce177c4 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:52.844778 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094b508-150a-4ea5-af0b-55539ce177c4 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:52.845058 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094b508-150a-4ea5-af0b-55539ce177c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:52.863230 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-e094b508-150a-4ea5-af0b-55539ce177c4 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:52.864473 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e094b508-150a-4ea5-af0b-55539ce177c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:52.927145 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1015/2051] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:10:52.938017 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094b508-150a-4ea5-af0b-55539ce177c4 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:52.939606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e094b508-150a-4ea5-af0b-55539ce177c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:52.995694 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094b508-150a-4ea5-af0b-55539ce177c4 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:53.000575 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ba2d0-62f4-44a3-b819-38c07f6ed61f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:53.001492 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ba2d0-62f4-44a3-b819-38c07f6ed61f service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:53.001605 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1037/2052] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:52 2022] DELETE /identity/v3/users/5f6a8844a7724b0485f0b8d38946ef71 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:53.001693 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ba2d0-62f4-44a3-b819-38c07f6ed61f service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:53.001766 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ba2d0-62f4-44a3-b819-38c07f6ed61f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:53.005819 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396b190-b1a1-4c85-aab5-d44c9ced9fa5 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:53.006110 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396b190-b1a1-4c85-aab5-d44c9ced9fa5 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:53.006384 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396b190-b1a1-4c85-aab5-d44c9ced9fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:53.011464 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ba2d0-62f4-44a3-b819-38c07f6ed61f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:53.012873 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ba2d0-62f4-44a3-b819-38c07f6ed61f service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:53.022630 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1016/2053] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:10:53.024116 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-d396b190-b1a1-4c85-aab5-d44c9ced9fa5 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:53.025292 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d396b190-b1a1-4c85-aab5-d44c9ced9fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:53.089797 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1038/2054] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:10:53.099873 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ba2d0-62f4-44a3-b819-38c07f6ed61f service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:53.101392 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-fc7ba2d0-62f4-44a3-b819-38c07f6ed61f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:53.113858 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ba2d0-62f4-44a3-b819-38c07f6ed61f service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:53.161401 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734c72d-2889-4583-b5ba-2c68b872449c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:53.162107 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734c72d-2889-4583-b5ba-2c68b872449c service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:53.162397 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734c72d-2889-4583-b5ba-2c68b872449c service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:53.162701 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734c72d-2889-4583-b5ba-2c68b872449c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:53.173176 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734c72d-2889-4583-b5ba-2c68b872449c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:53.174595 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734c72d-2889-4583-b5ba-2c68b872449c service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:53.184488 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1017/2055] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:53.709645 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396b190-b1a1-4c85-aab5-d44c9ced9fa5 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:53.711420 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d396b190-b1a1-4c85-aab5-d44c9ced9fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:53.725170 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396b190-b1a1-4c85-aab5-d44c9ced9fa5 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:53.730004 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df7a93-a5fa-4e6e-9404-48dfeb5fd797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:53.730887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df7a93-a5fa-4e6e-9404-48dfeb5fd797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:53.731335 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df7a93-a5fa-4e6e-9404-48dfeb5fd797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:53.731634 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df7a93-a5fa-4e6e-9404-48dfeb5fd797 admin admin] PATH_INFO: `/v3/projects/f0d8c9de26d94de69ee0c49bc53101db` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:53.732848 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df7a93-a5fa-4e6e-9404-48dfeb5fd797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0d8c9de26d94de69ee0c49bc53101db)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:53.734903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df7a93-a5fa-4e6e-9404-48dfeb5fd797 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:53.753979 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734c72d-2889-4583-b5ba-2c68b872449c service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:53.755654 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-c734c72d-2889-4583-b5ba-2c68b872449c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:53.778662 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734c72d-2889-4583-b5ba-2c68b872449c service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:53.812627 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e3f6a-98e8-4af3-9959-98a353fef0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:53.813499 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e3f6a-98e8-4af3-9959-98a353fef0b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:53.813782 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e3f6a-98e8-4af3-9959-98a353fef0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:53.814060 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e3f6a-98e8-4af3-9959-98a353fef0b1 admin admin] PATH_INFO: `/v3/projects/676f9103593c45b4a31daa80ff164f6a` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:53.817634 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e3f6a-98e8-4af3-9959-98a353fef0b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=676f9103593c45b4a31daa80ff164f6a)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:53.829113 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e3f6a-98e8-4af3-9959-98a353fef0b1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:53.912651 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-86df7a93-a5fa-4e6e-9404-48dfeb5fd797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0d8c9de26d94de69ee0c49bc53101db', 'request_id': 'req-86df7a93-a5fa-4e6e-9404-48dfeb5fd797'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:53.953748 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-110e3f6a-98e8-4af3-9959-98a353fef0b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '676f9103593c45b4a31daa80ff164f6a', 'request_id': 'req-110e3f6a-98e8-4af3-9959-98a353fef0b1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:54.054637 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-86df7a93-a5fa-4e6e-9404-48dfeb5fd797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0d8c9de26d94de69ee0c49bc53101db', 'request_id': 'req-86df7a93-a5fa-4e6e-9404-48dfeb5fd797'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:54.060967 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-86df7a93-a5fa-4e6e-9404-48dfeb5fd797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0d8c9de26d94de69ee0c49bc53101db', 'request_id': 'req-86df7a93-a5fa-4e6e-9404-48dfeb5fd797'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:54.072557 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-86df7a93-a5fa-4e6e-9404-48dfeb5fd797 admin admin] The token cache is being invalidate because project f0d8c9de26d94de69ee0c49bc53101db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:54.072875 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-86df7a93-a5fa-4e6e-9404-48dfeb5fd797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:54.073529 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-86df7a93-a5fa-4e6e-9404-48dfeb5fd797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:54.075121 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1039/2056] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:53 2022] DELETE /identity/v3/projects/f0d8c9de26d94de69ee0c49bc53101db => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:54.079620 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df7a93-a5fa-4e6e-9404-48dfeb5fd797 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:54.080920 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-86df7a93-a5fa-4e6e-9404-48dfeb5fd797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:54.153037 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df7a93-a5fa-4e6e-9404-48dfeb5fd797 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:54.185779 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-110e3f6a-98e8-4af3-9959-98a353fef0b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '676f9103593c45b4a31daa80ff164f6a', 'request_id': 'req-110e3f6a-98e8-4af3-9959-98a353fef0b1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:54.192229 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-110e3f6a-98e8-4af3-9959-98a353fef0b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '676f9103593c45b4a31daa80ff164f6a', 'request_id': 'req-110e3f6a-98e8-4af3-9959-98a353fef0b1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:54.206063 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-110e3f6a-98e8-4af3-9959-98a353fef0b1 admin admin] The token cache is being invalidate because project 676f9103593c45b4a31daa80ff164f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:54.206063 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-110e3f6a-98e8-4af3-9959-98a353fef0b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:54.206063 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-110e3f6a-98e8-4af3-9959-98a353fef0b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:54.207295 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1018/2057] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:53 2022] DELETE /identity/v3/projects/676f9103593c45b4a31daa80ff164f6a => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:54.211132 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e3f6a-98e8-4af3-9959-98a353fef0b1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:54.212521 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-110e3f6a-98e8-4af3-9959-98a353fef0b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:54.216229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb9906-cf95-4d30-beb3-5ce970c742c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:54.217098 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb9906-cf95-4d30-beb3-5ce970c742c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:54.217375 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb9906-cf95-4d30-beb3-5ce970c742c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:54.217719 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb9906-cf95-4d30-beb3-5ce970c742c1 admin admin] PATH_INFO: `/v3/users/465c17ccdf9c4bfa8aa74c4b42e8f2bc` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:54.218948 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb9906-cf95-4d30-beb3-5ce970c742c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=465c17ccdf9c4bfa8aa74c4b42e8f2bc)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:54.220942 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb9906-cf95-4d30-beb3-5ce970c742c1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:54.225682 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e3f6a-98e8-4af3-9959-98a353fef0b1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:54.230353 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd2d1f-2c83-4954-bd6f-5957ef6ceb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:54.232256 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd2d1f-2c83-4954-bd6f-5957ef6ceb1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:54.232597 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd2d1f-2c83-4954-bd6f-5957ef6ceb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:54.232940 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd2d1f-2c83-4954-bd6f-5957ef6ceb1d admin admin] PATH_INFO: `/v3/users/f367a246e5364af4a691822cfb6ee74a` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:54.234378 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd2d1f-2c83-4954-bd6f-5957ef6ceb1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f367a246e5364af4a691822cfb6ee74a)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:54.236312 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd2d1f-2c83-4954-bd6f-5957ef6ceb1d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:54.504332 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-fcfb9906-cf95-4d30-beb3-5ce970c742c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '465c17ccdf9c4bfa8aa74c4b42e8f2bc'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:54.504929 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-fcfb9906-cf95-4d30-beb3-5ce970c742c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '465c17ccdf9c4bfa8aa74c4b42e8f2bc'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:54.517067 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-fcfb9906-cf95-4d30-beb3-5ce970c742c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '465c17ccdf9c4bfa8aa74c4b42e8f2bc'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:54.520254 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-3dfd2d1f-2c83-4954-bd6f-5957ef6ceb1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f367a246e5364af4a691822cfb6ee74a'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:54.520973 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-3dfd2d1f-2c83-4954-bd6f-5957ef6ceb1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f367a246e5364af4a691822cfb6ee74a'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:54.523747 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-fcfb9906-cf95-4d30-beb3-5ce970c742c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '465c17ccdf9c4bfa8aa74c4b42e8f2bc'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:54.524445 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-fcfb9906-cf95-4d30-beb3-5ce970c742c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '465c17ccdf9c4bfa8aa74c4b42e8f2bc'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:54.534122 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-3dfd2d1f-2c83-4954-bd6f-5957ef6ceb1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f367a246e5364af4a691822cfb6ee74a'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:54.540846 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-3dfd2d1f-2c83-4954-bd6f-5957ef6ceb1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f367a246e5364af4a691822cfb6ee74a'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:54.611076 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1040/2058] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:54 2022] DELETE /identity/v3/users/465c17ccdf9c4bfa8aa74c4b42e8f2bc => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:10:54.684559 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-3dfd2d1f-2c83-4954-bd6f-5957ef6ceb1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f367a246e5364af4a691822cfb6ee74a'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:54.691929 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1019/2059] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:54 2022] DELETE /identity/v3/users/f367a246e5364af4a691822cfb6ee74a => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:10:55.108555 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb9906-cf95-4d30-beb3-5ce970c742c1 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:55.110914 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-fcfb9906-cf95-4d30-beb3-5ce970c742c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:55.176836 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb9906-cf95-4d30-beb3-5ce970c742c1 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:55.201979 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd2d1f-2c83-4954-bd6f-5957ef6ceb1d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:55.210518 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-3dfd2d1f-2c83-4954-bd6f-5957ef6ceb1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:55.250063 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bc962-1e6c-41c1-a51e-9affe711d425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:55.251521 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bc962-1e6c-41c1-a51e-9affe711d425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:55.252441 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bc962-1e6c-41c1-a51e-9affe711d425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:55.252720 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bc962-1e6c-41c1-a51e-9affe711d425 admin admin] PATH_INFO: `/v3/projects/9c4fefdd8ea34e39951197da08287d4d` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:55.254947 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bc962-1e6c-41c1-a51e-9affe711d425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4fefdd8ea34e39951197da08287d4d)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:55.257032 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bc962-1e6c-41c1-a51e-9affe711d425 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:55.301227 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd2d1f-2c83-4954-bd6f-5957ef6ceb1d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:55.301435 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35496048-6bc8-4775-b3e6-98eebb78e5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:55.302224 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35496048-6bc8-4775-b3e6-98eebb78e5e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:55.302504 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35496048-6bc8-4775-b3e6-98eebb78e5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:55.302812 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35496048-6bc8-4775-b3e6-98eebb78e5e8 admin admin] PATH_INFO: `/v3/projects/15c6d32ccb814011923fef954f65fbb4` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:55.304015 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35496048-6bc8-4775-b3e6-98eebb78e5e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15c6d32ccb814011923fef954f65fbb4)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:55.305922 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35496048-6bc8-4775-b3e6-98eebb78e5e8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:55.380194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-466bc962-1e6c-41c1-a51e-9affe711d425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4fefdd8ea34e39951197da08287d4d', 'request_id': 'req-466bc962-1e6c-41c1-a51e-9affe711d425'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:55.414117 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-35496048-6bc8-4775-b3e6-98eebb78e5e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c6d32ccb814011923fef954f65fbb4', 'request_id': 'req-35496048-6bc8-4775-b3e6-98eebb78e5e8'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:55.484215 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-466bc962-1e6c-41c1-a51e-9affe711d425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4fefdd8ea34e39951197da08287d4d', 'request_id': 'req-466bc962-1e6c-41c1-a51e-9affe711d425'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:55.490304 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-466bc962-1e6c-41c1-a51e-9affe711d425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4fefdd8ea34e39951197da08287d4d', 'request_id': 'req-466bc962-1e6c-41c1-a51e-9affe711d425'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:55.501811 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-466bc962-1e6c-41c1-a51e-9affe711d425 admin admin] The token cache is being invalidate because project 9c4fefdd8ea34e39951197da08287d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:55.502101 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-466bc962-1e6c-41c1-a51e-9affe711d425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:55.504032 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-466bc962-1e6c-41c1-a51e-9affe711d425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:55.504434 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1041/2060] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:55 2022] DELETE /identity/v3/projects/9c4fefdd8ea34e39951197da08287d4d => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:10:55.509069 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87063799-f139-4860-ac73-d9ae03182192 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:55.509357 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87063799-f139-4860-ac73-d9ae03182192 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:55.509639 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87063799-f139-4860-ac73-d9ae03182192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:55.528106 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-87063799-f139-4860-ac73-d9ae03182192 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:55.529985 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-87063799-f139-4860-ac73-d9ae03182192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:55.552807 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-35496048-6bc8-4775-b3e6-98eebb78e5e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c6d32ccb814011923fef954f65fbb4', 'request_id': 'req-35496048-6bc8-4775-b3e6-98eebb78e5e8'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:55.558776 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-35496048-6bc8-4775-b3e6-98eebb78e5e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c6d32ccb814011923fef954f65fbb4', 'request_id': 'req-35496048-6bc8-4775-b3e6-98eebb78e5e8'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:55.570233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-35496048-6bc8-4775-b3e6-98eebb78e5e8 admin admin] The token cache is being invalidate because project 15c6d32ccb814011923fef954f65fbb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:55.570532 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-35496048-6bc8-4775-b3e6-98eebb78e5e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:55.571383 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-35496048-6bc8-4775-b3e6-98eebb78e5e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:55.573162 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1020/2061] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:55 2022] DELETE /identity/v3/projects/15c6d32ccb814011923fef954f65fbb4 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:55.577800 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35496048-6bc8-4775-b3e6-98eebb78e5e8 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:55.579387 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-35496048-6bc8-4775-b3e6-98eebb78e5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:55.596599 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1042/2062] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:10:55.604152 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4864-87cf-452b-aa11-42571b48a770 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:55.604443 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4864-87cf-452b-aa11-42571b48a770 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:55.607309 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4864-87cf-452b-aa11-42571b48a770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:55.623320 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-bffa4864-87cf-452b-aa11-42571b48a770 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:55.624849 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-bffa4864-87cf-452b-aa11-42571b48a770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:55.633250 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1043/2063] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:10:55.637397 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4864-87cf-452b-aa11-42571b48a770 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:55.643709 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35496048-6bc8-4775-b3e6-98eebb78e5e8 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:55.646746 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4864-87cf-452b-aa11-42571b48a770 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:55.648412 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f5fdf-ad9a-4a93-bd30-91ecb12fcc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:55.649263 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f5fdf-ad9a-4a93-bd30-91ecb12fcc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:55.649589 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f5fdf-ad9a-4a93-bd30-91ecb12fcc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:55.649806 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f5fdf-ad9a-4a93-bd30-91ecb12fcc37 admin admin] PATH_INFO: `/v3/users/dfa65fba039049beb91137127a998566` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:55.651034 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f5fdf-ad9a-4a93-bd30-91ecb12fcc37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa65fba039049beb91137127a998566)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:55.651563 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac959f1a-c3a3-4928-adb6-95a9041c718d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:55.652194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac959f1a-c3a3-4928-adb6-95a9041c718d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:55.652477 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac959f1a-c3a3-4928-adb6-95a9041c718d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:55.652756 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac959f1a-c3a3-4928-adb6-95a9041c718d admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:55.652850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f5fdf-ad9a-4a93-bd30-91ecb12fcc37 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:55.653466 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac959f1a-c3a3-4928-adb6-95a9041c718d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:10:55.653773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac959f1a-c3a3-4928-adb6-95a9041c718d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:55.656049 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac959f1a-c3a3-4928-adb6-95a9041c718d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:55.667251 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1044/2064] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 17:10:55.671535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac959f1a-c3a3-4928-adb6-95a9041c718d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:55.680842 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac959f1a-c3a3-4928-adb6-95a9041c718d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:55.685494 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7195dec-aa76-4de4-98c6-853401128ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:55.686146 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7195dec-aa76-4de4-98c6-853401128ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:55.694072 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7195dec-aa76-4de4-98c6-853401128ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:55.694072 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7195dec-aa76-4de4-98c6-853401128ea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:55.694072 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7195dec-aa76-4de4-98c6-853401128ea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:55.694072 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7195dec-aa76-4de4-98c6-853401128ea1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:55.788343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1045/2065] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:55 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:10:55.792551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7195dec-aa76-4de4-98c6-853401128ea1 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:55.850900 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7195dec-aa76-4de4-98c6-853401128ea1 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:55.855876 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195f25b-4f56-46db-86b0-308816ab67e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:55.856550 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195f25b-4f56-46db-86b0-308816ab67e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:55.856826 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195f25b-4f56-46db-86b0-308816ab67e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:55.857093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195f25b-4f56-46db-86b0-308816ab67e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:55.857762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195f25b-4f56-46db-86b0-308816ab67e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:55.860151 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195f25b-4f56-46db-86b0-308816ab67e2 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:55.875687 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-8a9f5fdf-ad9a-4a93-bd30-91ecb12fcc37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa65fba039049beb91137127a998566'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:55.876336 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-8a9f5fdf-ad9a-4a93-bd30-91ecb12fcc37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa65fba039049beb91137127a998566'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:55.887480 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-8a9f5fdf-ad9a-4a93-bd30-91ecb12fcc37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa65fba039049beb91137127a998566'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:55.894885 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-8a9f5fdf-ad9a-4a93-bd30-91ecb12fcc37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa65fba039049beb91137127a998566'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:55.970552 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1046/2066] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:55 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:10:55.974717 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195f25b-4f56-46db-86b0-308816ab67e2 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:55.976320 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a195f25b-4f56-46db-86b0-308816ab67e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:55.988450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195f25b-4f56-46db-86b0-308816ab67e2 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:55.992826 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-8a9f5fdf-ad9a-4a93-bd30-91ecb12fcc37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa65fba039049beb91137127a998566'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:55.993865 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df48b2b-daa7-4a19-9057-e9265d399823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:55.997986 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df48b2b-daa7-4a19-9057-e9265d399823 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:55.997986 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df48b2b-daa7-4a19-9057-e9265d399823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:55.997986 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df48b2b-daa7-4a19-9057-e9265d399823 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:55.997986 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df48b2b-daa7-4a19-9057-e9265d399823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:55.997986 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df48b2b-daa7-4a19-9057-e9265d399823 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:55.999761 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1021/2067] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:55 2022] DELETE /identity/v3/users/dfa65fba039049beb91137127a998566 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:56.008449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1047/2068] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:10:56.012284 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f5fdf-ad9a-4a93-bd30-91ecb12fcc37 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:56.073807 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f5fdf-ad9a-4a93-bd30-91ecb12fcc37 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:56.079956 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cd79f-7f9d-4cbc-b286-3f5af521153a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:56.080636 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cd79f-7f9d-4cbc-b286-3f5af521153a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:56.080949 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cd79f-7f9d-4cbc-b286-3f5af521153a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:56.081229 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cd79f-7f9d-4cbc-b286-3f5af521153a admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:56.081960 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cd79f-7f9d-4cbc-b286-3f5af521153a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:56.083605 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cd79f-7f9d-4cbc-b286-3f5af521153a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:56.093526 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1022/2069] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:56.097685 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df48b2b-daa7-4a19-9057-e9265d399823 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:56.107806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df48b2b-daa7-4a19-9057-e9265d399823 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:56.113217 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea4f73-630e-4ff6-846e-dae1309bdf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:56.114096 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea4f73-630e-4ff6-846e-dae1309bdf15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:56.114377 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea4f73-630e-4ff6-846e-dae1309bdf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:56.114673 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea4f73-630e-4ff6-846e-dae1309bdf15 admin admin] PATH_INFO: `/v3/projects/a9151c121aff40dabbcc58ff70ec43c8/users/f5bb95d7c4ed4beb96c36bc0b2a2d57c/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:56.131656 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea4f73-630e-4ff6-846e-dae1309bdf15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9151c121aff40dabbcc58ff70ec43c8, user_id=f5bb95d7c4ed4beb96c36bc0b2a2d57c, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:56.134277 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea4f73-630e-4ff6-846e-dae1309bdf15 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:56.227677 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1048/2070] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:56 2022] PUT /identity/v3/projects/a9151c121aff40dabbcc58ff70ec43c8/users/f5bb95d7c4ed4beb96c36bc0b2a2d57c/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:10:56.241213 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce624a24-d181-4d1a-a735-0dfd28f57e17 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:56.246864 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce624a24-d181-4d1a-a735-0dfd28f57e17 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:56.247181 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce624a24-d181-4d1a-a735-0dfd28f57e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:56.284014 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-ce624a24-d181-4d1a-a735-0dfd28f57e17 None None] MFA Rules not processed for user `f5bb95d7c4ed4beb96c36bc0b2a2d57c`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:56.285281 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-ce624a24-d181-4d1a-a735-0dfd28f57e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:56.360602 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1023/2071] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:56.371441 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea4f73-630e-4ff6-846e-dae1309bdf15 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:56.373212 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-16ea4f73-630e-4ff6-846e-dae1309bdf15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:56.430071 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea4f73-630e-4ff6-846e-dae1309bdf15 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:56.433809 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ab8ac-f9bb-417c-a0a7-c0800d3cfcc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:56.434441 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ab8ac-f9bb-417c-a0a7-c0800d3cfcc1 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:56.434759 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ab8ac-f9bb-417c-a0a7-c0800d3cfcc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:56.435036 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ab8ac-f9bb-417c-a0a7-c0800d3cfcc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:56.444233 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ab8ac-f9bb-417c-a0a7-c0800d3cfcc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:56.445696 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ab8ac-f9bb-417c-a0a7-c0800d3cfcc1 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:56.454708 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1049/2072] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:56.503589 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce624a24-d181-4d1a-a735-0dfd28f57e17 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:56.505130 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-ce624a24-d181-4d1a-a735-0dfd28f57e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:56.580959 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce624a24-d181-4d1a-a735-0dfd28f57e17 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:56.597710 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb9b4e-178b-4337-9ac2-b9459229f761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:56.598587 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb9b4e-178b-4337-9ac2-b9459229f761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:56.599224 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb9b4e-178b-4337-9ac2-b9459229f761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:56.599224 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb9b4e-178b-4337-9ac2-b9459229f761 admin admin] PATH_INFO: `/v3/projects/a755006aa0634fd4a3591c454a1f2b4f` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:56.601525 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb9b4e-178b-4337-9ac2-b9459229f761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a755006aa0634fd4a3591c454a1f2b4f)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:56.602443 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb9b4e-178b-4337-9ac2-b9459229f761 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:56.706467 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b4eb9b4e-178b-4337-9ac2-b9459229f761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a755006aa0634fd4a3591c454a1f2b4f', 'request_id': 'req-b4eb9b4e-178b-4337-9ac2-b9459229f761'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:56.894527 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b4eb9b4e-178b-4337-9ac2-b9459229f761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a755006aa0634fd4a3591c454a1f2b4f', 'request_id': 'req-b4eb9b4e-178b-4337-9ac2-b9459229f761'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:56.900363 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b4eb9b4e-178b-4337-9ac2-b9459229f761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a755006aa0634fd4a3591c454a1f2b4f', 'request_id': 'req-b4eb9b4e-178b-4337-9ac2-b9459229f761'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:56.912118 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b4eb9b4e-178b-4337-9ac2-b9459229f761 admin admin] The token cache is being invalidate because project a755006aa0634fd4a3591c454a1f2b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:10:56.912405 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b4eb9b4e-178b-4337-9ac2-b9459229f761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:56.913038 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b4eb9b4e-178b-4337-9ac2-b9459229f761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:56.914592 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1024/2073] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:10:56 2022] DELETE /identity/v3/projects/a755006aa0634fd4a3591c454a1f2b4f => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:56.920922 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf890a-0498-4500-9e01-65135fc62387 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:56.921247 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf890a-0498-4500-9e01-65135fc62387 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:56.921535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf890a-0498-4500-9e01-65135fc62387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:56.939365 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-aacf890a-0498-4500-9e01-65135fc62387 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:56.940543 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-aacf890a-0498-4500-9e01-65135fc62387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:56.997903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1050/2074] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:57.006586 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a1493-c16b-4a8c-a093-48dc850e2ed6 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:57.006904 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a1493-c16b-4a8c-a093-48dc850e2ed6 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:57.007180 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a1493-c16b-4a8c-a093-48dc850e2ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:57.026050 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-a39a1493-c16b-4a8c-a093-48dc850e2ed6 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:57.027554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-a39a1493-c16b-4a8c-a093-48dc850e2ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:57.036406 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1025/2075] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:57.041642 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf890a-0498-4500-9e01-65135fc62387 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:57.052361 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf890a-0498-4500-9e01-65135fc62387 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:57.057283 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f03ba-a4e8-4e12-a731-46a3cdd70790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:57.057953 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f03ba-a4e8-4e12-a731-46a3cdd70790 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:57.058230 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f03ba-a4e8-4e12-a731-46a3cdd70790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:57.058507 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f03ba-a4e8-4e12-a731-46a3cdd70790 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:57.059258 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f03ba-a4e8-4e12-a731-46a3cdd70790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:10:57.059564 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f03ba-a4e8-4e12-a731-46a3cdd70790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:57.061180 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f03ba-a4e8-4e12-a731-46a3cdd70790 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:57.073953 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1051/2076] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:10:57.078868 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a1493-c16b-4a8c-a093-48dc850e2ed6 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:57.087792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a1493-c16b-4a8c-a093-48dc850e2ed6 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:57.092431 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956a7e6-60e3-48fe-ab1a-8aec37239f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:57.093646 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956a7e6-60e3-48fe-ab1a-8aec37239f88 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:57.093926 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956a7e6-60e3-48fe-ab1a-8aec37239f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:57.094201 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956a7e6-60e3-48fe-ab1a-8aec37239f88 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:57.094934 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956a7e6-60e3-48fe-ab1a-8aec37239f88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:57.096809 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956a7e6-60e3-48fe-ab1a-8aec37239f88 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:57.205560 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1026/2077] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:57 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:10:57.210308 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f03ba-a4e8-4e12-a731-46a3cdd70790 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:57.221087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f03ba-a4e8-4e12-a731-46a3cdd70790 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:57.292051 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2a1ee-3fa3-4b26-8dbe-e2ad25d562dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:57.292719 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2a1ee-3fa3-4b26-8dbe-e2ad25d562dd admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:57.293055 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2a1ee-3fa3-4b26-8dbe-e2ad25d562dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:57.293263 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2a1ee-3fa3-4b26-8dbe-e2ad25d562dd admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:57.293950 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2a1ee-3fa3-4b26-8dbe-e2ad25d562dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:57.297250 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2a1ee-3fa3-4b26-8dbe-e2ad25d562dd admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:57.422772 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1052/2078] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:57 2022] POST /identity/v3/users => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:57.425503 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956a7e6-60e3-48fe-ab1a-8aec37239f88 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:57.436679 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956a7e6-60e3-48fe-ab1a-8aec37239f88 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:57.441555 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a33fc-54c8-43be-b204-88c600bdd15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:57.442215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a33fc-54c8-43be-b204-88c600bdd15a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:57.442487 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a33fc-54c8-43be-b204-88c600bdd15a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:57.442805 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a33fc-54c8-43be-b204-88c600bdd15a admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:57.443602 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a33fc-54c8-43be-b204-88c600bdd15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:57.445168 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a33fc-54c8-43be-b204-88c600bdd15a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:57.455577 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1027/2079] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:57.459693 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2a1ee-3fa3-4b26-8dbe-e2ad25d562dd admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:57.470169 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2a1ee-3fa3-4b26-8dbe-e2ad25d562dd admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:57.475009 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c57ebf-857d-4e81-96e1-6fb85bc6f9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:57.475692 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c57ebf-857d-4e81-96e1-6fb85bc6f9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:57.475975 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c57ebf-857d-4e81-96e1-6fb85bc6f9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:57.476246 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c57ebf-857d-4e81-96e1-6fb85bc6f9b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:57.476958 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c57ebf-857d-4e81-96e1-6fb85bc6f9b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:57.478528 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c57ebf-857d-4e81-96e1-6fb85bc6f9b1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:57.489141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1053/2080] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:57.500199 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a33fc-54c8-43be-b204-88c600bdd15a admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:57.509777 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a33fc-54c8-43be-b204-88c600bdd15a admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:57.514367 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aca5e1-3abc-49d5-b2a8-e7f7ec106606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:57.515703 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aca5e1-3abc-49d5-b2a8-e7f7ec106606 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:57.515982 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aca5e1-3abc-49d5-b2a8-e7f7ec106606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:57.516255 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aca5e1-3abc-49d5-b2a8-e7f7ec106606 admin admin] PATH_INFO: `/v3/projects/b5a4ad1197894218b2ed61f714d0a66d/users/42702241ee514dbd9d51e787f80bb550/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:57.531143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aca5e1-3abc-49d5-b2a8-e7f7ec106606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a4ad1197894218b2ed61f714d0a66d, user_id=42702241ee514dbd9d51e787f80bb550, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:57.534182 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aca5e1-3abc-49d5-b2a8-e7f7ec106606 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:57.631708 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1028/2081] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:57 2022] PUT /identity/v3/projects/b5a4ad1197894218b2ed61f714d0a66d/users/42702241ee514dbd9d51e787f80bb550/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:57.644732 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8abd3-4020-4943-badc-7f7a151128ff None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:57.651638 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8abd3-4020-4943-badc-7f7a151128ff None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:57.651638 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8abd3-4020-4943-badc-7f7a151128ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:57.672780 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-bba8abd3-4020-4943-badc-7f7a151128ff None None] MFA Rules not processed for user `42702241ee514dbd9d51e787f80bb550`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:57.673896 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-bba8abd3-4020-4943-badc-7f7a151128ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:57.735872 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1054/2082] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:10:57.740521 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aca5e1-3abc-49d5-b2a8-e7f7ec106606 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:57.799316 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aca5e1-3abc-49d5-b2a8-e7f7ec106606 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:57.803899 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84be80-38ae-49e7-91c9-0b1c216b0a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:57.804540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84be80-38ae-49e7-91c9-0b1c216b0a96 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:57.804820 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84be80-38ae-49e7-91c9-0b1c216b0a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:57.805092 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84be80-38ae-49e7-91c9-0b1c216b0a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:57.805790 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84be80-38ae-49e7-91c9-0b1c216b0a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:57.807719 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84be80-38ae-49e7-91c9-0b1c216b0a96 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:57.902455 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1029/2083] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:10:57 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:10:57.907407 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8abd3-4020-4943-badc-7f7a151128ff None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:57.918037 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8abd3-4020-4943-badc-7f7a151128ff None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:57.973047 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289712b-07fe-458d-bd8f-103f260a5141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:57.973664 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289712b-07fe-458d-bd8f-103f260a5141 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:57.973947 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289712b-07fe-458d-bd8f-103f260a5141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:57.974226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289712b-07fe-458d-bd8f-103f260a5141 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:57.974970 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289712b-07fe-458d-bd8f-103f260a5141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:57.976877 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289712b-07fe-458d-bd8f-103f260a5141 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:58.090196 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1055/2084] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:10:57 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:10:58.095064 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84be80-38ae-49e7-91c9-0b1c216b0a96 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:58.105930 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84be80-38ae-49e7-91c9-0b1c216b0a96 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:58.111417 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22151b-44b1-4594-95d3-b74390860748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:58.112136 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22151b-44b1-4594-95d3-b74390860748 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:58.112415 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22151b-44b1-4594-95d3-b74390860748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:58.112687 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22151b-44b1-4594-95d3-b74390860748 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:58.113428 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22151b-44b1-4594-95d3-b74390860748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:58.115062 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22151b-44b1-4594-95d3-b74390860748 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:58.125526 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1030/2085] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:58.129565 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289712b-07fe-458d-bd8f-103f260a5141 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:58.139546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289712b-07fe-458d-bd8f-103f260a5141 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:58.144220 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059cbb9-1257-4edd-9899-776c97a29e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:58.145086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059cbb9-1257-4edd-9899-776c97a29e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:58.145371 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059cbb9-1257-4edd-9899-776c97a29e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:58.145648 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059cbb9-1257-4edd-9899-776c97a29e0d admin admin] PATH_INFO: `/v3/projects/871ac384880e4bba96b75e53b8581133/users/fb80f933103549a1b974c09703f9a582/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:58.161014 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059cbb9-1257-4edd-9899-776c97a29e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=871ac384880e4bba96b75e53b8581133, user_id=fb80f933103549a1b974c09703f9a582, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:58.163653 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059cbb9-1257-4edd-9899-776c97a29e0d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:58.289984 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1056/2086] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:58 2022] PUT /identity/v3/projects/871ac384880e4bba96b75e53b8581133/users/fb80f933103549a1b974c09703f9a582/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:58.293855 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22151b-44b1-4594-95d3-b74390860748 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:58.305035 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22151b-44b1-4594-95d3-b74390860748 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:58.367124 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998e22c-ab99-42bd-acca-2545cba79b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:58.367124 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998e22c-ab99-42bd-acca-2545cba79b38 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:58.367124 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998e22c-ab99-42bd-acca-2545cba79b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:58.367124 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998e22c-ab99-42bd-acca-2545cba79b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:58.374705 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998e22c-ab99-42bd-acca-2545cba79b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:58.374705 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998e22c-ab99-42bd-acca-2545cba79b38 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:58.382317 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1031/2087] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:10:58.383571 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059cbb9-1257-4edd-9899-776c97a29e0d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:58.394572 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059cbb9-1257-4edd-9899-776c97a29e0d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:58.399805 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d0c5a-3d80-44e5-8c75-1dce55a4b4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:58.400691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d0c5a-3d80-44e5-8c75-1dce55a4b4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:58.400968 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d0c5a-3d80-44e5-8c75-1dce55a4b4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:58.401241 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d0c5a-3d80-44e5-8c75-1dce55a4b4eb admin admin] PATH_INFO: `/v3/projects/871ac384880e4bba96b75e53b8581133/users/fb80f933103549a1b974c09703f9a582/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:58.403237 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d0c5a-3d80-44e5-8c75-1dce55a4b4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=871ac384880e4bba96b75e53b8581133, user_id=fb80f933103549a1b974c09703f9a582, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:58.406499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d0c5a-3d80-44e5-8c75-1dce55a4b4eb admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:58.416806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1057/2088] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:10:58 2022] PUT /identity/v3/projects/871ac384880e4bba96b75e53b8581133/users/fb80f933103549a1b974c09703f9a582/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:58.428288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e44fa8-e9e9-4856-9ff8-b0f291d82fff None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:58.428757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e44fa8-e9e9-4856-9ff8-b0f291d82fff None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:58.428874 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e44fa8-e9e9-4856-9ff8-b0f291d82fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:58.456832 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-a6e44fa8-e9e9-4856-9ff8-b0f291d82fff None None] MFA Rules not processed for user `fb80f933103549a1b974c09703f9a582`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:58.458019 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-a6e44fa8-e9e9-4856-9ff8-b0f291d82fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:58.526130 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1032/2089] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:10:58.536884 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d0c5a-3d80-44e5-8c75-1dce55a4b4eb admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:58.538560 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-035d0c5a-3d80-44e5-8c75-1dce55a4b4eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:58.595685 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d0c5a-3d80-44e5-8c75-1dce55a4b4eb admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:58.599235 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3eece-03a9-44b2-848d-809cb11dc955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:58.599867 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3eece-03a9-44b2-848d-809cb11dc955 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:58.600144 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3eece-03a9-44b2-848d-809cb11dc955 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:58.600415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3eece-03a9-44b2-848d-809cb11dc955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:58.610319 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3eece-03a9-44b2-848d-809cb11dc955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:58.611914 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3eece-03a9-44b2-848d-809cb11dc955 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:58.621577 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1058/2090] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:10:59.079846 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e44fa8-e9e9-4856-9ff8-b0f291d82fff None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:59.142895 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e44fa8-e9e9-4856-9ff8-b0f291d82fff None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:59.147456 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0faac8-abef-468e-b78c-b89cd580f3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:59.148305 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0faac8-abef-468e-b78c-b89cd580f3bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:59.148584 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0faac8-abef-468e-b78c-b89cd580f3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:59.148859 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0faac8-abef-468e-b78c-b89cd580f3bf admin admin] PATH_INFO: `/v3/users/42702241ee514dbd9d51e787f80bb550` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:59.150033 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0faac8-abef-468e-b78c-b89cd580f3bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=42702241ee514dbd9d51e787f80bb550)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:59.151945 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0faac8-abef-468e-b78c-b89cd580f3bf admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:59.360129 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-ec0faac8-abef-468e-b78c-b89cd580f3bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42702241ee514dbd9d51e787f80bb550'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:59.360790 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-ec0faac8-abef-468e-b78c-b89cd580f3bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42702241ee514dbd9d51e787f80bb550'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:59.372662 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-ec0faac8-abef-468e-b78c-b89cd580f3bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42702241ee514dbd9d51e787f80bb550'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:59.380163 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-ec0faac8-abef-468e-b78c-b89cd580f3bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42702241ee514dbd9d51e787f80bb550'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:59.461132 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-ec0faac8-abef-468e-b78c-b89cd580f3bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42702241ee514dbd9d51e787f80bb550'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:10:59.467420 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1033/2091] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:10:59 2022] DELETE /identity/v3/users/42702241ee514dbd9d51e787f80bb550 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:10:59.479336 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9658d-1282-4220-aa1c-e781dfa3ca0f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:59.479816 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9658d-1282-4220-aa1c-e781dfa3ca0f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:59.480010 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9658d-1282-4220-aa1c-e781dfa3ca0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:59.498259 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-21c9658d-1282-4220-aa1c-e781dfa3ca0f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:10:59.500464 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-21c9658d-1282-4220-aa1c-e781dfa3ca0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:59.559970 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1059/2092] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:10:59.570315 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0faac8-abef-468e-b78c-b89cd580f3bf admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:10:59.571742 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-ec0faac8-abef-468e-b78c-b89cd580f3bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:10:59.628116 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0faac8-abef-468e-b78c-b89cd580f3bf admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:10:59.631693 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cbc53-b715-452c-9871-ee1bfb0ca1fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:10:59.632322 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cbc53-b715-452c-9871-ee1bfb0ca1fc service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:10:59.632596 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cbc53-b715-452c-9871-ee1bfb0ca1fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:10:59.632867 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cbc53-b715-452c-9871-ee1bfb0ca1fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:10:59.642258 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930cbc53-b715-452c-9871-ee1bfb0ca1fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:10:59.643690 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930cbc53-b715-452c-9871-ee1bfb0ca1fc service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:10:59.652863 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1034/2093] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:11:00.063240 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9658d-1282-4220-aa1c-e781dfa3ca0f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:00.064651 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-21c9658d-1282-4220-aa1c-e781dfa3ca0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:00.076605 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9658d-1282-4220-aa1c-e781dfa3ca0f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:00.081612 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b84b07-f861-4f03-8b06-4bfb76633d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:00.082502 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b84b07-f861-4f03-8b06-4bfb76633d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:00.082879 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b84b07-f861-4f03-8b06-4bfb76633d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:00.083216 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b84b07-f861-4f03-8b06-4bfb76633d9a admin admin] PATH_INFO: `/v3/projects/b5a4ad1197894218b2ed61f714d0a66d` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:00.084417 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b84b07-f861-4f03-8b06-4bfb76633d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a4ad1197894218b2ed61f714d0a66d)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:00.086427 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b84b07-f861-4f03-8b06-4bfb76633d9a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:00.208331 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-26b84b07-f861-4f03-8b06-4bfb76633d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a4ad1197894218b2ed61f714d0a66d', 'request_id': 'req-26b84b07-f861-4f03-8b06-4bfb76633d9a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:00.272590 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-26b84b07-f861-4f03-8b06-4bfb76633d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a4ad1197894218b2ed61f714d0a66d', 'request_id': 'req-26b84b07-f861-4f03-8b06-4bfb76633d9a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:00.278071 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-26b84b07-f861-4f03-8b06-4bfb76633d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a4ad1197894218b2ed61f714d0a66d', 'request_id': 'req-26b84b07-f861-4f03-8b06-4bfb76633d9a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:00.289925 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-26b84b07-f861-4f03-8b06-4bfb76633d9a admin admin] The token cache is being invalidate because project b5a4ad1197894218b2ed61f714d0a66d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:11:00.290208 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-26b84b07-f861-4f03-8b06-4bfb76633d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:00.290911 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-26b84b07-f861-4f03-8b06-4bfb76633d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:00.292431 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1060/2094] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:11:00 2022] DELETE /identity/v3/projects/b5a4ad1197894218b2ed61f714d0a66d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:11:00.297423 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cbc53-b715-452c-9871-ee1bfb0ca1fc service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:00.307427 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cbc53-b715-452c-9871-ee1bfb0ca1fc service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:00.361747 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed34678-e50c-4a8e-9add-119dd3e6c39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:00.362583 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed34678-e50c-4a8e-9add-119dd3e6c39d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:00.362900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed34678-e50c-4a8e-9add-119dd3e6c39d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:00.363177 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed34678-e50c-4a8e-9add-119dd3e6c39d admin admin] PATH_INFO: `/v3/users/fb80f933103549a1b974c09703f9a582` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:00.364368 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed34678-e50c-4a8e-9add-119dd3e6c39d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb80f933103549a1b974c09703f9a582)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:00.366237 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed34678-e50c-4a8e-9add-119dd3e6c39d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:00.602879 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-5ed34678-e50c-4a8e-9add-119dd3e6c39d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb80f933103549a1b974c09703f9a582'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:00.603550 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-5ed34678-e50c-4a8e-9add-119dd3e6c39d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb80f933103549a1b974c09703f9a582'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:00.615718 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-5ed34678-e50c-4a8e-9add-119dd3e6c39d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb80f933103549a1b974c09703f9a582'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:00.622860 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-5ed34678-e50c-4a8e-9add-119dd3e6c39d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb80f933103549a1b974c09703f9a582'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:00.730123 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-5ed34678-e50c-4a8e-9add-119dd3e6c39d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb80f933103549a1b974c09703f9a582'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:00.741064 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1035/2095] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:11:00 2022] DELETE /identity/v3/users/fb80f933103549a1b974c09703f9a582 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:11:01.200108 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b84b07-f861-4f03-8b06-4bfb76633d9a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:01.202542 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-26b84b07-f861-4f03-8b06-4bfb76633d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:01.215390 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b84b07-f861-4f03-8b06-4bfb76633d9a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:01.273806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae6b50-5af5-4df1-bb31-a831106c5d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:01.274585 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae6b50-5af5-4df1-bb31-a831106c5d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:01.274903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae6b50-5af5-4df1-bb31-a831106c5d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:01.275178 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae6b50-5af5-4df1-bb31-a831106c5d04 admin admin] PATH_INFO: `/v3/projects/871ac384880e4bba96b75e53b8581133` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:01.276350 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae6b50-5af5-4df1-bb31-a831106c5d04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=871ac384880e4bba96b75e53b8581133)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:01.278313 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae6b50-5af5-4df1-bb31-a831106c5d04 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:01.479328 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-97ae6b50-5af5-4df1-bb31-a831106c5d04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '871ac384880e4bba96b75e53b8581133', 'request_id': 'req-97ae6b50-5af5-4df1-bb31-a831106c5d04'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:01.678983 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-97ae6b50-5af5-4df1-bb31-a831106c5d04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '871ac384880e4bba96b75e53b8581133', 'request_id': 'req-97ae6b50-5af5-4df1-bb31-a831106c5d04'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:01.688543 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-97ae6b50-5af5-4df1-bb31-a831106c5d04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '871ac384880e4bba96b75e53b8581133', 'request_id': 'req-97ae6b50-5af5-4df1-bb31-a831106c5d04'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:01.704081 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-97ae6b50-5af5-4df1-bb31-a831106c5d04 admin admin] The token cache is being invalidate because project 871ac384880e4bba96b75e53b8581133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:11:01.704374 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-97ae6b50-5af5-4df1-bb31-a831106c5d04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:01.705036 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-97ae6b50-5af5-4df1-bb31-a831106c5d04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:01.707151 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1061/2096] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:11:01 2022] DELETE /identity/v3/projects/871ac384880e4bba96b75e53b8581133 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:01.712156 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5a1ea-bfd6-492d-9dc0-f985c67cde6a None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:01.712679 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5a1ea-bfd6-492d-9dc0-f985c67cde6a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:01.712938 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5a1ea-bfd6-492d-9dc0-f985c67cde6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:01.735748 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-f9c5a1ea-bfd6-492d-9dc0-f985c67cde6a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:01.737014 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f9c5a1ea-bfd6-492d-9dc0-f985c67cde6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:01.796548 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1036/2097] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:01.805421 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b394a3-10d0-4f63-ab3c-4a82d9ed8d4b None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:01.805711 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b394a3-10d0-4f63-ab3c-4a82d9ed8d4b None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:01.805989 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b394a3-10d0-4f63-ab3c-4a82d9ed8d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:01.825041 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-d5b394a3-10d0-4f63-ab3c-4a82d9ed8d4b None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:01.826345 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d5b394a3-10d0-4f63-ab3c-4a82d9ed8d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:01.835966 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1062/2098] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:01.840235 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5a1ea-bfd6-492d-9dc0-f985c67cde6a None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:01.850023 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5a1ea-bfd6-492d-9dc0-f985c67cde6a None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:01.854872 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d33b6-e070-455e-a064-3fb758b6ce44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:01.855515 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d33b6-e070-455e-a064-3fb758b6ce44 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:01.855794 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d33b6-e070-455e-a064-3fb758b6ce44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:01.856067 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d33b6-e070-455e-a064-3fb758b6ce44 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:01.856780 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d33b6-e070-455e-a064-3fb758b6ce44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:11:01.857093 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d33b6-e070-455e-a064-3fb758b6ce44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:01.859016 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d33b6-e070-455e-a064-3fb758b6ce44 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:01.871259 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1037/2099] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 17:11:01.876337 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b394a3-10d0-4f63-ab3c-4a82d9ed8d4b None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:01.885421 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b394a3-10d0-4f63-ab3c-4a82d9ed8d4b None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:01.890935 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422121a-0b85-42b7-a951-b93a22f8967d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:01.891554 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422121a-0b85-42b7-a951-b93a22f8967d admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:01.891830 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422121a-0b85-42b7-a951-b93a22f8967d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:01.892094 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422121a-0b85-42b7-a951-b93a22f8967d admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:01.892782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422121a-0b85-42b7-a951-b93a22f8967d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:01.894664 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422121a-0b85-42b7-a951-b93a22f8967d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:01.986898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1063/2100] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:11:01 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:11:01.991444 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d33b6-e070-455e-a064-3fb758b6ce44 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:02.004092 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d33b6-e070-455e-a064-3fb758b6ce44 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:02.060237 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2209328-a255-4ec7-ab48-913960d0d411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:02.060931 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2209328-a255-4ec7-ab48-913960d0d411 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:02.061747 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2209328-a255-4ec7-ab48-913960d0d411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:02.062353 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2209328-a255-4ec7-ab48-913960d0d411 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:02.063391 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2209328-a255-4ec7-ab48-913960d0d411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:02.065318 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2209328-a255-4ec7-ab48-913960d0d411 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:02.199099 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1038/2101] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:11:01 2022] POST /identity/v3/users => generated 285 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:11:02.203470 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422121a-0b85-42b7-a951-b93a22f8967d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:02.216561 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422121a-0b85-42b7-a951-b93a22f8967d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:02.221634 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a9260-3560-46d7-adae-30728ed3120d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:02.222380 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a9260-3560-46d7-adae-30728ed3120d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:02.223088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a9260-3560-46d7-adae-30728ed3120d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:02.223360 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a9260-3560-46d7-adae-30728ed3120d admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:02.224111 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a9260-3560-46d7-adae-30728ed3120d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:02.225913 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a9260-3560-46d7-adae-30728ed3120d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:02.237318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1064/2102] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:11:02.241213 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2209328-a255-4ec7-ab48-913960d0d411 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:02.253701 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2209328-a255-4ec7-ab48-913960d0d411 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:02.257821 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4ef38-4daa-4b84-9cc0-2ee25f7a1a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:02.259606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4ef38-4daa-4b84-9cc0-2ee25f7a1a80 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:02.259606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4ef38-4daa-4b84-9cc0-2ee25f7a1a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:02.259606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4ef38-4daa-4b84-9cc0-2ee25f7a1a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:02.260002 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4ef38-4daa-4b84-9cc0-2ee25f7a1a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:02.262947 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4ef38-4daa-4b84-9cc0-2ee25f7a1a80 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:02.275176 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1039/2103] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:11:02.276715 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a9260-3560-46d7-adae-30728ed3120d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:02.286867 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a9260-3560-46d7-adae-30728ed3120d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:02.292102 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268e0bf-8906-4f25-84ad-4f04ba7c800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:02.293313 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268e0bf-8906-4f25-84ad-4f04ba7c800d admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:02.293535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268e0bf-8906-4f25-84ad-4f04ba7c800d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:02.293847 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268e0bf-8906-4f25-84ad-4f04ba7c800d admin admin] PATH_INFO: `/v3/projects/63f78708814244819cdb333190650f23/users/6de69d16071448a18486af7f86e1099e/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:02.317732 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268e0bf-8906-4f25-84ad-4f04ba7c800d admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f78708814244819cdb333190650f23, user_id=6de69d16071448a18486af7f86e1099e, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:02.318902 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268e0bf-8906-4f25-84ad-4f04ba7c800d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:02.403730 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1065/2104] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:02 2022] PUT /identity/v3/projects/63f78708814244819cdb333190650f23/users/6de69d16071448a18486af7f86e1099e/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:11:02.409174 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8429c5-8117-40c0-91e0-726a5bf48378 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:02.409453 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8429c5-8117-40c0-91e0-726a5bf48378 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:02.409722 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8429c5-8117-40c0-91e0-726a5bf48378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:02.427689 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-ee8429c5-8117-40c0-91e0-726a5bf48378 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:02.428890 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-ee8429c5-8117-40c0-91e0-726a5bf48378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:02.495511 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1040/2105] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:02.502520 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268e0bf-8906-4f25-84ad-4f04ba7c800d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:02.506117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0268e0bf-8906-4f25-84ad-4f04ba7c800d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:02.554242 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8429c5-8117-40c0-91e0-726a5bf48378 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:02.555928 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-ee8429c5-8117-40c0-91e0-726a5bf48378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:02.568707 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8429c5-8117-40c0-91e0-726a5bf48378 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:02.575459 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2228e1-920c-4fcf-aa14-52ed2a301d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:02.576461 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2228e1-920c-4fcf-aa14-52ed2a301d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:02.580725 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2228e1-920c-4fcf-aa14-52ed2a301d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:02.580725 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2228e1-920c-4fcf-aa14-52ed2a301d15 admin admin] PATH_INFO: `/v3/users/60197e5576eb43e099846bfc42c611a6` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:02.581666 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2228e1-920c-4fcf-aa14-52ed2a301d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60197e5576eb43e099846bfc42c611a6)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:02.584023 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2228e1-920c-4fcf-aa14-52ed2a301d15 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:02.596868 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268e0bf-8906-4f25-84ad-4f04ba7c800d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:02.606991 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09cab9-b8d0-46d6-abd9-143c09956de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:02.609462 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09cab9-b8d0-46d6-abd9-143c09956de6 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:02.609462 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09cab9-b8d0-46d6-abd9-143c09956de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:02.609462 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09cab9-b8d0-46d6-abd9-143c09956de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:02.620376 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09cab9-b8d0-46d6-abd9-143c09956de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:02.621949 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09cab9-b8d0-46d6-abd9-143c09956de6 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:02.637199 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1066/2106] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:11:02.638331 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09cab9-b8d0-46d6-abd9-143c09956de6 service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:02.639742 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-3b09cab9-b8d0-46d6-abd9-143c09956de6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:02.653226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09cab9-b8d0-46d6-abd9-143c09956de6 service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:02.667362 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dd6bf-bf30-42ae-bcb1-2cc8eb4d4c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:02.667362 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dd6bf-bf30-42ae-bcb1-2cc8eb4d4c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:02.667362 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dd6bf-bf30-42ae-bcb1-2cc8eb4d4c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:02.667362 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dd6bf-bf30-42ae-bcb1-2cc8eb4d4c14 admin admin] PATH_INFO: `/v3/users/bb1d6cd3209b42e9805c5947f25dcbc2` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:02.667972 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dd6bf-bf30-42ae-bcb1-2cc8eb4d4c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb1d6cd3209b42e9805c5947f25dcbc2)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:02.667972 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dd6bf-bf30-42ae-bcb1-2cc8eb4d4c14 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:02.814393 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-5c2228e1-920c-4fcf-aa14-52ed2a301d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60197e5576eb43e099846bfc42c611a6'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:02.815190 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-5c2228e1-920c-4fcf-aa14-52ed2a301d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60197e5576eb43e099846bfc42c611a6'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:02.828990 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-5c2228e1-920c-4fcf-aa14-52ed2a301d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60197e5576eb43e099846bfc42c611a6'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:02.836579 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-5c2228e1-920c-4fcf-aa14-52ed2a301d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60197e5576eb43e099846bfc42c611a6'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:02.926290 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-961dd6bf-bf30-42ae-bcb1-2cc8eb4d4c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb1d6cd3209b42e9805c5947f25dcbc2'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:02.927000 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-961dd6bf-bf30-42ae-bcb1-2cc8eb4d4c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb1d6cd3209b42e9805c5947f25dcbc2'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:02.938966 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-961dd6bf-bf30-42ae-bcb1-2cc8eb4d4c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb1d6cd3209b42e9805c5947f25dcbc2'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:02.945549 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-961dd6bf-bf30-42ae-bcb1-2cc8eb4d4c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb1d6cd3209b42e9805c5947f25dcbc2'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:02.946180 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-961dd6bf-bf30-42ae-bcb1-2cc8eb4d4c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb1d6cd3209b42e9805c5947f25dcbc2'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:02.976041 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-5c2228e1-920c-4fcf-aa14-52ed2a301d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60197e5576eb43e099846bfc42c611a6'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:02.982331 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1041/2107] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:11:02 2022] DELETE /identity/v3/users/60197e5576eb43e099846bfc42c611a6 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:03.088481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1067/2108] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:11:02 2022] DELETE /identity/v3/users/bb1d6cd3209b42e9805c5947f25dcbc2 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:03.093943 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281379a2-ee74-42c7-9cde-2d2262b92798 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:03.094269 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281379a2-ee74-42c7-9cde-2d2262b92798 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:03.094502 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281379a2-ee74-42c7-9cde-2d2262b92798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:03.113446 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-281379a2-ee74-42c7-9cde-2d2262b92798 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:03.114814 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-281379a2-ee74-42c7-9cde-2d2262b92798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:03.175642 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1042/2109] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:03.185392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dd6bf-bf30-42ae-bcb1-2cc8eb4d4c14 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:03.187542 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-961dd6bf-bf30-42ae-bcb1-2cc8eb4d4c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:03.242527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dd6bf-bf30-42ae-bcb1-2cc8eb4d4c14 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:03.246073 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d71997-4004-4b78-b955-616daf38fe75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:03.246761 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d71997-4004-4b78-b955-616daf38fe75 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:03.247038 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d71997-4004-4b78-b955-616daf38fe75 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:03.247305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d71997-4004-4b78-b955-616daf38fe75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:03.256847 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d71997-4004-4b78-b955-616daf38fe75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:03.258259 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d71997-4004-4b78-b955-616daf38fe75 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:03.269070 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1068/2110] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:11:03.327650 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281379a2-ee74-42c7-9cde-2d2262b92798 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:03.327650 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-281379a2-ee74-42c7-9cde-2d2262b92798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:03.339735 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281379a2-ee74-42c7-9cde-2d2262b92798 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:03.344433 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016cb6f-dd42-43c1-9da8-0b94c7508731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:03.345345 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016cb6f-dd42-43c1-9da8-0b94c7508731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:03.345686 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016cb6f-dd42-43c1-9da8-0b94c7508731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:03.346064 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016cb6f-dd42-43c1-9da8-0b94c7508731 admin admin] PATH_INFO: `/v3/projects/9a66da4daef8436fb5c15521ca7ca9a7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:03.347343 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016cb6f-dd42-43c1-9da8-0b94c7508731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a66da4daef8436fb5c15521ca7ca9a7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:03.349282 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016cb6f-dd42-43c1-9da8-0b94c7508731 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:03.508974 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-c016cb6f-dd42-43c1-9da8-0b94c7508731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a66da4daef8436fb5c15521ca7ca9a7', 'request_id': 'req-c016cb6f-dd42-43c1-9da8-0b94c7508731'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:03.593654 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-c016cb6f-dd42-43c1-9da8-0b94c7508731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a66da4daef8436fb5c15521ca7ca9a7', 'request_id': 'req-c016cb6f-dd42-43c1-9da8-0b94c7508731'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:03.601585 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-c016cb6f-dd42-43c1-9da8-0b94c7508731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a66da4daef8436fb5c15521ca7ca9a7', 'request_id': 'req-c016cb6f-dd42-43c1-9da8-0b94c7508731'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:03.615528 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-c016cb6f-dd42-43c1-9da8-0b94c7508731 admin admin] The token cache is being invalidate because project 9a66da4daef8436fb5c15521ca7ca9a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:11:03.615815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-c016cb6f-dd42-43c1-9da8-0b94c7508731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:03.616767 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-c016cb6f-dd42-43c1-9da8-0b94c7508731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:03.618372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1043/2111] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:11:03 2022] DELETE /identity/v3/projects/9a66da4daef8436fb5c15521ca7ca9a7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:03.624228 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5da7a-954a-401e-a857-d7c7c6717f0a None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:03.624813 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5da7a-954a-401e-a857-d7c7c6717f0a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:03.625230 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5da7a-954a-401e-a857-d7c7c6717f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:03.645540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-60e5da7a-954a-401e-a857-d7c7c6717f0a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:03.646799 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-60e5da7a-954a-401e-a857-d7c7c6717f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:03.707336 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1069/2112] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:11:03.716143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28bd9c-2203-4fbd-9ebc-f58672b8c59f None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:03.716527 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28bd9c-2203-4fbd-9ebc-f58672b8c59f None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:03.716981 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28bd9c-2203-4fbd-9ebc-f58672b8c59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:03.736845 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-fb28bd9c-2203-4fbd-9ebc-f58672b8c59f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:03.738172 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-fb28bd9c-2203-4fbd-9ebc-f58672b8c59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:03.746686 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1044/2113] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:11:03.751755 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5da7a-954a-401e-a857-d7c7c6717f0a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:03.765518 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5da7a-954a-401e-a857-d7c7c6717f0a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:03.771653 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534e219-9a5c-48bd-abc3-ebd065f60960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:03.772405 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534e219-9a5c-48bd-abc3-ebd065f60960 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:03.772635 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534e219-9a5c-48bd-abc3-ebd065f60960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:03.772910 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534e219-9a5c-48bd-abc3-ebd065f60960 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:03.773801 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534e219-9a5c-48bd-abc3-ebd065f60960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:11:03.774165 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534e219-9a5c-48bd-abc3-ebd065f60960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:03.775906 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534e219-9a5c-48bd-abc3-ebd065f60960 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:03.791215 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1070/2114] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:11:03.795805 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28bd9c-2203-4fbd-9ebc-f58672b8c59f None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:03.815792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28bd9c-2203-4fbd-9ebc-f58672b8c59f None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:03.823656 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca8e61-94d8-47ae-8009-43c43886afa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:03.824605 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca8e61-94d8-47ae-8009-43c43886afa7 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:03.824958 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca8e61-94d8-47ae-8009-43c43886afa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:03.825725 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca8e61-94d8-47ae-8009-43c43886afa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:03.826490 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca8e61-94d8-47ae-8009-43c43886afa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:03.830716 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca8e61-94d8-47ae-8009-43c43886afa7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:03.960756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1045/2115] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:11:03 2022] POST /identity/v3/projects => generated 393 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:11:03.964836 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534e219-9a5c-48bd-abc3-ebd065f60960 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:03.974470 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534e219-9a5c-48bd-abc3-ebd065f60960 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:04.016739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca8e61-94d8-47ae-8009-43c43886afa7 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:04.018618 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-a8ca8e61-94d8-47ae-8009-43c43886afa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:04.060499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d4a18-f3d4-47f6-a482-2588672df5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:04.060499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d4a18-f3d4-47f6-a482-2588672df5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:04.060499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d4a18-f3d4-47f6-a482-2588672df5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:04.060499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d4a18-f3d4-47f6-a482-2588672df5c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:04.060863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d4a18-f3d4-47f6-a482-2588672df5c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:04.062005 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d4a18-f3d4-47f6-a482-2588672df5c6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:04.109577 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca8e61-94d8-47ae-8009-43c43886afa7 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:04.114768 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d3c71-8b95-4a01-be3e-5897d04cca26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:04.115535 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d3c71-8b95-4a01-be3e-5897d04cca26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:04.115819 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d3c71-8b95-4a01-be3e-5897d04cca26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:04.116090 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d3c71-8b95-4a01-be3e-5897d04cca26 admin admin] PATH_INFO: `/v3/projects/c4af4ab43163437b8f0413517fcfa9b9` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:04.117548 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d3c71-8b95-4a01-be3e-5897d04cca26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4af4ab43163437b8f0413517fcfa9b9)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:04.119472 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d3c71-8b95-4a01-be3e-5897d04cca26 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:04.154920 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1071/2116] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:11:03 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:11:04.215134 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d4a18-f3d4-47f6-a482-2588672df5c6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:04.215134 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d4a18-f3d4-47f6-a482-2588672df5c6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:04.215134 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b27ef-f701-4728-b515-066d8d5c960b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:04.215134 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b27ef-f701-4728-b515-066d8d5c960b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:04.215850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b27ef-f701-4728-b515-066d8d5c960b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:04.215850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b27ef-f701-4728-b515-066d8d5c960b admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:04.215850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b27ef-f701-4728-b515-066d8d5c960b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:04.215850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b27ef-f701-4728-b515-066d8d5c960b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:04.215850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1072/2117] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:11:04.215850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b27ef-f701-4728-b515-066d8d5c960b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:04.216288 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b27ef-f701-4728-b515-066d8d5c960b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:04.216692 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63f3f5-e0e1-4d42-8faa-089d7130ebf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:04.217353 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63f3f5-e0e1-4d42-8faa-089d7130ebf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:04.217635 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63f3f5-e0e1-4d42-8faa-089d7130ebf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:04.217909 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63f3f5-e0e1-4d42-8faa-089d7130ebf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:04.218639 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63f3f5-e0e1-4d42-8faa-089d7130ebf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:04.220254 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63f3f5-e0e1-4d42-8faa-089d7130ebf5 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:04.230751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1073/2118] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:11:04.234849 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63f3f5-e0e1-4d42-8faa-089d7130ebf5 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:04.244285 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63f3f5-e0e1-4d42-8faa-089d7130ebf5 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:04.249664 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6efa0-120b-426b-8b54-8e1a15aaca4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:04.250504 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6efa0-120b-426b-8b54-8e1a15aaca4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:04.250818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6efa0-120b-426b-8b54-8e1a15aaca4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:04.251093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6efa0-120b-426b-8b54-8e1a15aaca4b admin admin] PATH_INFO: `/v3/projects/7a140809764f4e2486fbf1776ed9c33c/users/5802e711ef624ead8e35e3fce3455f8c/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:04.265804 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6efa0-120b-426b-8b54-8e1a15aaca4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a140809764f4e2486fbf1776ed9c33c, user_id=5802e711ef624ead8e35e3fce3455f8c, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:04.324049 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6efa0-120b-426b-8b54-8e1a15aaca4b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:04.641311 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1074/2119] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:04 2022] PUT /identity/v3/projects/7a140809764f4e2486fbf1776ed9c33c/users/5802e711ef624ead8e35e3fce3455f8c/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:11:04.652451 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b4301-f6f9-4ace-9c3b-4af72a386ff9 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:04.652451 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b4301-f6f9-4ace-9c3b-4af72a386ff9 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:04.652451 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b4301-f6f9-4ace-9c3b-4af72a386ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:04.652943 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-fb6d3c71-8b95-4a01-be3e-5897d04cca26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4af4ab43163437b8f0413517fcfa9b9', 'request_id': 'req-fb6d3c71-8b95-4a01-be3e-5897d04cca26'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:04.673713 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-619b4301-f6f9-4ace-9c3b-4af72a386ff9 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:04.674945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-619b4301-f6f9-4ace-9c3b-4af72a386ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:04.752782 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-fb6d3c71-8b95-4a01-be3e-5897d04cca26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4af4ab43163437b8f0413517fcfa9b9', 'request_id': 'req-fb6d3c71-8b95-4a01-be3e-5897d04cca26'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:04.761098 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-fb6d3c71-8b95-4a01-be3e-5897d04cca26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4af4ab43163437b8f0413517fcfa9b9', 'request_id': 'req-fb6d3c71-8b95-4a01-be3e-5897d04cca26'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:04.774843 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-fb6d3c71-8b95-4a01-be3e-5897d04cca26 admin admin] The token cache is being invalidate because project c4af4ab43163437b8f0413517fcfa9b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:11:04.775285 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-fb6d3c71-8b95-4a01-be3e-5897d04cca26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:04.776047 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-fb6d3c71-8b95-4a01-be3e-5897d04cca26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:04.777800 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1046/2120] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:11:04 2022] DELETE /identity/v3/projects/c4af4ab43163437b8f0413517fcfa9b9 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:04.783197 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d3c71-8b95-4a01-be3e-5897d04cca26 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:04.784824 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-fb6d3c71-8b95-4a01-be3e-5897d04cca26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:04.804414 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1075/2121] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:04.810832 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d3c71-8b95-4a01-be3e-5897d04cca26 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:04.814948 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b4301-f6f9-4ace-9c3b-4af72a386ff9 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:04.816951 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-619b4301-f6f9-4ace-9c3b-4af72a386ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:04.817868 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff4593-af7b-4fdc-8ec8-b3e6a05830ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:04.818762 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4593-af7b-4fdc-8ec8-b3e6a05830ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:04.819207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4593-af7b-4fdc-8ec8-b3e6a05830ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:04.819870 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4593-af7b-4fdc-8ec8-b3e6a05830ba admin admin] PATH_INFO: `/v3/users/4c1be89a6bab49bcbed6e02f9b9d8fca` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:04.821342 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff4593-af7b-4fdc-8ec8-b3e6a05830ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1be89a6bab49bcbed6e02f9b9d8fca)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:04.823795 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff4593-af7b-4fdc-8ec8-b3e6a05830ba admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:04.892679 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b4301-f6f9-4ace-9c3b-4af72a386ff9 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:04.897299 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6409e-ca28-4431-9038-8da6ab6cbef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:04.897999 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6409e-ca28-4431-9038-8da6ab6cbef8 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:04.898266 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6409e-ca28-4431-9038-8da6ab6cbef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:04.898540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6409e-ca28-4431-9038-8da6ab6cbef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:04.908807 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6409e-ca28-4431-9038-8da6ab6cbef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:04.910183 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6409e-ca28-4431-9038-8da6ab6cbef8 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:04.919926 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1076/2122] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:11:04.921193 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d8267-4f47-444e-968f-9a6c4bf101ff None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:04.921709 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d8267-4f47-444e-968f-9a6c4bf101ff None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:04.922101 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d8267-4f47-444e-968f-9a6c4bf101ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:04.955051 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-d32d8267-4f47-444e-968f-9a6c4bf101ff None None] MFA Rules not processed for user `6de69d16071448a18486af7f86e1099e`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:04.956361 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d32d8267-4f47-444e-968f-9a6c4bf101ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:05.027329 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1077/2123] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:05.032345 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d8267-4f47-444e-968f-9a6c4bf101ff None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:05.033691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d32d8267-4f47-444e-968f-9a6c4bf101ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:05.049017 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d8267-4f47-444e-968f-9a6c4bf101ff None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:05.053576 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d931fd-626d-4969-845b-810187dffe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:05.056647 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d931fd-626d-4969-845b-810187dffe02 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:05.056647 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d931fd-626d-4969-845b-810187dffe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:05.056647 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d931fd-626d-4969-845b-810187dffe02 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:05.056647 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d931fd-626d-4969-845b-810187dffe02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:05.057356 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d931fd-626d-4969-845b-810187dffe02 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:05.094706 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-baff4593-af7b-4fdc-8ec8-b3e6a05830ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1be89a6bab49bcbed6e02f9b9d8fca'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:05.095516 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-baff4593-af7b-4fdc-8ec8-b3e6a05830ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1be89a6bab49bcbed6e02f9b9d8fca'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:05.109858 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-baff4593-af7b-4fdc-8ec8-b3e6a05830ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1be89a6bab49bcbed6e02f9b9d8fca'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:05.116788 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-baff4593-af7b-4fdc-8ec8-b3e6a05830ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1be89a6bab49bcbed6e02f9b9d8fca'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:05.187606 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1078/2124] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:11:05 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:11:05.191599 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d931fd-626d-4969-845b-810187dffe02 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:05.193192 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-47d931fd-626d-4969-845b-810187dffe02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:05.208236 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-baff4593-af7b-4fdc-8ec8-b3e6a05830ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1be89a6bab49bcbed6e02f9b9d8fca'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:05.215796 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1047/2125] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:11:04 2022] DELETE /identity/v3/users/4c1be89a6bab49bcbed6e02f9b9d8fca => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:05.267040 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d931fd-626d-4969-845b-810187dffe02 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:05.347540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb8b02-b089-40d5-970f-df586015f55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:05.348155 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb8b02-b089-40d5-970f-df586015f55b admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:05.348438 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb8b02-b089-40d5-970f-df586015f55b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:05.348735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb8b02-b089-40d5-970f-df586015f55b admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:05.349484 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb8b02-b089-40d5-970f-df586015f55b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:05.351486 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb8b02-b089-40d5-970f-df586015f55b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:05.475147 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1079/2126] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:11:05 2022] POST /identity/v3/users => generated 292 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:11:05.479804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff4593-af7b-4fdc-8ec8-b3e6a05830ba admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:05.491337 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff4593-af7b-4fdc-8ec8-b3e6a05830ba admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:05.504139 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce110ac2-1b6b-4efd-961f-bd3e74642aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:05.504859 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce110ac2-1b6b-4efd-961f-bd3e74642aba admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:05.508499 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce110ac2-1b6b-4efd-961f-bd3e74642aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:05.508499 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce110ac2-1b6b-4efd-961f-bd3e74642aba admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:05.508499 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce110ac2-1b6b-4efd-961f-bd3e74642aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:05.508499 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce110ac2-1b6b-4efd-961f-bd3e74642aba admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:05.522738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1048/2127] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:11:05.524113 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb8b02-b089-40d5-970f-df586015f55b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:05.537236 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb8b02-b089-40d5-970f-df586015f55b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:05.542328 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d88832-0288-42b4-8e0f-1c8f03164248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:05.543892 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d88832-0288-42b4-8e0f-1c8f03164248 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:05.544171 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d88832-0288-42b4-8e0f-1c8f03164248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:05.544437 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d88832-0288-42b4-8e0f-1c8f03164248 admin admin] PATH_INFO: `/v3/projects/2c8cccebbfc24182b49896f016d5b84b/users/3e29ab52bedf49cd95caf440de31f700/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:05.565962 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d88832-0288-42b4-8e0f-1c8f03164248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8cccebbfc24182b49896f016d5b84b, user_id=3e29ab52bedf49cd95caf440de31f700, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:05.568817 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d88832-0288-42b4-8e0f-1c8f03164248 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:05.680001 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1080/2128] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:05 2022] PUT /identity/v3/projects/2c8cccebbfc24182b49896f016d5b84b/users/3e29ab52bedf49cd95caf440de31f700/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:05.683962 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce110ac2-1b6b-4efd-961f-bd3e74642aba admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:05.701850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce110ac2-1b6b-4efd-961f-bd3e74642aba admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:05.705285 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d88832-0288-42b4-8e0f-1c8f03164248 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:05.710787 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-b2d88832-0288-42b4-8e0f-1c8f03164248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:05.773910 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80859a8e-8699-4ce5-8d44-e4c8933de6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:05.774883 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80859a8e-8699-4ce5-8d44-e4c8933de6fd admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:05.775225 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80859a8e-8699-4ce5-8d44-e4c8933de6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:05.775666 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80859a8e-8699-4ce5-8d44-e4c8933de6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:05.776541 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80859a8e-8699-4ce5-8d44-e4c8933de6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:05.778303 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80859a8e-8699-4ce5-8d44-e4c8933de6fd admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:05.789168 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1049/2129] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:11:05.792775 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d88832-0288-42b4-8e0f-1c8f03164248 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:05.793794 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80859a8e-8699-4ce5-8d44-e4c8933de6fd admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:05.799909 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377985ca-34e4-4326-adc6-09e8a065a0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:05.800793 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377985ca-34e4-4326-adc6-09e8a065a0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:05.801068 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377985ca-34e4-4326-adc6-09e8a065a0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:05.801339 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377985ca-34e4-4326-adc6-09e8a065a0dd admin admin] PATH_INFO: `/v3/projects/ff0d5a80ab20424baf0fc1c208b38958` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:05.802528 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377985ca-34e4-4326-adc6-09e8a065a0dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff0d5a80ab20424baf0fc1c208b38958)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:05.804821 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377985ca-34e4-4326-adc6-09e8a065a0dd admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:05.809851 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80859a8e-8699-4ce5-8d44-e4c8933de6fd admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:05.817067 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbe7f9-582f-4876-8f65-a652faf6e8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:05.817959 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbe7f9-582f-4876-8f65-a652faf6e8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:05.818507 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbe7f9-582f-4876-8f65-a652faf6e8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:05.818507 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbe7f9-582f-4876-8f65-a652faf6e8b5 admin admin] PATH_INFO: `/v3/projects/2c8cccebbfc24182b49896f016d5b84b/users/3e29ab52bedf49cd95caf440de31f700/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:05.820739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbe7f9-582f-4876-8f65-a652faf6e8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8cccebbfc24182b49896f016d5b84b, user_id=3e29ab52bedf49cd95caf440de31f700, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:05.823403 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbe7f9-582f-4876-8f65-a652faf6e8b5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:05.835209 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1050/2130] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:05 2022] PUT /identity/v3/projects/2c8cccebbfc24182b49896f016d5b84b/users/3e29ab52bedf49cd95caf440de31f700/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:05.917333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-377985ca-34e4-4326-adc6-09e8a065a0dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff0d5a80ab20424baf0fc1c208b38958', 'request_id': 'req-377985ca-34e4-4326-adc6-09e8a065a0dd'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:05.986920 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-377985ca-34e4-4326-adc6-09e8a065a0dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff0d5a80ab20424baf0fc1c208b38958', 'request_id': 'req-377985ca-34e4-4326-adc6-09e8a065a0dd'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:05.993667 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-377985ca-34e4-4326-adc6-09e8a065a0dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff0d5a80ab20424baf0fc1c208b38958', 'request_id': 'req-377985ca-34e4-4326-adc6-09e8a065a0dd'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:06.008301 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-377985ca-34e4-4326-adc6-09e8a065a0dd admin admin] The token cache is being invalidate because project ff0d5a80ab20424baf0fc1c208b38958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:11:06.008674 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-377985ca-34e4-4326-adc6-09e8a065a0dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:06.009320 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-377985ca-34e4-4326-adc6-09e8a065a0dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:06.011121 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1081/2131] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:11:05 2022] DELETE /identity/v3/projects/ff0d5a80ab20424baf0fc1c208b38958 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:11:06.014879 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbe7f9-582f-4876-8f65-a652faf6e8b5 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:06.019152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-01cbe7f9-582f-4876-8f65-a652faf6e8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:06.083966 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbe7f9-582f-4876-8f65-a652faf6e8b5 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:06.146044 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b646295-6307-43af-85a5-078437aa65ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:06.146938 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b646295-6307-43af-85a5-078437aa65ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:06.147214 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b646295-6307-43af-85a5-078437aa65ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:06.147484 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b646295-6307-43af-85a5-078437aa65ee admin admin] PATH_INFO: `/v3/users/2cf24d4a560d4b4b9b77b71620e80e4e` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:06.148703 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b646295-6307-43af-85a5-078437aa65ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf24d4a560d4b4b9b77b71620e80e4e)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:06.150729 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b646295-6307-43af-85a5-078437aa65ee admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:06.393201 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6b646295-6307-43af-85a5-078437aa65ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf24d4a560d4b4b9b77b71620e80e4e'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:06.397312 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6b646295-6307-43af-85a5-078437aa65ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf24d4a560d4b4b9b77b71620e80e4e'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:06.419581 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6b646295-6307-43af-85a5-078437aa65ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf24d4a560d4b4b9b77b71620e80e4e'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:06.433209 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6b646295-6307-43af-85a5-078437aa65ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf24d4a560d4b4b9b77b71620e80e4e'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:06.547343 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6b646295-6307-43af-85a5-078437aa65ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf24d4a560d4b4b9b77b71620e80e4e'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:06.554468 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1051/2132] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:11:06 2022] DELETE /identity/v3/users/2cf24d4a560d4b4b9b77b71620e80e4e => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:07.286958 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffc842-ab22-489a-b3f8-fb727e7002f3 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:07.287584 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffc842-ab22-489a-b3f8-fb727e7002f3 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:07.287800 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffc842-ab22-489a-b3f8-fb727e7002f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:07.319950 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-0cffc842-ab22-489a-b3f8-fb727e7002f3 None None] MFA Rules not processed for user `3e29ab52bedf49cd95caf440de31f700`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:07.322104 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0cffc842-ab22-489a-b3f8-fb727e7002f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:07.376497 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b646295-6307-43af-85a5-078437aa65ee admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:07.381709 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6b646295-6307-43af-85a5-078437aa65ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:07.415987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1082/2133] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:07 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:07.434747 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffc842-ab22-489a-b3f8-fb727e7002f3 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:07.444716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0cffc842-ab22-489a-b3f8-fb727e7002f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:07.495898 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b646295-6307-43af-85a5-078437aa65ee admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:07.502123 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da960aa1-3394-486f-a719-57221ad8c118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:07.505252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da960aa1-3394-486f-a719-57221ad8c118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:07.505252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da960aa1-3394-486f-a719-57221ad8c118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:07.505252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da960aa1-3394-486f-a719-57221ad8c118 admin admin] PATH_INFO: `/v3/projects/33f58921b0814d27bb7241e4914a9399` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:07.506368 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da960aa1-3394-486f-a719-57221ad8c118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33f58921b0814d27bb7241e4914a9399)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:07.510016 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da960aa1-3394-486f-a719-57221ad8c118 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:07.518092 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffc842-ab22-489a-b3f8-fb727e7002f3 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:07.521710 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d924964-41eb-4d21-b05a-22b1b4c14076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:07.522459 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924964-41eb-4d21-b05a-22b1b4c14076 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:07.522847 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924964-41eb-4d21-b05a-22b1b4c14076 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:07.523497 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924964-41eb-4d21-b05a-22b1b4c14076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:07.525427 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2d924964-41eb-4d21-b05a-22b1b4c14076 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:07.596042 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d924964-41eb-4d21-b05a-22b1b4c14076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:07.597517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d924964-41eb-4d21-b05a-22b1b4c14076 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:07.607189 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1083/2134] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:11:07.652452 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-da960aa1-3394-486f-a719-57221ad8c118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33f58921b0814d27bb7241e4914a9399', 'request_id': 'req-da960aa1-3394-486f-a719-57221ad8c118'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:07.724139 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-da960aa1-3394-486f-a719-57221ad8c118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33f58921b0814d27bb7241e4914a9399', 'request_id': 'req-da960aa1-3394-486f-a719-57221ad8c118'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:07.730370 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-da960aa1-3394-486f-a719-57221ad8c118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33f58921b0814d27bb7241e4914a9399', 'request_id': 'req-da960aa1-3394-486f-a719-57221ad8c118'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:07.743549 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-da960aa1-3394-486f-a719-57221ad8c118 admin admin] The token cache is being invalidate because project 33f58921b0814d27bb7241e4914a9399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:11:07.743842 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-da960aa1-3394-486f-a719-57221ad8c118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:07.744530 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-da960aa1-3394-486f-a719-57221ad8c118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:07.746159 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1052/2135] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:11:07 2022] DELETE /identity/v3/projects/33f58921b0814d27bb7241e4914a9399 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:07.753855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b4bd6-1364-437f-8a1d-86bf9197482a None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:07.754159 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b4bd6-1364-437f-8a1d-86bf9197482a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:07.754410 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b4bd6-1364-437f-8a1d-86bf9197482a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:07.772920 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-180b4bd6-1364-437f-8a1d-86bf9197482a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:07.774204 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-180b4bd6-1364-437f-8a1d-86bf9197482a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:07.832119 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1084/2136] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:07.840122 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07893b-ea56-4857-b1d3-25ff7e1c9840 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:07.840410 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07893b-ea56-4857-b1d3-25ff7e1c9840 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:07.840688 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07893b-ea56-4857-b1d3-25ff7e1c9840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:07.858983 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-de07893b-ea56-4857-b1d3-25ff7e1c9840 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:07.860205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-de07893b-ea56-4857-b1d3-25ff7e1c9840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:07.868540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1053/2137] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:07.872811 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b4bd6-1364-437f-8a1d-86bf9197482a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:07.883239 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b4bd6-1364-437f-8a1d-86bf9197482a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:07.888114 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651870f8-d7d6-4b1f-9ce6-1e8b826f96e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:07.888761 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651870f8-d7d6-4b1f-9ce6-1e8b826f96e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:07.889040 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651870f8-d7d6-4b1f-9ce6-1e8b826f96e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:07.889314 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651870f8-d7d6-4b1f-9ce6-1e8b826f96e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:07.890744 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651870f8-d7d6-4b1f-9ce6-1e8b826f96e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:11:07.891238 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651870f8-d7d6-4b1f-9ce6-1e8b826f96e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:07.892838 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651870f8-d7d6-4b1f-9ce6-1e8b826f96e8 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:07.905420 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1085/2138] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:11:07.909642 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07893b-ea56-4857-b1d3-25ff7e1c9840 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:07.919427 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07893b-ea56-4857-b1d3-25ff7e1c9840 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:07.924236 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07884a38-d3dd-4cc5-805b-9f1be9a1d729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:07.924887 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07884a38-d3dd-4cc5-805b-9f1be9a1d729 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:07.925167 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07884a38-d3dd-4cc5-805b-9f1be9a1d729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:07.925440 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07884a38-d3dd-4cc5-805b-9f1be9a1d729 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:07.926126 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07884a38-d3dd-4cc5-805b-9f1be9a1d729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:07.928043 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07884a38-d3dd-4cc5-805b-9f1be9a1d729 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:08.018980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1054/2139] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:11:07 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:11:08.023511 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651870f8-d7d6-4b1f-9ce6-1e8b826f96e8 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:08.034387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651870f8-d7d6-4b1f-9ce6-1e8b826f96e8 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:08.098663 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c8305-49fa-4ae2-990f-51c693919561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:08.099486 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c8305-49fa-4ae2-990f-51c693919561 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:08.099753 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c8305-49fa-4ae2-990f-51c693919561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:08.100024 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c8305-49fa-4ae2-990f-51c693919561 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:08.100856 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c8305-49fa-4ae2-990f-51c693919561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:08.103023 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c8305-49fa-4ae2-990f-51c693919561 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:08.207737 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1086/2140] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:11:08 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:11:08.208893 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07884a38-d3dd-4cc5-805b-9f1be9a1d729 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:08.219565 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07884a38-d3dd-4cc5-805b-9f1be9a1d729 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:08.224660 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422c364-f48a-44bc-afc0-ba0a5290d3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:08.225324 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422c364-f48a-44bc-afc0-ba0a5290d3bb admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:08.225631 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422c364-f48a-44bc-afc0-ba0a5290d3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:08.225912 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422c364-f48a-44bc-afc0-ba0a5290d3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:08.226686 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422c364-f48a-44bc-afc0-ba0a5290d3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:08.230561 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422c364-f48a-44bc-afc0-ba0a5290d3bb admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:08.240196 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1055/2141] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:11:08.244536 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c8305-49fa-4ae2-990f-51c693919561 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:08.255326 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c8305-49fa-4ae2-990f-51c693919561 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:08.260232 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a4d4d-3d11-4601-9199-13c2ea77554a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:08.260919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a4d4d-3d11-4601-9199-13c2ea77554a admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:08.261222 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a4d4d-3d11-4601-9199-13c2ea77554a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:08.265204 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a4d4d-3d11-4601-9199-13c2ea77554a admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:08.265204 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a4d4d-3d11-4601-9199-13c2ea77554a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:08.265204 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a4d4d-3d11-4601-9199-13c2ea77554a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:08.274183 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1087/2142] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:11:08.278520 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422c364-f48a-44bc-afc0-ba0a5290d3bb admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:08.291051 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422c364-f48a-44bc-afc0-ba0a5290d3bb admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:08.298230 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a6d5c-97f0-4536-ac42-c08bb61c5ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:08.299348 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a6d5c-97f0-4536-ac42-c08bb61c5ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:08.299828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a6d5c-97f0-4536-ac42-c08bb61c5ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:08.300257 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a6d5c-97f0-4536-ac42-c08bb61c5ae8 admin admin] PATH_INFO: `/v3/projects/8d3245f4aa7b4332b05463ba37bd9f40/users/b5ea1801f0674e8297e2cd8a964333d4/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:08.320027 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a6d5c-97f0-4536-ac42-c08bb61c5ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3245f4aa7b4332b05463ba37bd9f40, user_id=b5ea1801f0674e8297e2cd8a964333d4, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:08.323706 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a6d5c-97f0-4536-ac42-c08bb61c5ae8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:08.456857 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1056/2143] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:08 2022] PUT /identity/v3/projects/8d3245f4aa7b4332b05463ba37bd9f40/users/b5ea1801f0674e8297e2cd8a964333d4/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:08.462363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd8571-8ef3-4bc8-9ee1-3487f24912a4 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:08.462876 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd8571-8ef3-4bc8-9ee1-3487f24912a4 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:08.463258 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd8571-8ef3-4bc8-9ee1-3487f24912a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:08.485463 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-5cbd8571-8ef3-4bc8-9ee1-3487f24912a4 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:08.486869 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5cbd8571-8ef3-4bc8-9ee1-3487f24912a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:08.552032 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1088/2144] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:08.561755 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a6d5c-97f0-4536-ac42-c08bb61c5ae8 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:08.565473 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f65a6d5c-97f0-4536-ac42-c08bb61c5ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:08.622512 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a6d5c-97f0-4536-ac42-c08bb61c5ae8 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:08.626531 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b505e-72c8-4d94-b2b6-93f98d309d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:08.627188 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b505e-72c8-4d94-b2b6-93f98d309d0b service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:08.627464 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b505e-72c8-4d94-b2b6-93f98d309d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:08.627736 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b505e-72c8-4d94-b2b6-93f98d309d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:08.636513 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b505e-72c8-4d94-b2b6-93f98d309d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:08.637949 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b505e-72c8-4d94-b2b6-93f98d309d0b service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:08.647200 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1057/2145] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:11:11.203172 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5f6e1-8211-4356-b96f-d6acd593d735 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:11.203765 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5f6e1-8211-4356-b96f-d6acd593d735 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:11.204142 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5f6e1-8211-4356-b96f-d6acd593d735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:11.253497 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-22b5f6e1-8211-4356-b96f-d6acd593d735 None None] MFA Rules not processed for user `5802e711ef624ead8e35e3fce3455f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:11.255363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-22b5f6e1-8211-4356-b96f-d6acd593d735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:11.358233 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1089/2146] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:11.360558 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6977da-7938-458e-9907-88f501f12d69 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:11.361040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6977da-7938-458e-9907-88f501f12d69 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:11.361313 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6977da-7938-458e-9907-88f501f12d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:11.399813 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-3a6977da-7938-458e-9907-88f501f12d69 None None] MFA Rules not processed for user `5802e711ef624ead8e35e3fce3455f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:11.401120 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-3a6977da-7938-458e-9907-88f501f12d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:11.418171 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1058/2147] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:11:11.433183 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5f6e1-8211-4356-b96f-d6acd593d735 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:11.435097 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-22b5f6e1-8211-4356-b96f-d6acd593d735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:11.651375 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6977da-7938-458e-9907-88f501f12d69 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:11.653172 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-3a6977da-7938-458e-9907-88f501f12d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:11.663902 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5f6e1-8211-4356-b96f-d6acd593d735 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:11.680324 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab0a08-4f5c-4e07-a677-ac93e29ab4ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:11.681058 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab0a08-4f5c-4e07-a677-ac93e29ab4ca service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:11.681397 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab0a08-4f5c-4e07-a677-ac93e29ab4ca service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:11.683634 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab0a08-4f5c-4e07-a677-ac93e29ab4ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:11.693721 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab0a08-4f5c-4e07-a677-ac93e29ab4ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:11.696127 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab0a08-4f5c-4e07-a677-ac93e29ab4ca service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:11.725762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1090/2148] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:11:11.799832 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6977da-7938-458e-9907-88f501f12d69 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:11.821653 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b865d-eb93-4d8f-81b1-cde44d2345f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:11.822939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b865d-eb93-4d8f-81b1-cde44d2345f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:11.823413 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b865d-eb93-4d8f-81b1-cde44d2345f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:11.823890 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b865d-eb93-4d8f-81b1-cde44d2345f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:11.830144 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-484b865d-eb93-4d8f-81b1-cde44d2345f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:11.949540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b865d-eb93-4d8f-81b1-cde44d2345f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:11.951160 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b865d-eb93-4d8f-81b1-cde44d2345f3 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:11.963177 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1059/2149] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:11:13.002181 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92140c4c-eb43-456b-a7c0-2fe26cce8c93 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:13.002783 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92140c4c-eb43-456b-a7c0-2fe26cce8c93 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:13.002878 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92140c4c-eb43-456b-a7c0-2fe26cce8c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:13.029956 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-92140c4c-eb43-456b-a7c0-2fe26cce8c93 None None] MFA Rules not processed for user `5802e711ef624ead8e35e3fce3455f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:13.031443 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-92140c4c-eb43-456b-a7c0-2fe26cce8c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:13.045035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1091/2150] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:16.330984 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d9e8e-ff3b-4832-9c5a-294534d1c9be None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:16.331819 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d9e8e-ff3b-4832-9c5a-294534d1c9be None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:16.332153 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d9e8e-ff3b-4832-9c5a-294534d1c9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:16.385050 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-cc9d9e8e-ff3b-4832-9c5a-294534d1c9be None None] MFA Rules not processed for user `b5ea1801f0674e8297e2cd8a964333d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:16.386322 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-cc9d9e8e-ff3b-4832-9c5a-294534d1c9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:16.546702 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1060/2151] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:16.550825 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92140c4c-eb43-456b-a7c0-2fe26cce8c93 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:16.564853 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92140c4c-eb43-456b-a7c0-2fe26cce8c93 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:16.586240 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227aa9b-c334-463a-9aae-7a775f0b2a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:16.587250 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227aa9b-c334-463a-9aae-7a775f0b2a94 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:16.587714 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227aa9b-c334-463a-9aae-7a775f0b2a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:16.588143 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227aa9b-c334-463a-9aae-7a775f0b2a94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:16.591461 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227aa9b-c334-463a-9aae-7a775f0b2a94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:16.608449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227aa9b-c334-463a-9aae-7a775f0b2a94 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:16.796966 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1092/2152] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:11:16 2022] POST /identity/v3/projects => generated 379 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:11:16.801072 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d9e8e-ff3b-4832-9c5a-294534d1c9be None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:16.815902 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d9e8e-ff3b-4832-9c5a-294534d1c9be None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:16.878194 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8695172-d26e-469e-93ef-a26ba7dcd671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:16.878924 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8695172-d26e-469e-93ef-a26ba7dcd671 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:16.882413 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8695172-d26e-469e-93ef-a26ba7dcd671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:16.882413 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8695172-d26e-469e-93ef-a26ba7dcd671 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:16.882413 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8695172-d26e-469e-93ef-a26ba7dcd671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:16.883345 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8695172-d26e-469e-93ef-a26ba7dcd671 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:16.964323 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1061/2153] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:11:16 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:11:16.971702 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227aa9b-c334-463a-9aae-7a775f0b2a94 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:16.979293 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227aa9b-c334-463a-9aae-7a775f0b2a94 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:16.984172 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d5945-0b9e-4b3e-ab39-285a3b57104b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:16.984943 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d5945-0b9e-4b3e-ab39-285a3b57104b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:16.985344 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d5945-0b9e-4b3e-ab39-285a3b57104b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:16.985677 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d5945-0b9e-4b3e-ab39-285a3b57104b admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:16.986505 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d5945-0b9e-4b3e-ab39-285a3b57104b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:16.988037 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d5945-0b9e-4b3e-ab39-285a3b57104b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:16.998807 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1093/2154] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:11:17.003889 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8695172-d26e-469e-93ef-a26ba7dcd671 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:17.014111 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8695172-d26e-469e-93ef-a26ba7dcd671 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:17.019440 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367a2e9-db4a-4bb8-8a23-bdb1592d911a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:17.020318 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367a2e9-db4a-4bb8-8a23-bdb1592d911a admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:17.020593 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367a2e9-db4a-4bb8-8a23-bdb1592d911a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:17.020860 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367a2e9-db4a-4bb8-8a23-bdb1592d911a admin admin] PATH_INFO: `/v3/projects/62596e5209834a61b3a68da289b17b80/users/d5e846e3629e4bbe98f1e6e848165bf5/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:17.036379 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367a2e9-db4a-4bb8-8a23-bdb1592d911a admin admin] RBAC: Authorizing `identity:create_grant(project_id=62596e5209834a61b3a68da289b17b80, user_id=d5e846e3629e4bbe98f1e6e848165bf5, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:17.039107 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367a2e9-db4a-4bb8-8a23-bdb1592d911a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:17.119526 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1062/2155] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:17 2022] PUT /identity/v3/projects/62596e5209834a61b3a68da289b17b80/users/d5e846e3629e4bbe98f1e6e848165bf5/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:17.123609 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d5945-0b9e-4b3e-ab39-285a3b57104b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:17.135613 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d5945-0b9e-4b3e-ab39-285a3b57104b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:17.196273 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe19a9c-3e2a-47cc-b742-9b4000d2864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:17.196944 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe19a9c-3e2a-47cc-b742-9b4000d2864f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:17.197224 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe19a9c-3e2a-47cc-b742-9b4000d2864f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:17.197564 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe19a9c-3e2a-47cc-b742-9b4000d2864f admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:17.198290 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe19a9c-3e2a-47cc-b742-9b4000d2864f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:17.199945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe19a9c-3e2a-47cc-b742-9b4000d2864f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:17.210605 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1094/2156] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:11:17.215526 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367a2e9-db4a-4bb8-8a23-bdb1592d911a admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:17.226913 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367a2e9-db4a-4bb8-8a23-bdb1592d911a admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:17.231607 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea6cb-2eef-4cf9-8a51-3fefe7f04a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:17.232488 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea6cb-2eef-4cf9-8a51-3fefe7f04a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:17.232773 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea6cb-2eef-4cf9-8a51-3fefe7f04a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:17.233051 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea6cb-2eef-4cf9-8a51-3fefe7f04a6d admin admin] PATH_INFO: `/v3/projects/62596e5209834a61b3a68da289b17b80/users/d5e846e3629e4bbe98f1e6e848165bf5/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:17.235142 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfea6cb-2eef-4cf9-8a51-3fefe7f04a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62596e5209834a61b3a68da289b17b80, user_id=d5e846e3629e4bbe98f1e6e848165bf5, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:17.237776 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfea6cb-2eef-4cf9-8a51-3fefe7f04a6d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:17.249923 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1063/2157] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:17 2022] PUT /identity/v3/projects/62596e5209834a61b3a68da289b17b80/users/d5e846e3629e4bbe98f1e6e848165bf5/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:11:24.665528 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe19a9c-3e2a-47cc-b742-9b4000d2864f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:24.667649 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-abe19a9c-3e2a-47cc-b742-9b4000d2864f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:24.685176 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe19a9c-3e2a-47cc-b742-9b4000d2864f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:24.753750 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf1bb5-bd51-4e0b-af65-a1c3dda0cfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:24.754726 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf1bb5-bd51-4e0b-af65-a1c3dda0cfa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:24.754984 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf1bb5-bd51-4e0b-af65-a1c3dda0cfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:24.755257 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf1bb5-bd51-4e0b-af65-a1c3dda0cfa7 admin admin] PATH_INFO: `/v3/users/f5bb95d7c4ed4beb96c36bc0b2a2d57c` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:24.756457 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf1bb5-bd51-4e0b-af65-a1c3dda0cfa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5bb95d7c4ed4beb96c36bc0b2a2d57c)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:24.758535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf1bb5-bd51-4e0b-af65-a1c3dda0cfa7 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:24.972620 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5acf1bb5-bd51-4e0b-af65-a1c3dda0cfa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5bb95d7c4ed4beb96c36bc0b2a2d57c'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:24.973308 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5acf1bb5-bd51-4e0b-af65-a1c3dda0cfa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5bb95d7c4ed4beb96c36bc0b2a2d57c'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:24.988505 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5acf1bb5-bd51-4e0b-af65-a1c3dda0cfa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5bb95d7c4ed4beb96c36bc0b2a2d57c'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:24.996431 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5acf1bb5-bd51-4e0b-af65-a1c3dda0cfa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5bb95d7c4ed4beb96c36bc0b2a2d57c'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:24.997292 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5acf1bb5-bd51-4e0b-af65-a1c3dda0cfa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5bb95d7c4ed4beb96c36bc0b2a2d57c'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:25.094954 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1095/2158] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:11:24 2022] DELETE /identity/v3/users/f5bb95d7c4ed4beb96c36bc0b2a2d57c => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:25.097941 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b71033-96c9-42e9-997e-a66e18ee240a None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:25.098491 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b71033-96c9-42e9-997e-a66e18ee240a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:25.098491 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b71033-96c9-42e9-997e-a66e18ee240a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:25.144502 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-11b71033-96c9-42e9-997e-a66e18ee240a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:25.146141 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-11b71033-96c9-42e9-997e-a66e18ee240a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:25.300837 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1064/2159] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:25.314686 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf1bb5-bd51-4e0b-af65-a1c3dda0cfa7 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:25.317148 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5acf1bb5-bd51-4e0b-af65-a1c3dda0cfa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:25.429941 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf1bb5-bd51-4e0b-af65-a1c3dda0cfa7 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:25.434029 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9a92a-20a0-4ad1-a20e-1b31109b5ef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:25.435127 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9a92a-20a0-4ad1-a20e-1b31109b5ef6 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:25.435846 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9a92a-20a0-4ad1-a20e-1b31109b5ef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:25.437490 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9a92a-20a0-4ad1-a20e-1b31109b5ef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:25.454764 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9a92a-20a0-4ad1-a20e-1b31109b5ef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:25.456460 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9a92a-20a0-4ad1-a20e-1b31109b5ef6 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:25.469006 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1096/2160] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:11:25.714148 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c837ef-ee0e-48fb-96e6-ae4d21c5517e None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:25.714450 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c837ef-ee0e-48fb-96e6-ae4d21c5517e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:25.718143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c837ef-ee0e-48fb-96e6-ae4d21c5517e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:25.764630 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-65c837ef-ee0e-48fb-96e6-ae4d21c5517e None None] MFA Rules not processed for user `d5e846e3629e4bbe98f1e6e848165bf5`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:25.765955 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-65c837ef-ee0e-48fb-96e6-ae4d21c5517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:25.848199 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9a92a-20a0-4ad1-a20e-1b31109b5ef6 service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:25.849601 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-cef9a92a-20a0-4ad1-a20e-1b31109b5ef6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:25.853377 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1065/2161] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:25.863849 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9a92a-20a0-4ad1-a20e-1b31109b5ef6 service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:25.866411 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c837ef-ee0e-48fb-96e6-ae4d21c5517e None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:25.868120 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-65c837ef-ee0e-48fb-96e6-ae4d21c5517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:25.868823 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf0bb1-9f45-4405-94d8-02105b1014ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:25.869754 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf0bb1-9f45-4405-94d8-02105b1014ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:25.870114 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf0bb1-9f45-4405-94d8-02105b1014ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:25.870448 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf0bb1-9f45-4405-94d8-02105b1014ba admin admin] PATH_INFO: `/v3/users/0ebe75b2ad4c4817b716a9544b8b54c9` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:25.871735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf0bb1-9f45-4405-94d8-02105b1014ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ebe75b2ad4c4817b716a9544b8b54c9)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:25.874017 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf0bb1-9f45-4405-94d8-02105b1014ba admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:25.945423 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c837ef-ee0e-48fb-96e6-ae4d21c5517e None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:25.952262 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a2115-778f-4f24-9e80-ba5c52f36505 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:25.953047 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a2115-778f-4f24-9e80-ba5c52f36505 service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:25.953325 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a2115-778f-4f24-9e80-ba5c52f36505 service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:25.953602 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a2115-778f-4f24-9e80-ba5c52f36505 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:25.955476 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-2a6a2115-778f-4f24-9e80-ba5c52f36505 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:26.015850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a2115-778f-4f24-9e80-ba5c52f36505 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:26.017428 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a2115-778f-4f24-9e80-ba5c52f36505 service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:26.026531 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1066/2162] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:11:26.027381 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a2115-778f-4f24-9e80-ba5c52f36505 service nova] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:26.028665 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-2a6a2115-778f-4f24-9e80-ba5c52f36505 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:26.042568 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a2115-778f-4f24-9e80-ba5c52f36505 service nova] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:26.048486 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f7d77-ea13-470b-9073-3dc9ef3906f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:26.049394 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f7d77-ea13-470b-9073-3dc9ef3906f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:26.049741 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f7d77-ea13-470b-9073-3dc9ef3906f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:26.050093 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f7d77-ea13-470b-9073-3dc9ef3906f0 admin admin] PATH_INFO: `/v3/projects/a9151c121aff40dabbcc58ff70ec43c8` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:26.051372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f7d77-ea13-470b-9073-3dc9ef3906f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9151c121aff40dabbcc58ff70ec43c8)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:26.053377 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f7d77-ea13-470b-9073-3dc9ef3906f0 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:26.083251 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-85cf0bb1-9f45-4405-94d8-02105b1014ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ebe75b2ad4c4817b716a9544b8b54c9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:26.083933 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-85cf0bb1-9f45-4405-94d8-02105b1014ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ebe75b2ad4c4817b716a9544b8b54c9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:26.096481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-85cf0bb1-9f45-4405-94d8-02105b1014ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ebe75b2ad4c4817b716a9544b8b54c9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:26.103209 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-85cf0bb1-9f45-4405-94d8-02105b1014ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ebe75b2ad4c4817b716a9544b8b54c9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:26.103870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-85cf0bb1-9f45-4405-94d8-02105b1014ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ebe75b2ad4c4817b716a9544b8b54c9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:26.200840 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b33f7d77-ea13-470b-9073-3dc9ef3906f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9151c121aff40dabbcc58ff70ec43c8', 'request_id': 'req-b33f7d77-ea13-470b-9073-3dc9ef3906f0'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:26.225752 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1097/2163] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:11:25 2022] DELETE /identity/v3/users/0ebe75b2ad4c4817b716a9544b8b54c9 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:11:26.230174 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e222c29-9b80-497f-8f48-e94efd007238 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:26.230461 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e222c29-9b80-497f-8f48-e94efd007238 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:26.230895 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e222c29-9b80-497f-8f48-e94efd007238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:26.248242 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-5e222c29-9b80-497f-8f48-e94efd007238 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:26.249717 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5e222c29-9b80-497f-8f48-e94efd007238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:26.307322 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1098/2164] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:11:26.317768 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e222c29-9b80-497f-8f48-e94efd007238 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:26.318594 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b33f7d77-ea13-470b-9073-3dc9ef3906f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9151c121aff40dabbcc58ff70ec43c8', 'request_id': 'req-b33f7d77-ea13-470b-9073-3dc9ef3906f0'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:26.319976 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5e222c29-9b80-497f-8f48-e94efd007238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:26.328817 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b33f7d77-ea13-470b-9073-3dc9ef3906f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9151c121aff40dabbcc58ff70ec43c8', 'request_id': 'req-b33f7d77-ea13-470b-9073-3dc9ef3906f0'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:26.342111 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b33f7d77-ea13-470b-9073-3dc9ef3906f0 admin admin] The token cache is being invalidate because project a9151c121aff40dabbcc58ff70ec43c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:11:26.344127 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b33f7d77-ea13-470b-9073-3dc9ef3906f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:26.344946 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b33f7d77-ea13-470b-9073-3dc9ef3906f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:26.347057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1067/2165] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:11:26 2022] DELETE /identity/v3/projects/a9151c121aff40dabbcc58ff70ec43c8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:26.351733 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae23a4-27e9-44bd-b1b5-dc31c93c876e None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:26.352018 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae23a4-27e9-44bd-b1b5-dc31c93c876e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:26.352305 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae23a4-27e9-44bd-b1b5-dc31c93c876e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:26.370435 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-a3ae23a4-27e9-44bd-b1b5-dc31c93c876e None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:26.371657 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-a3ae23a4-27e9-44bd-b1b5-dc31c93c876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:26.380380 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1068/2166] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:26.382069 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e222c29-9b80-497f-8f48-e94efd007238 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:26.385840 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6dd9a7-c878-42dd-b24f-ec8af8773aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:26.386742 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dd9a7-c878-42dd-b24f-ec8af8773aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:26.386959 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dd9a7-c878-42dd-b24f-ec8af8773aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:26.387234 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dd9a7-c878-42dd-b24f-ec8af8773aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:26.387959 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826b069-4edb-4117-940e-a0f1aefe5071 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:26.388274 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826b069-4edb-4117-940e-a0f1aefe5071 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:26.388547 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826b069-4edb-4117-940e-a0f1aefe5071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:26.389731 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-af6dd9a7-c878-42dd-b24f-ec8af8773aa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:26.401760 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6dd9a7-c878-42dd-b24f-ec8af8773aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:26.403331 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6dd9a7-c878-42dd-b24f-ec8af8773aa3 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:26.407265 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-0826b069-4edb-4117-940e-a0f1aefe5071 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:26.408420 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-0826b069-4edb-4117-940e-a0f1aefe5071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:26.413952 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1099/2167] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:11:26.416684 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1069/2168] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:11:26.420853 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6dd9a7-c878-42dd-b24f-ec8af8773aa3 service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:26.430443 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6dd9a7-c878-42dd-b24f-ec8af8773aa3 service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:26.435192 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12e7e0-8a71-4181-9866-1894af4a5e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:26.435841 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12e7e0-8a71-4181-9866-1894af4a5e48 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:26.436678 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12e7e0-8a71-4181-9866-1894af4a5e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:26.440098 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12e7e0-8a71-4181-9866-1894af4a5e48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:26.440098 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12e7e0-8a71-4181-9866-1894af4a5e48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:11:26.440098 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12e7e0-8a71-4181-9866-1894af4a5e48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:26.440354 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12e7e0-8a71-4181-9866-1894af4a5e48 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:26.453101 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1100/2169] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 17:11:26.457775 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826b069-4edb-4117-940e-a0f1aefe5071 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:26.468209 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826b069-4edb-4117-940e-a0f1aefe5071 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:26.473363 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b85ea0-5b36-4d0e-8762-b7a1c0acda74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:26.474031 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b85ea0-5b36-4d0e-8762-b7a1c0acda74 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:26.474285 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b85ea0-5b36-4d0e-8762-b7a1c0acda74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:26.474772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b85ea0-5b36-4d0e-8762-b7a1c0acda74 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:26.475601 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b85ea0-5b36-4d0e-8762-b7a1c0acda74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:26.477756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b85ea0-5b36-4d0e-8762-b7a1c0acda74 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:26.646105 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1070/2170] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:11:26 2022] POST /identity/v3/projects => generated 389 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:11:26.650301 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12e7e0-8a71-4181-9866-1894af4a5e48 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:26.660101 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12e7e0-8a71-4181-9866-1894af4a5e48 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:26.723072 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8262aca-fda4-46d6-9b32-8d95214cec10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:26.723826 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8262aca-fda4-46d6-9b32-8d95214cec10 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:26.724169 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8262aca-fda4-46d6-9b32-8d95214cec10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:26.724540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8262aca-fda4-46d6-9b32-8d95214cec10 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:26.725206 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8262aca-fda4-46d6-9b32-8d95214cec10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:26.727886 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8262aca-fda4-46d6-9b32-8d95214cec10 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:26.856112 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1101/2171] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:11:26 2022] POST /identity/v3/users => generated 295 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:11:26.856857 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b85ea0-5b36-4d0e-8762-b7a1c0acda74 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:26.867942 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b85ea0-5b36-4d0e-8762-b7a1c0acda74 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:26.877756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded2b89-a45a-4e68-8004-828273d2c3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:26.877756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded2b89-a45a-4e68-8004-828273d2c3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:26.877756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded2b89-a45a-4e68-8004-828273d2c3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:26.877756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded2b89-a45a-4e68-8004-828273d2c3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:26.878120 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded2b89-a45a-4e68-8004-828273d2c3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:26.878273 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded2b89-a45a-4e68-8004-828273d2c3f3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:26.888895 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1071/2172] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:11:26.897173 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8262aca-fda4-46d6-9b32-8d95214cec10 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:26.908059 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8262aca-fda4-46d6-9b32-8d95214cec10 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:26.912871 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afa53f-a37f-458c-bc48-d87965e9dbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:26.913533 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afa53f-a37f-458c-bc48-d87965e9dbda admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:26.913811 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afa53f-a37f-458c-bc48-d87965e9dbda admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:26.914086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afa53f-a37f-458c-bc48-d87965e9dbda admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:26.914835 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afa53f-a37f-458c-bc48-d87965e9dbda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:26.916421 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afa53f-a37f-458c-bc48-d87965e9dbda admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:26.926982 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1102/2173] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:11:26.931290 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded2b89-a45a-4e68-8004-828273d2c3f3 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:26.941980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded2b89-a45a-4e68-8004-828273d2c3f3 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:26.946972 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa02a3-669f-4563-8853-c0d69764b506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:26.947850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa02a3-669f-4563-8853-c0d69764b506 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:26.952307 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa02a3-669f-4563-8853-c0d69764b506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:26.952307 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa02a3-669f-4563-8853-c0d69764b506 admin admin] PATH_INFO: `/v3/projects/cc1e186de2174542b0eed634e37384ea/users/b05848f087f54926ae2c5bcb82b0dbc8/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:26.964159 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa02a3-669f-4563-8853-c0d69764b506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1e186de2174542b0eed634e37384ea, user_id=b05848f087f54926ae2c5bcb82b0dbc8, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:26.966827 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa02a3-669f-4563-8853-c0d69764b506 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:26.979639 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afa53f-a37f-458c-bc48-d87965e9dbda admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:26.981729 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e2afa53f-a37f-458c-bc48-d87965e9dbda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:27.002779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afa53f-a37f-458c-bc48-d87965e9dbda admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:27.009170 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f45ca8-3dc0-4a6f-b433-9892b784a0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:27.009390 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f45ca8-3dc0-4a6f-b433-9892b784a0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:27.009847 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f45ca8-3dc0-4a6f-b433-9892b784a0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:27.010122 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f45ca8-3dc0-4a6f-b433-9892b784a0d3 admin admin] PATH_INFO: `/v3/projects/731a2829036e4fdcad5a5363d7847334` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:27.011396 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f45ca8-3dc0-4a6f-b433-9892b784a0d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=731a2829036e4fdcad5a5363d7847334)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:27.013325 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f45ca8-3dc0-4a6f-b433-9892b784a0d3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:27.065109 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1072/2174] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:26 2022] PUT /identity/v3/projects/cc1e186de2174542b0eed634e37384ea/users/b05848f087f54926ae2c5bcb82b0dbc8/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:27.066582 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72a9ff-1d10-449a-a44e-934387a4f08a None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:27.066908 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72a9ff-1d10-449a-a44e-934387a4f08a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:27.067187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72a9ff-1d10-449a-a44e-934387a4f08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:27.100016 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-3a72a9ff-1d10-449a-a44e-934387a4f08a None None] MFA Rules not processed for user `b05848f087f54926ae2c5bcb82b0dbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:27.101592 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-3a72a9ff-1d10-449a-a44e-934387a4f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:27.176871 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d2f45ca8-3dc0-4a6f-b433-9892b784a0d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '731a2829036e4fdcad5a5363d7847334', 'request_id': 'req-d2f45ca8-3dc0-4a6f-b433-9892b784a0d3'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:27.182433 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1073/2175] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:11:27.195832 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72a9ff-1d10-449a-a44e-934387a4f08a None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:27.197464 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-3a72a9ff-1d10-449a-a44e-934387a4f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:27.266918 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d2f45ca8-3dc0-4a6f-b433-9892b784a0d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '731a2829036e4fdcad5a5363d7847334', 'request_id': 'req-d2f45ca8-3dc0-4a6f-b433-9892b784a0d3'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:27.267944 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72a9ff-1d10-449a-a44e-934387a4f08a None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:27.273014 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d2f45ca8-3dc0-4a6f-b433-9892b784a0d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '731a2829036e4fdcad5a5363d7847334', 'request_id': 'req-d2f45ca8-3dc0-4a6f-b433-9892b784a0d3'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:27.284755 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d2f45ca8-3dc0-4a6f-b433-9892b784a0d3 admin admin] The token cache is being invalidate because project 731a2829036e4fdcad5a5363d7847334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:11:27.285131 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d2f45ca8-3dc0-4a6f-b433-9892b784a0d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:27.285852 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d2f45ca8-3dc0-4a6f-b433-9892b784a0d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:27.287577 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1103/2176] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:11:26 2022] DELETE /identity/v3/projects/731a2829036e4fdcad5a5363d7847334 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:27.291645 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f45ca8-3dc0-4a6f-b433-9892b784a0d3 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:27.293102 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d2f45ca8-3dc0-4a6f-b433-9892b784a0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:27.320338 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd5d1f-6331-4849-9fe4-6ffaeda5e25f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:27.321096 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd5d1f-6331-4849-9fe4-6ffaeda5e25f service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:27.321445 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd5d1f-6331-4849-9fe4-6ffaeda5e25f service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:27.321767 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd5d1f-6331-4849-9fe4-6ffaeda5e25f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:27.323627 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-39dd5d1f-6331-4849-9fe4-6ffaeda5e25f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:27.363511 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f45ca8-3dc0-4a6f-b433-9892b784a0d3 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:27.371873 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af61373-0220-4b2a-9044-d0ec5b94aa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:27.373059 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af61373-0220-4b2a-9044-d0ec5b94aa45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:27.377810 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af61373-0220-4b2a-9044-d0ec5b94aa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:27.377810 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af61373-0220-4b2a-9044-d0ec5b94aa45 admin admin] PATH_INFO: `/v3/users/dc09c0595ce245c983fa44c82fb28984` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:27.377810 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af61373-0220-4b2a-9044-d0ec5b94aa45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc09c0595ce245c983fa44c82fb28984)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:27.380491 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af61373-0220-4b2a-9044-d0ec5b94aa45 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:27.392546 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd5d1f-6331-4849-9fe4-6ffaeda5e25f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:27.394848 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd5d1f-6331-4849-9fe4-6ffaeda5e25f service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:27.406711 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1074/2177] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:11:27.824006 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5af61373-0220-4b2a-9044-d0ec5b94aa45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc09c0595ce245c983fa44c82fb28984'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:27.826078 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5af61373-0220-4b2a-9044-d0ec5b94aa45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc09c0595ce245c983fa44c82fb28984'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:27.841245 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5af61373-0220-4b2a-9044-d0ec5b94aa45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc09c0595ce245c983fa44c82fb28984'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:27.849751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5af61373-0220-4b2a-9044-d0ec5b94aa45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc09c0595ce245c983fa44c82fb28984'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:27.850576 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5af61373-0220-4b2a-9044-d0ec5b94aa45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc09c0595ce245c983fa44c82fb28984'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:27.957305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1104/2178] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:11:27 2022] DELETE /identity/v3/users/dc09c0595ce245c983fa44c82fb28984 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:28.760969 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd5d1f-6331-4849-9fe4-6ffaeda5e25f service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:28.777389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd5d1f-6331-4849-9fe4-6ffaeda5e25f service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:28.887247 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa5721-8f81-4e1c-a996-7588e9681ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:28.888296 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa5721-8f81-4e1c-a996-7588e9681ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:28.888683 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa5721-8f81-4e1c-a996-7588e9681ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:28.889116 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa5721-8f81-4e1c-a996-7588e9681ed2 admin admin] PATH_INFO: `/v3/projects/6635c4402e48453b80d5d8ec8768ef7c` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:28.893154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa5721-8f81-4e1c-a996-7588e9681ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6635c4402e48453b80d5d8ec8768ef7c)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:28.895857 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa5721-8f81-4e1c-a996-7588e9681ed2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:29.123185 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d4aa5721-8f81-4e1c-a996-7588e9681ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6635c4402e48453b80d5d8ec8768ef7c', 'request_id': 'req-d4aa5721-8f81-4e1c-a996-7588e9681ed2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:29.226756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d4aa5721-8f81-4e1c-a996-7588e9681ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6635c4402e48453b80d5d8ec8768ef7c', 'request_id': 'req-d4aa5721-8f81-4e1c-a996-7588e9681ed2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:29.237882 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d4aa5721-8f81-4e1c-a996-7588e9681ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6635c4402e48453b80d5d8ec8768ef7c', 'request_id': 'req-d4aa5721-8f81-4e1c-a996-7588e9681ed2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:29.249841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d4aa5721-8f81-4e1c-a996-7588e9681ed2 admin admin] The token cache is being invalidate because project 6635c4402e48453b80d5d8ec8768ef7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:11:29.250137 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d4aa5721-8f81-4e1c-a996-7588e9681ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:29.250833 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d4aa5721-8f81-4e1c-a996-7588e9681ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:29.252358 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1075/2179] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:11:28 2022] DELETE /identity/v3/projects/6635c4402e48453b80d5d8ec8768ef7c => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:29.257286 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9523b-0fd2-4368-83d5-509a9f26a2b4 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:29.257762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9523b-0fd2-4368-83d5-509a9f26a2b4 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:29.258495 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9523b-0fd2-4368-83d5-509a9f26a2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:29.286083 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-ceb9523b-0fd2-4368-83d5-509a9f26a2b4 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:29.287433 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-ceb9523b-0fd2-4368-83d5-509a9f26a2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:29.348463 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1105/2180] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:11:29.355959 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65baaf-41cf-4f2f-b196-b79a17ebef8a None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:29.356241 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65baaf-41cf-4f2f-b196-b79a17ebef8a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:29.356506 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65baaf-41cf-4f2f-b196-b79a17ebef8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:29.384210 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-1e65baaf-41cf-4f2f-b196-b79a17ebef8a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:29.386658 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-1e65baaf-41cf-4f2f-b196-b79a17ebef8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:29.398691 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1076/2181] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:29.403090 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9523b-0fd2-4368-83d5-509a9f26a2b4 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:29.414025 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9523b-0fd2-4368-83d5-509a9f26a2b4 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:29.419414 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb0a3e-9981-4944-af93-f65014472afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:29.420602 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb0a3e-9981-4944-af93-f65014472afc admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:29.421047 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb0a3e-9981-4944-af93-f65014472afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:29.421327 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb0a3e-9981-4944-af93-f65014472afc admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:29.422061 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb0a3e-9981-4944-af93-f65014472afc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:11:29.422532 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb0a3e-9981-4944-af93-f65014472afc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:29.424174 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb0a3e-9981-4944-af93-f65014472afc admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:29.437296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1106/2182] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:11:29.441865 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65baaf-41cf-4f2f-b196-b79a17ebef8a None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:29.451444 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65baaf-41cf-4f2f-b196-b79a17ebef8a None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:29.457119 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ad300-be02-418f-a9d1-dad4c197cfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:29.461557 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ad300-be02-418f-a9d1-dad4c197cfa1 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:29.461557 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ad300-be02-418f-a9d1-dad4c197cfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:29.461557 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ad300-be02-418f-a9d1-dad4c197cfa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:29.461557 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ad300-be02-418f-a9d1-dad4c197cfa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:29.461557 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ad300-be02-418f-a9d1-dad4c197cfa1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:29.583380 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb0a3e-9981-4944-af93-f65014472afc admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:29.594837 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb0a3e-9981-4944-af93-f65014472afc admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:29.595078 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1077/2183] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:11:29 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:11:29.658224 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d48f5-7219-4247-a8a7-519eda9b307d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:29.659765 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d48f5-7219-4247-a8a7-519eda9b307d admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:29.660060 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d48f5-7219-4247-a8a7-519eda9b307d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:29.660339 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d48f5-7219-4247-a8a7-519eda9b307d admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:29.661039 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d48f5-7219-4247-a8a7-519eda9b307d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:29.662985 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d48f5-7219-4247-a8a7-519eda9b307d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:29.785652 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1107/2184] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:11:29 2022] POST /identity/v3/users => generated 284 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:11:29.787135 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ad300-be02-418f-a9d1-dad4c197cfa1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:29.798731 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ad300-be02-418f-a9d1-dad4c197cfa1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:29.804894 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21117335-b128-47aa-8917-963a333d6270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:29.805581 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21117335-b128-47aa-8917-963a333d6270 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:29.807609 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21117335-b128-47aa-8917-963a333d6270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:29.807609 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21117335-b128-47aa-8917-963a333d6270 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:29.807609 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21117335-b128-47aa-8917-963a333d6270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:29.808414 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21117335-b128-47aa-8917-963a333d6270 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:29.820706 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1078/2185] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:11:29.825325 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d48f5-7219-4247-a8a7-519eda9b307d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:29.836807 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d48f5-7219-4247-a8a7-519eda9b307d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:29.842113 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f134961-008a-4fa7-9661-c9a9d1485bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:29.843791 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f134961-008a-4fa7-9661-c9a9d1485bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:29.844121 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f134961-008a-4fa7-9661-c9a9d1485bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:29.844402 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f134961-008a-4fa7-9661-c9a9d1485bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:29.845118 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f134961-008a-4fa7-9661-c9a9d1485bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:29.846731 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f134961-008a-4fa7-9661-c9a9d1485bc2 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:29.862692 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1108/2186] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:11:29.866555 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21117335-b128-47aa-8917-963a333d6270 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:29.883648 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21117335-b128-47aa-8917-963a333d6270 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:29.889687 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c4751-a664-4ce6-9049-0ca288f6b5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:29.890802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c4751-a664-4ce6-9049-0ca288f6b5fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:29.891470 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c4751-a664-4ce6-9049-0ca288f6b5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:29.891470 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c4751-a664-4ce6-9049-0ca288f6b5fd admin admin] PATH_INFO: `/v3/projects/e8be461b9219436d9959a73b2c41a25b/users/0f1535d8679740f88f074dee3f9d376d/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:29.909286 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c4751-a664-4ce6-9049-0ca288f6b5fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8be461b9219436d9959a73b2c41a25b, user_id=0f1535d8679740f88f074dee3f9d376d, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:29.912171 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c4751-a664-4ce6-9049-0ca288f6b5fd admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:30.035709 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1079/2187] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:29 2022] PUT /identity/v3/projects/e8be461b9219436d9959a73b2c41a25b/users/0f1535d8679740f88f074dee3f9d376d/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:30.052930 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e122ae7-fbd4-4020-bd78-e74ff91e6963 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:30.053230 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e122ae7-fbd4-4020-bd78-e74ff91e6963 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:30.053508 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e122ae7-fbd4-4020-bd78-e74ff91e6963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:30.085373 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-8e122ae7-fbd4-4020-bd78-e74ff91e6963 None None] MFA Rules not processed for user `0f1535d8679740f88f074dee3f9d376d`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:30.086576 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8e122ae7-fbd4-4020-bd78-e74ff91e6963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:30.168449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1109/2188] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:30.170800 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c4751-a664-4ce6-9049-0ca288f6b5fd admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:30.242935 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c4751-a664-4ce6-9049-0ca288f6b5fd admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:30.248645 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a183a34-9126-4886-bb7f-b150eb252e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:30.249386 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a183a34-9126-4886-bb7f-b150eb252e45 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:30.249734 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a183a34-9126-4886-bb7f-b150eb252e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:30.250375 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a183a34-9126-4886-bb7f-b150eb252e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:30.251123 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a183a34-9126-4886-bb7f-b150eb252e45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:30.253190 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a183a34-9126-4886-bb7f-b150eb252e45 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:30.372523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1080/2189] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:11:30 2022] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:11:30.376752 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e122ae7-fbd4-4020-bd78-e74ff91e6963 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:30.388337 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e122ae7-fbd4-4020-bd78-e74ff91e6963 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:30.452138 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b6bb3-d98c-4937-af19-d164baa57b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:30.452969 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b6bb3-d98c-4937-af19-d164baa57b58 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:30.453527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b6bb3-d98c-4937-af19-d164baa57b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:30.454179 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b6bb3-d98c-4937-af19-d164baa57b58 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:30.455171 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b6bb3-d98c-4937-af19-d164baa57b58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:30.457548 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b6bb3-d98c-4937-af19-d164baa57b58 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:30.662573 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1110/2190] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:11:30 2022] POST /identity/v3/users => generated 290 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:11:30.666620 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a183a34-9126-4886-bb7f-b150eb252e45 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:30.677057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a183a34-9126-4886-bb7f-b150eb252e45 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:30.681690 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31d2c3-e2d9-421c-8da6-67623a08d0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:30.682327 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31d2c3-e2d9-421c-8da6-67623a08d0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:30.682603 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31d2c3-e2d9-421c-8da6-67623a08d0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:30.682906 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31d2c3-e2d9-421c-8da6-67623a08d0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:30.683620 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31d2c3-e2d9-421c-8da6-67623a08d0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:30.685193 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31d2c3-e2d9-421c-8da6-67623a08d0e9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:30.700204 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1081/2191] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:11:30.704399 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b6bb3-d98c-4937-af19-d164baa57b58 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:30.714449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b6bb3-d98c-4937-af19-d164baa57b58 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:30.719832 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc87621-3001-4c8a-b5c9-0d4723df5591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:30.720696 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc87621-3001-4c8a-b5c9-0d4723df5591 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:30.720969 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc87621-3001-4c8a-b5c9-0d4723df5591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:30.721236 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc87621-3001-4c8a-b5c9-0d4723df5591 admin admin] PATH_INFO: `/v3/projects/a17a467dbcca47a2b8c08cd53609d6d1/users/1506d6dcca2644a3b0d8c2def4c2eab1/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:30.735769 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc87621-3001-4c8a-b5c9-0d4723df5591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17a467dbcca47a2b8c08cd53609d6d1, user_id=1506d6dcca2644a3b0d8c2def4c2eab1, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:30.738367 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc87621-3001-4c8a-b5c9-0d4723df5591 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:30.809632 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1111/2192] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:30 2022] PUT /identity/v3/projects/a17a467dbcca47a2b8c08cd53609d6d1/users/1506d6dcca2644a3b0d8c2def4c2eab1/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:30.814340 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31d2c3-e2d9-421c-8da6-67623a08d0e9 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:30.824333 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31d2c3-e2d9-421c-8da6-67623a08d0e9 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:30.888109 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2d5ec-644b-4444-ad5d-e542f62e714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:30.889029 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2d5ec-644b-4444-ad5d-e542f62e714e admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:30.889149 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2d5ec-644b-4444-ad5d-e542f62e714e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:30.889484 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2d5ec-644b-4444-ad5d-e542f62e714e admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:30.890214 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2d5ec-644b-4444-ad5d-e542f62e714e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:30.892589 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2d5ec-644b-4444-ad5d-e542f62e714e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:30.903029 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1082/2193] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:11:30.916433 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc87621-3001-4c8a-b5c9-0d4723df5591 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:30.921391 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc87621-3001-4c8a-b5c9-0d4723df5591 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:30.926744 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3a625-683e-4c09-96d6-ad70d488c5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:30.927697 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3a625-683e-4c09-96d6-ad70d488c5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:30.928106 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3a625-683e-4c09-96d6-ad70d488c5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:30.928416 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3a625-683e-4c09-96d6-ad70d488c5c6 admin admin] PATH_INFO: `/v3/projects/a17a467dbcca47a2b8c08cd53609d6d1/users/1506d6dcca2644a3b0d8c2def4c2eab1/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:30.930467 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3a625-683e-4c09-96d6-ad70d488c5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17a467dbcca47a2b8c08cd53609d6d1, user_id=1506d6dcca2644a3b0d8c2def4c2eab1, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:30.933229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3a625-683e-4c09-96d6-ad70d488c5c6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:30.945991 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1112/2194] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:30 2022] PUT /identity/v3/projects/a17a467dbcca47a2b8c08cd53609d6d1/users/1506d6dcca2644a3b0d8c2def4c2eab1/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:30.960708 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd544f2-bd8e-46fa-9e04-1be65ce829eb None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:30.961005 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd544f2-bd8e-46fa-9e04-1be65ce829eb None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:30.961288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd544f2-bd8e-46fa-9e04-1be65ce829eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:31.003080 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-bdd544f2-bd8e-46fa-9e04-1be65ce829eb None None] MFA Rules not processed for user `1506d6dcca2644a3b0d8c2def4c2eab1`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:31.004346 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-bdd544f2-bd8e-46fa-9e04-1be65ce829eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:31.129152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1083/2195] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:31.141508 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3a625-683e-4c09-96d6-ad70d488c5c6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:31.144368 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-02b3a625-683e-4c09-96d6-ad70d488c5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:31.216394 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3a625-683e-4c09-96d6-ad70d488c5c6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:31.221021 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1f073-24be-47e6-99ee-86d061bd95bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:31.221663 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1f073-24be-47e6-99ee-86d061bd95bc service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:31.221941 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1f073-24be-47e6-99ee-86d061bd95bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:31.222213 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1f073-24be-47e6-99ee-86d061bd95bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:31.231575 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1f073-24be-47e6-99ee-86d061bd95bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:31.233004 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1f073-24be-47e6-99ee-86d061bd95bc service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:31.244158 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1113/2196] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:11:34.210588 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd544f2-bd8e-46fa-9e04-1be65ce829eb None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:34.310655 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd544f2-bd8e-46fa-9e04-1be65ce829eb None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:34.315869 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf0b4a-d0c4-40c2-8f42-de779973b6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:34.316159 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf0b4a-d0c4-40c2-8f42-de779973b6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:34.316438 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf0b4a-d0c4-40c2-8f42-de779973b6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:34.316713 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf0b4a-d0c4-40c2-8f42-de779973b6e1 admin admin] PATH_INFO: `/v3/users/0f1535d8679740f88f074dee3f9d376d` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:34.317897 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf0b4a-d0c4-40c2-8f42-de779973b6e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f1535d8679740f88f074dee3f9d376d)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:34.319827 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf0b4a-d0c4-40c2-8f42-de779973b6e1 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:34.549071 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-64bf0b4a-d0c4-40c2-8f42-de779973b6e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f1535d8679740f88f074dee3f9d376d'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:34.550186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-64bf0b4a-d0c4-40c2-8f42-de779973b6e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f1535d8679740f88f074dee3f9d376d'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:34.561985 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-64bf0b4a-d0c4-40c2-8f42-de779973b6e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f1535d8679740f88f074dee3f9d376d'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:34.569020 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-64bf0b4a-d0c4-40c2-8f42-de779973b6e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f1535d8679740f88f074dee3f9d376d'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:34.643773 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-64bf0b4a-d0c4-40c2-8f42-de779973b6e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f1535d8679740f88f074dee3f9d376d'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:34.650434 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1084/2197] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:11:34 2022] DELETE /identity/v3/users/0f1535d8679740f88f074dee3f9d376d => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:34.654925 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2796c4a-0041-4893-b37c-dcd3d9104e92 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:34.655419 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2796c4a-0041-4893-b37c-dcd3d9104e92 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:34.655509 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2796c4a-0041-4893-b37c-dcd3d9104e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:34.702576 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-a2796c4a-0041-4893-b37c-dcd3d9104e92 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:34.704355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a2796c4a-0041-4893-b37c-dcd3d9104e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:34.759525 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1114/2198] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:34.769822 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf0b4a-d0c4-40c2-8f42-de779973b6e1 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:34.771279 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-64bf0b4a-d0c4-40c2-8f42-de779973b6e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:34.861887 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf0b4a-d0c4-40c2-8f42-de779973b6e1 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:34.865578 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95b782-fee4-4253-aaef-ec5a0720c108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:34.866215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95b782-fee4-4253-aaef-ec5a0720c108 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:34.866498 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95b782-fee4-4253-aaef-ec5a0720c108 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:34.867079 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95b782-fee4-4253-aaef-ec5a0720c108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:34.876608 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95b782-fee4-4253-aaef-ec5a0720c108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:34.878018 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95b782-fee4-4253-aaef-ec5a0720c108 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:34.887479 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1085/2199] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:11:35.487078 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2796c4a-0041-4893-b37c-dcd3d9104e92 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:35.487078 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a2796c4a-0041-4893-b37c-dcd3d9104e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:35.498521 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2796c4a-0041-4893-b37c-dcd3d9104e92 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:35.503355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122f493-827e-461a-b0ce-6f9c8d49bf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:35.504128 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122f493-827e-461a-b0ce-6f9c8d49bf56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:35.504409 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122f493-827e-461a-b0ce-6f9c8d49bf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:35.504726 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122f493-827e-461a-b0ce-6f9c8d49bf56 admin admin] PATH_INFO: `/v3/projects/e8be461b9219436d9959a73b2c41a25b` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:35.505876 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122f493-827e-461a-b0ce-6f9c8d49bf56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8be461b9219436d9959a73b2c41a25b)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:35.507963 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122f493-827e-461a-b0ce-6f9c8d49bf56 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:35.758254 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-3122f493-827e-461a-b0ce-6f9c8d49bf56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8be461b9219436d9959a73b2c41a25b', 'request_id': 'req-3122f493-827e-461a-b0ce-6f9c8d49bf56'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:35.844639 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-3122f493-827e-461a-b0ce-6f9c8d49bf56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8be461b9219436d9959a73b2c41a25b', 'request_id': 'req-3122f493-827e-461a-b0ce-6f9c8d49bf56'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:35.851028 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-3122f493-827e-461a-b0ce-6f9c8d49bf56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8be461b9219436d9959a73b2c41a25b', 'request_id': 'req-3122f493-827e-461a-b0ce-6f9c8d49bf56'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:35.864974 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-3122f493-827e-461a-b0ce-6f9c8d49bf56 admin admin] The token cache is being invalidate because project e8be461b9219436d9959a73b2c41a25b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:11:35.865772 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-3122f493-827e-461a-b0ce-6f9c8d49bf56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:35.865942 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-3122f493-827e-461a-b0ce-6f9c8d49bf56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:35.867808 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1115/2200] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:11:35 2022] DELETE /identity/v3/projects/e8be461b9219436d9959a73b2c41a25b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:35.871774 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95b782-fee4-4253-aaef-ec5a0720c108 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:35.881825 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95b782-fee4-4253-aaef-ec5a0720c108 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:35.937548 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c8330-a32a-4fad-bf7c-269897ed4d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:35.938431 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c8330-a32a-4fad-bf7c-269897ed4d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:35.938745 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c8330-a32a-4fad-bf7c-269897ed4d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:35.939024 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c8330-a32a-4fad-bf7c-269897ed4d05 admin admin] PATH_INFO: `/v3/users/1506d6dcca2644a3b0d8c2def4c2eab1` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:35.940223 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c8330-a32a-4fad-bf7c-269897ed4d05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1506d6dcca2644a3b0d8c2def4c2eab1)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:35.942121 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c8330-a32a-4fad-bf7c-269897ed4d05 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:36.157977 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a24c8330-a32a-4fad-bf7c-269897ed4d05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1506d6dcca2644a3b0d8c2def4c2eab1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:36.159037 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a24c8330-a32a-4fad-bf7c-269897ed4d05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1506d6dcca2644a3b0d8c2def4c2eab1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:36.170893 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a24c8330-a32a-4fad-bf7c-269897ed4d05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1506d6dcca2644a3b0d8c2def4c2eab1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:36.178417 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a24c8330-a32a-4fad-bf7c-269897ed4d05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1506d6dcca2644a3b0d8c2def4c2eab1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:36.285828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a24c8330-a32a-4fad-bf7c-269897ed4d05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1506d6dcca2644a3b0d8c2def4c2eab1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:36.287915 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1086/2201] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:11:35 2022] DELETE /identity/v3/users/1506d6dcca2644a3b0d8c2def4c2eab1 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:36.747998 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122f493-827e-461a-b0ce-6f9c8d49bf56 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:36.749678 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-3122f493-827e-461a-b0ce-6f9c8d49bf56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:36.764617 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122f493-827e-461a-b0ce-6f9c8d49bf56 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:36.822203 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b423a-f930-4315-af48-6c942180d6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:36.823022 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b423a-f930-4315-af48-6c942180d6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:36.823304 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b423a-f930-4315-af48-6c942180d6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:36.823574 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b423a-f930-4315-af48-6c942180d6dd admin admin] PATH_INFO: `/v3/projects/a17a467dbcca47a2b8c08cd53609d6d1` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:36.824759 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b423a-f930-4315-af48-6c942180d6dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a17a467dbcca47a2b8c08cd53609d6d1)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:36.826820 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b423a-f930-4315-af48-6c942180d6dd admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:36.964523 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-897b423a-f930-4315-af48-6c942180d6dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a17a467dbcca47a2b8c08cd53609d6d1', 'request_id': 'req-897b423a-f930-4315-af48-6c942180d6dd'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:37.055015 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-897b423a-f930-4315-af48-6c942180d6dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a17a467dbcca47a2b8c08cd53609d6d1', 'request_id': 'req-897b423a-f930-4315-af48-6c942180d6dd'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:37.061124 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-897b423a-f930-4315-af48-6c942180d6dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a17a467dbcca47a2b8c08cd53609d6d1', 'request_id': 'req-897b423a-f930-4315-af48-6c942180d6dd'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:37.072399 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-897b423a-f930-4315-af48-6c942180d6dd admin admin] The token cache is being invalidate because project a17a467dbcca47a2b8c08cd53609d6d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:11:37.072639 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-897b423a-f930-4315-af48-6c942180d6dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:37.073270 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-897b423a-f930-4315-af48-6c942180d6dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:37.074856 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1116/2202] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:11:36 2022] DELETE /identity/v3/projects/a17a467dbcca47a2b8c08cd53609d6d1 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:37.080539 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3851e7-c18d-4aee-87ba-3b3f65df9f7a None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:37.081019 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3851e7-c18d-4aee-87ba-3b3f65df9f7a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:37.081114 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3851e7-c18d-4aee-87ba-3b3f65df9f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:37.119406 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-4b3851e7-c18d-4aee-87ba-3b3f65df9f7a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:37.120606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-4b3851e7-c18d-4aee-87ba-3b3f65df9f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:37.182726 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1087/2203] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:37.190802 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360d1f3-13e1-414a-9413-0c1775f2f77a None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:37.191095 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360d1f3-13e1-414a-9413-0c1775f2f77a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:37.191375 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360d1f3-13e1-414a-9413-0c1775f2f77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:37.210545 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-9360d1f3-13e1-414a-9413-0c1775f2f77a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:37.211922 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-9360d1f3-13e1-414a-9413-0c1775f2f77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:37.220719 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1117/2204] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:37.225487 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3851e7-c18d-4aee-87ba-3b3f65df9f7a None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:37.235614 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3851e7-c18d-4aee-87ba-3b3f65df9f7a None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:37.240790 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68275570-ae51-4973-85f4-f7a310820c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:37.246696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68275570-ae51-4973-85f4-f7a310820c24 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:37.246696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68275570-ae51-4973-85f4-f7a310820c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:37.246696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68275570-ae51-4973-85f4-f7a310820c24 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:37.246696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68275570-ae51-4973-85f4-f7a310820c24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:11:37.246696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68275570-ae51-4973-85f4-f7a310820c24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:37.246696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68275570-ae51-4973-85f4-f7a310820c24 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:37.258253 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1088/2205] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:11:37.263442 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360d1f3-13e1-414a-9413-0c1775f2f77a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:37.273946 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360d1f3-13e1-414a-9413-0c1775f2f77a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:37.279874 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e028ab-b3c2-4e7f-94e7-48a55780f89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:37.285356 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e028ab-b3c2-4e7f-94e7-48a55780f89e admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:37.285356 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e028ab-b3c2-4e7f-94e7-48a55780f89e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:37.285356 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e028ab-b3c2-4e7f-94e7-48a55780f89e admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:37.285356 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e028ab-b3c2-4e7f-94e7-48a55780f89e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:37.285356 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e028ab-b3c2-4e7f-94e7-48a55780f89e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:37.385541 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1118/2206] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:11:37 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:11:37.386774 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68275570-ae51-4973-85f4-f7a310820c24 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:37.399201 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68275570-ae51-4973-85f4-f7a310820c24 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:37.470953 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5cbd0-90d3-4a08-8541-6710deec5efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:37.471901 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5cbd0-90d3-4a08-8541-6710deec5efd admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:37.472303 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5cbd0-90d3-4a08-8541-6710deec5efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:37.473925 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5cbd0-90d3-4a08-8541-6710deec5efd admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:37.475091 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5cbd0-90d3-4a08-8541-6710deec5efd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:37.479467 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5cbd0-90d3-4a08-8541-6710deec5efd admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:37.610701 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1089/2207] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:11:37 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:11:37.621824 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e028ab-b3c2-4e7f-94e7-48a55780f89e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:37.632203 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e028ab-b3c2-4e7f-94e7-48a55780f89e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:37.637070 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a906deb-d6aa-4fa7-bd90-cacbd5897c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:37.637737 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a906deb-d6aa-4fa7-bd90-cacbd5897c8c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:37.638020 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a906deb-d6aa-4fa7-bd90-cacbd5897c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:37.638487 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a906deb-d6aa-4fa7-bd90-cacbd5897c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:37.639265 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a906deb-d6aa-4fa7-bd90-cacbd5897c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:37.641494 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a906deb-d6aa-4fa7-bd90-cacbd5897c8c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:37.652209 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1119/2208] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:11:37.656809 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5cbd0-90d3-4a08-8541-6710deec5efd admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:37.666606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5cbd0-90d3-4a08-8541-6710deec5efd admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:37.671372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c6f91-d862-44ae-8f22-8b386e552bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:37.672383 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c6f91-d862-44ae-8f22-8b386e552bff admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:37.672383 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c6f91-d862-44ae-8f22-8b386e552bff admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:37.672636 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c6f91-d862-44ae-8f22-8b386e552bff admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:37.673356 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c6f91-d862-44ae-8f22-8b386e552bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:37.675088 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c6f91-d862-44ae-8f22-8b386e552bff admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:37.685459 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1090/2209] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:11:37.690242 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a906deb-d6aa-4fa7-bd90-cacbd5897c8c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:37.701185 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a906deb-d6aa-4fa7-bd90-cacbd5897c8c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:37.708754 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460de2e3-4123-4524-b0b3-a7b1ac0720e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:37.709741 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460de2e3-4123-4524-b0b3-a7b1ac0720e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:37.710042 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460de2e3-4123-4524-b0b3-a7b1ac0720e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:37.710360 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460de2e3-4123-4524-b0b3-a7b1ac0720e2 admin admin] PATH_INFO: `/v3/projects/a05d735ac5fc41b3bef538932ae047c0/users/30b2c368aa194d02b2c7f8bcb2595ae4/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:37.731267 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460de2e3-4123-4524-b0b3-a7b1ac0720e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a05d735ac5fc41b3bef538932ae047c0, user_id=30b2c368aa194d02b2c7f8bcb2595ae4, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:37.734333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460de2e3-4123-4524-b0b3-a7b1ac0720e2 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:37.847508 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1120/2210] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:37 2022] PUT /identity/v3/projects/a05d735ac5fc41b3bef538932ae047c0/users/30b2c368aa194d02b2c7f8bcb2595ae4/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:37.857958 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0059b47-222b-4af4-878e-0cbd7f1d9226 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:37.858356 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0059b47-222b-4af4-878e-0cbd7f1d9226 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:37.858751 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0059b47-222b-4af4-878e-0cbd7f1d9226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:37.887164 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-b0059b47-222b-4af4-878e-0cbd7f1d9226 None None] MFA Rules not processed for user `30b2c368aa194d02b2c7f8bcb2595ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:37.888567 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b0059b47-222b-4af4-878e-0cbd7f1d9226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:37.955901 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1091/2211] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:37.960382 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460de2e3-4123-4524-b0b3-a7b1ac0720e2 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:38.023797 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460de2e3-4123-4524-b0b3-a7b1ac0720e2 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:38.028572 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9fc0b-d1f0-47ca-9613-74d538537755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:38.029227 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9fc0b-d1f0-47ca-9613-74d538537755 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:38.029509 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9fc0b-d1f0-47ca-9613-74d538537755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:38.029783 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9fc0b-d1f0-47ca-9613-74d538537755 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:38.030473 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9fc0b-d1f0-47ca-9613-74d538537755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:38.032994 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9fc0b-d1f0-47ca-9613-74d538537755 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:38.251284 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1121/2212] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:11:37 2022] POST /identity/v3/projects => generated 385 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:11:38.255434 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0059b47-222b-4af4-878e-0cbd7f1d9226 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:38.265915 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0059b47-222b-4af4-878e-0cbd7f1d9226 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:38.321630 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d042c-be9b-406c-9493-cb6e344f3a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:38.322290 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d042c-be9b-406c-9493-cb6e344f3a56 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:38.322568 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d042c-be9b-406c-9493-cb6e344f3a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:38.322866 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d042c-be9b-406c-9493-cb6e344f3a56 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:38.323555 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d042c-be9b-406c-9493-cb6e344f3a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:38.325427 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d042c-be9b-406c-9493-cb6e344f3a56 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:38.434565 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1092/2213] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:11:38 2022] POST /identity/v3/users => generated 299 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:11:38.440100 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9fc0b-d1f0-47ca-9613-74d538537755 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:38.451085 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9fc0b-d1f0-47ca-9613-74d538537755 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:38.455756 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9530f-c851-454c-bbf1-f99433055aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:38.456417 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9530f-c851-454c-bbf1-f99433055aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:38.456697 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9530f-c851-454c-bbf1-f99433055aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:38.456967 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9530f-c851-454c-bbf1-f99433055aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:38.457683 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9530f-c851-454c-bbf1-f99433055aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:38.459387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9530f-c851-454c-bbf1-f99433055aa6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:38.469328 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1122/2214] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:11:38.478434 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d042c-be9b-406c-9493-cb6e344f3a56 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:38.488954 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d042c-be9b-406c-9493-cb6e344f3a56 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:38.493939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60330037-a8e4-4b93-88d5-40cec1cc661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:38.494846 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60330037-a8e4-4b93-88d5-40cec1cc661e admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:38.495131 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60330037-a8e4-4b93-88d5-40cec1cc661e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:38.495406 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60330037-a8e4-4b93-88d5-40cec1cc661e admin admin] PATH_INFO: `/v3/projects/1e6535e0682c4e749a05d6de62e1deae/users/0988502b7d4d49468441680c10547c23/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:38.510233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60330037-a8e4-4b93-88d5-40cec1cc661e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e6535e0682c4e749a05d6de62e1deae, user_id=0988502b7d4d49468441680c10547c23, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:38.512967 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60330037-a8e4-4b93-88d5-40cec1cc661e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:38.649725 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1093/2215] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:38 2022] PUT /identity/v3/projects/1e6535e0682c4e749a05d6de62e1deae/users/0988502b7d4d49468441680c10547c23/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:38.653804 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9530f-c851-454c-bbf1-f99433055aa6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:38.665955 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9530f-c851-454c-bbf1-f99433055aa6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:38.730557 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd2c0d-0622-49a7-8f5d-2ea98e574c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:38.731257 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd2c0d-0622-49a7-8f5d-2ea98e574c78 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:38.731544 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd2c0d-0622-49a7-8f5d-2ea98e574c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:38.731820 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd2c0d-0622-49a7-8f5d-2ea98e574c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:38.732544 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd2c0d-0622-49a7-8f5d-2ea98e574c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:38.734205 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd2c0d-0622-49a7-8f5d-2ea98e574c78 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:38.747331 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1123/2216] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:11:38.748510 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60330037-a8e4-4b93-88d5-40cec1cc661e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:38.758958 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60330037-a8e4-4b93-88d5-40cec1cc661e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:38.763670 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff4a54-11b4-4347-a40d-cd879f687560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:38.764603 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff4a54-11b4-4347-a40d-cd879f687560 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:38.764947 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff4a54-11b4-4347-a40d-cd879f687560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:38.765285 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff4a54-11b4-4347-a40d-cd879f687560 admin admin] PATH_INFO: `/v3/projects/1e6535e0682c4e749a05d6de62e1deae/users/0988502b7d4d49468441680c10547c23/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:38.768950 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff4a54-11b4-4347-a40d-cd879f687560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e6535e0682c4e749a05d6de62e1deae, user_id=0988502b7d4d49468441680c10547c23, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:38.771717 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff4a54-11b4-4347-a40d-cd879f687560 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:38.783138 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1094/2217] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:38 2022] PUT /identity/v3/projects/1e6535e0682c4e749a05d6de62e1deae/users/0988502b7d4d49468441680c10547c23/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:38.793171 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a085e-58bc-4bfe-b678-e4f468506968 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:38.793461 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a085e-58bc-4bfe-b678-e4f468506968 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:38.793765 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a085e-58bc-4bfe-b678-e4f468506968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:38.820941 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-053a085e-58bc-4bfe-b678-e4f468506968 None None] MFA Rules not processed for user `0988502b7d4d49468441680c10547c23`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:38.822177 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-053a085e-58bc-4bfe-b678-e4f468506968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:38.830517 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff4a54-11b4-4347-a40d-cd879f687560 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:38.832201 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d1ff4a54-11b4-4347-a40d-cd879f687560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:38.893308 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1124/2218] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:38.897448 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff4a54-11b4-4347-a40d-cd879f687560 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:38.902127 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ee618-a4af-4a4b-9c07-0b7a64cd17f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:38.903564 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ee618-a4af-4a4b-9c07-0b7a64cd17f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:38.903710 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a085e-58bc-4bfe-b678-e4f468506968 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:38.903849 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ee618-a4af-4a4b-9c07-0b7a64cd17f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:38.904126 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ee618-a4af-4a4b-9c07-0b7a64cd17f6 admin admin] PATH_INFO: `/v3/users/9f81460fb7204916be2da0091c88e365` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:38.905064 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-053a085e-58bc-4bfe-b678-e4f468506968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:38.905314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ee618-a4af-4a4b-9c07-0b7a64cd17f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f81460fb7204916be2da0091c88e365)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:38.907555 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ee618-a4af-4a4b-9c07-0b7a64cd17f6 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:38.961806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a085e-58bc-4bfe-b678-e4f468506968 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:38.965509 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5936ec-11a4-42b7-afe7-0fcc30e75f96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:38.966146 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5936ec-11a4-42b7-afe7-0fcc30e75f96 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:38.966427 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5936ec-11a4-42b7-afe7-0fcc30e75f96 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:38.966738 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5936ec-11a4-42b7-afe7-0fcc30e75f96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:38.976183 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5936ec-11a4-42b7-afe7-0fcc30e75f96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:38.977598 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5936ec-11a4-42b7-afe7-0fcc30e75f96 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:38.987106 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1125/2219] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:11:39.058513 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5936ec-11a4-42b7-afe7-0fcc30e75f96 service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:39.069644 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5936ec-11a4-42b7-afe7-0fcc30e75f96 service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:39.077620 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690234c-7ec7-4413-9a0c-740e9e5ffe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:39.077620 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690234c-7ec7-4413-9a0c-740e9e5ffe2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:39.077620 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690234c-7ec7-4413-9a0c-740e9e5ffe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:39.077620 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690234c-7ec7-4413-9a0c-740e9e5ffe2b admin admin] PATH_INFO: `/v3/users/30b2c368aa194d02b2c7f8bcb2595ae4` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:39.078710 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690234c-7ec7-4413-9a0c-740e9e5ffe2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=30b2c368aa194d02b2c7f8bcb2595ae4)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:39.079332 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690234c-7ec7-4413-9a0c-740e9e5ffe2b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:39.131926 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e02ee618-a4af-4a4b-9c07-0b7a64cd17f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f81460fb7204916be2da0091c88e365'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:39.132688 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e02ee618-a4af-4a4b-9c07-0b7a64cd17f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f81460fb7204916be2da0091c88e365'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:39.147214 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e02ee618-a4af-4a4b-9c07-0b7a64cd17f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f81460fb7204916be2da0091c88e365'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:39.153924 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e02ee618-a4af-4a4b-9c07-0b7a64cd17f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f81460fb7204916be2da0091c88e365'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:39.249349 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-e02ee618-a4af-4a4b-9c07-0b7a64cd17f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f81460fb7204916be2da0091c88e365'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:39.256226 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1095/2220] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:11:38 2022] DELETE /identity/v3/users/9f81460fb7204916be2da0091c88e365 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:39.260676 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391747a-0541-4d71-ac7e-a62570d67b49 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:39.260958 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391747a-0541-4d71-ac7e-a62570d67b49 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:39.261233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391747a-0541-4d71-ac7e-a62570d67b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:39.279211 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-1391747a-0541-4d71-ac7e-a62570d67b49 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:39.280414 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-1391747a-0541-4d71-ac7e-a62570d67b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:39.291325 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2690234c-7ec7-4413-9a0c-740e9e5ffe2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30b2c368aa194d02b2c7f8bcb2595ae4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:39.291972 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2690234c-7ec7-4413-9a0c-740e9e5ffe2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30b2c368aa194d02b2c7f8bcb2595ae4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:39.304536 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2690234c-7ec7-4413-9a0c-740e9e5ffe2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30b2c368aa194d02b2c7f8bcb2595ae4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:39.319047 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2690234c-7ec7-4413-9a0c-740e9e5ffe2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30b2c368aa194d02b2c7f8bcb2595ae4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:39.319881 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2690234c-7ec7-4413-9a0c-740e9e5ffe2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30b2c368aa194d02b2c7f8bcb2595ae4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:39.340391 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1096/2221] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:39.350107 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391747a-0541-4d71-ac7e-a62570d67b49 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:39.351609 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-1391747a-0541-4d71-ac7e-a62570d67b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:39.398609 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1126/2222] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:11:39 2022] DELETE /identity/v3/users/30b2c368aa194d02b2c7f8bcb2595ae4 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:11:39.410898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ac106-f909-42ff-bebf-d0ec06aa5e8f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:39.410898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ac106-f909-42ff-bebf-d0ec06aa5e8f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:39.410898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ac106-f909-42ff-bebf-d0ec06aa5e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:39.411575 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391747a-0541-4d71-ac7e-a62570d67b49 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:39.422466 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-302ac106-f909-42ff-bebf-d0ec06aa5e8f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:39.423748 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-302ac106-f909-42ff-bebf-d0ec06aa5e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:39.458349 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4687490-193a-493d-a4dd-3f9eb703439a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:39.459031 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4687490-193a-493d-a4dd-3f9eb703439a service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:39.459307 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4687490-193a-493d-a4dd-3f9eb703439a service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:39.459578 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4687490-193a-493d-a4dd-3f9eb703439a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:39.482860 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1127/2223] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:39.493659 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ac106-f909-42ff-bebf-d0ec06aa5e8f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:39.503927 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ac106-f909-42ff-bebf-d0ec06aa5e8f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:39.507556 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af7fa6-f472-4913-9cbb-6701e8ec4f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:39.508190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af7fa6-f472-4913-9cbb-6701e8ec4f08 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:39.508465 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af7fa6-f472-4913-9cbb-6701e8ec4f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:39.508737 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af7fa6-f472-4913-9cbb-6701e8ec4f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:39.517575 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af7fa6-f472-4913-9cbb-6701e8ec4f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:39.519028 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af7fa6-f472-4913-9cbb-6701e8ec4f08 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:39.523980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4687490-193a-493d-a4dd-3f9eb703439a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:39.525172 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4687490-193a-493d-a4dd-3f9eb703439a service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:39.528583 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1128/2224] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:11:39.536103 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1097/2225] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:11:40.061821 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af7fa6-f472-4913-9cbb-6701e8ec4f08 service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:40.064516 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-54af7fa6-f472-4913-9cbb-6701e8ec4f08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:40.081172 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af7fa6-f472-4913-9cbb-6701e8ec4f08 service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:40.087068 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146b9f2-b6f7-40aa-9f3f-3aaea427dfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:40.088316 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146b9f2-b6f7-40aa-9f3f-3aaea427dfc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:40.088711 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146b9f2-b6f7-40aa-9f3f-3aaea427dfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:40.089181 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146b9f2-b6f7-40aa-9f3f-3aaea427dfc9 admin admin] PATH_INFO: `/v3/projects/1efe4df95d184169be887339bb080213` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:40.090871 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146b9f2-b6f7-40aa-9f3f-3aaea427dfc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1efe4df95d184169be887339bb080213)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:40.093580 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146b9f2-b6f7-40aa-9f3f-3aaea427dfc9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:40.265740 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f146b9f2-b6f7-40aa-9f3f-3aaea427dfc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1efe4df95d184169be887339bb080213', 'request_id': 'req-f146b9f2-b6f7-40aa-9f3f-3aaea427dfc9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:40.325234 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4687490-193a-493d-a4dd-3f9eb703439a service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:40.326722 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f4687490-193a-493d-a4dd-3f9eb703439a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:40.339581 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4687490-193a-493d-a4dd-3f9eb703439a service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:40.368561 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f146b9f2-b6f7-40aa-9f3f-3aaea427dfc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1efe4df95d184169be887339bb080213', 'request_id': 'req-f146b9f2-b6f7-40aa-9f3f-3aaea427dfc9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:40.375096 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f146b9f2-b6f7-40aa-9f3f-3aaea427dfc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1efe4df95d184169be887339bb080213', 'request_id': 'req-f146b9f2-b6f7-40aa-9f3f-3aaea427dfc9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:40.386836 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f146b9f2-b6f7-40aa-9f3f-3aaea427dfc9 admin admin] The token cache is being invalidate because project 1efe4df95d184169be887339bb080213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:11:40.387122 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f146b9f2-b6f7-40aa-9f3f-3aaea427dfc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:40.387766 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f146b9f2-b6f7-40aa-9f3f-3aaea427dfc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:40.389488 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1129/2226] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:11:40 2022] DELETE /identity/v3/projects/1efe4df95d184169be887339bb080213 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:40.393441 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146b9f2-b6f7-40aa-9f3f-3aaea427dfc9 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:40.394896 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f146b9f2-b6f7-40aa-9f3f-3aaea427dfc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:40.401419 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cac31-ee3a-4f1c-b7f2-5f5d554c9c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:40.402370 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cac31-ee3a-4f1c-b7f2-5f5d554c9c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:40.402803 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cac31-ee3a-4f1c-b7f2-5f5d554c9c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:40.403080 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cac31-ee3a-4f1c-b7f2-5f5d554c9c65 admin admin] PATH_INFO: `/v3/projects/a05d735ac5fc41b3bef538932ae047c0` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:40.404269 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cac31-ee3a-4f1c-b7f2-5f5d554c9c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a05d735ac5fc41b3bef538932ae047c0)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:40.406723 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cac31-ee3a-4f1c-b7f2-5f5d554c9c65 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:40.465672 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146b9f2-b6f7-40aa-9f3f-3aaea427dfc9 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:40.470902 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5724a90-dc35-4449-a020-833a02a51d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:40.471758 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5724a90-dc35-4449-a020-833a02a51d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:40.472038 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5724a90-dc35-4449-a020-833a02a51d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:40.472311 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5724a90-dc35-4449-a020-833a02a51d76 admin admin] PATH_INFO: `/v3/users/488e2757f22d4b89a7747b909e83c6ba` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:40.473540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5724a90-dc35-4449-a020-833a02a51d76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=488e2757f22d4b89a7747b909e83c6ba)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:40.475468 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5724a90-dc35-4449-a020-833a02a51d76 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:40.593169 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a49cac31-ee3a-4f1c-b7f2-5f5d554c9c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a05d735ac5fc41b3bef538932ae047c0', 'request_id': 'req-a49cac31-ee3a-4f1c-b7f2-5f5d554c9c65'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:40.683700 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a49cac31-ee3a-4f1c-b7f2-5f5d554c9c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a05d735ac5fc41b3bef538932ae047c0', 'request_id': 'req-a49cac31-ee3a-4f1c-b7f2-5f5d554c9c65'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:40.690405 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a49cac31-ee3a-4f1c-b7f2-5f5d554c9c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a05d735ac5fc41b3bef538932ae047c0', 'request_id': 'req-a49cac31-ee3a-4f1c-b7f2-5f5d554c9c65'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:40.701986 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a49cac31-ee3a-4f1c-b7f2-5f5d554c9c65 admin admin] The token cache is being invalidate because project a05d735ac5fc41b3bef538932ae047c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:11:40.702268 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a49cac31-ee3a-4f1c-b7f2-5f5d554c9c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:40.703551 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a49cac31-ee3a-4f1c-b7f2-5f5d554c9c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:40.705776 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1098/2227] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:11:40 2022] DELETE /identity/v3/projects/a05d735ac5fc41b3bef538932ae047c0 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:11:40.710435 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cac31-ee3a-4f1c-b7f2-5f5d554c9c65 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:40.712594 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-a49cac31-ee3a-4f1c-b7f2-5f5d554c9c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:40.723357 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5724a90-dc35-4449-a020-833a02a51d76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '488e2757f22d4b89a7747b909e83c6ba'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:40.724138 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5724a90-dc35-4449-a020-833a02a51d76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '488e2757f22d4b89a7747b909e83c6ba'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:40.737164 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5724a90-dc35-4449-a020-833a02a51d76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '488e2757f22d4b89a7747b909e83c6ba'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:40.743965 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5724a90-dc35-4449-a020-833a02a51d76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '488e2757f22d4b89a7747b909e83c6ba'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:40.744632 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5724a90-dc35-4449-a020-833a02a51d76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '488e2757f22d4b89a7747b909e83c6ba'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:40.788233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cac31-ee3a-4f1c-b7f2-5f5d554c9c65 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:40.793610 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b2a6f-e3bf-4d98-8af3-68b79918d46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:40.795083 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b2a6f-e3bf-4d98-8af3-68b79918d46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:40.795083 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b2a6f-e3bf-4d98-8af3-68b79918d46b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:40.795307 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b2a6f-e3bf-4d98-8af3-68b79918d46b admin admin] PATH_INFO: `/v3/users/0988502b7d4d49468441680c10547c23` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:40.797687 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b2a6f-e3bf-4d98-8af3-68b79918d46b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0988502b7d4d49468441680c10547c23)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:40.799745 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b2a6f-e3bf-4d98-8af3-68b79918d46b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:40.832212 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1130/2228] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:11:40 2022] DELETE /identity/v3/users/488e2757f22d4b89a7747b909e83c6ba => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:11:41.106425 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d66b2a6f-e3bf-4d98-8af3-68b79918d46b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0988502b7d4d49468441680c10547c23'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:41.107375 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d66b2a6f-e3bf-4d98-8af3-68b79918d46b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0988502b7d4d49468441680c10547c23'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:41.127716 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d66b2a6f-e3bf-4d98-8af3-68b79918d46b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0988502b7d4d49468441680c10547c23'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:41.135088 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d66b2a6f-e3bf-4d98-8af3-68b79918d46b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0988502b7d4d49468441680c10547c23'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:41.221004 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d66b2a6f-e3bf-4d98-8af3-68b79918d46b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0988502b7d4d49468441680c10547c23'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:41.229395 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1099/2229] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:11:40 2022] DELETE /identity/v3/users/0988502b7d4d49468441680c10547c23 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:11:41.338182 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5724a90-dc35-4449-a020-833a02a51d76 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:41.344854 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-b5724a90-dc35-4449-a020-833a02a51d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:41.435054 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5724a90-dc35-4449-a020-833a02a51d76 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:41.516415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88259622-0321-4f6c-8340-85ad6d19edd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:41.516415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88259622-0321-4f6c-8340-85ad6d19edd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:41.516415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88259622-0321-4f6c-8340-85ad6d19edd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:41.516415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88259622-0321-4f6c-8340-85ad6d19edd6 admin admin] PATH_INFO: `/v3/projects/8b937e4230a94b30bf0024e3646465a2` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:41.516882 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88259622-0321-4f6c-8340-85ad6d19edd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b937e4230a94b30bf0024e3646465a2)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:41.516882 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88259622-0321-4f6c-8340-85ad6d19edd6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:41.677626 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-88259622-0321-4f6c-8340-85ad6d19edd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b937e4230a94b30bf0024e3646465a2', 'request_id': 'req-88259622-0321-4f6c-8340-85ad6d19edd6'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:41.759287 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b2a6f-e3bf-4d98-8af3-68b79918d46b admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:41.760755 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d66b2a6f-e3bf-4d98-8af3-68b79918d46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:41.769333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-88259622-0321-4f6c-8340-85ad6d19edd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b937e4230a94b30bf0024e3646465a2', 'request_id': 'req-88259622-0321-4f6c-8340-85ad6d19edd6'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:41.775835 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b2a6f-e3bf-4d98-8af3-68b79918d46b admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:41.789261 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-88259622-0321-4f6c-8340-85ad6d19edd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b937e4230a94b30bf0024e3646465a2', 'request_id': 'req-88259622-0321-4f6c-8340-85ad6d19edd6'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:41.803746 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-88259622-0321-4f6c-8340-85ad6d19edd6 admin admin] The token cache is being invalidate because project 8b937e4230a94b30bf0024e3646465a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:11:41.804132 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-88259622-0321-4f6c-8340-85ad6d19edd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:41.804949 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-88259622-0321-4f6c-8340-85ad6d19edd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:41.807155 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1131/2230] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:11:41 2022] DELETE /identity/v3/projects/8b937e4230a94b30bf0024e3646465a2 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:41.814011 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a01203-9394-4066-910e-4f7176cf968d None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:41.814421 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a01203-9394-4066-910e-4f7176cf968d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:41.814897 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a01203-9394-4066-910e-4f7176cf968d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:41.836692 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-b5a01203-9394-4066-910e-4f7176cf968d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:41.838132 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-b5a01203-9394-4066-910e-4f7176cf968d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:41.853041 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d8904-62f5-40f7-82dd-69606a44837a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:41.854013 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d8904-62f5-40f7-82dd-69606a44837a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:41.854351 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d8904-62f5-40f7-82dd-69606a44837a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:41.854671 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d8904-62f5-40f7-82dd-69606a44837a admin admin] PATH_INFO: `/v3/projects/1e6535e0682c4e749a05d6de62e1deae` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:41.856013 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d8904-62f5-40f7-82dd-69606a44837a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e6535e0682c4e749a05d6de62e1deae)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:41.858058 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d8904-62f5-40f7-82dd-69606a44837a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:41.900540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1132/2231] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:11:41.910446 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78328cdb-4231-40c4-9eba-4f340b20923f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:41.910799 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78328cdb-4231-40c4-9eba-4f340b20923f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:41.911077 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78328cdb-4231-40c4-9eba-4f340b20923f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:41.928628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-78328cdb-4231-40c4-9eba-4f340b20923f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:41.929891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-78328cdb-4231-40c4-9eba-4f340b20923f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:41.939100 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1133/2232] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:11:41.943446 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78328cdb-4231-40c4-9eba-4f340b20923f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:41.957494 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78328cdb-4231-40c4-9eba-4f340b20923f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:41.958993 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b30d8904-62f5-40f7-82dd-69606a44837a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e6535e0682c4e749a05d6de62e1deae', 'request_id': 'req-b30d8904-62f5-40f7-82dd-69606a44837a'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:42.009629 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea61aa-aa5f-4c2a-806c-83fc61f996ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:42.010283 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea61aa-aa5f-4c2a-806c-83fc61f996ad admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:42.010564 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea61aa-aa5f-4c2a-806c-83fc61f996ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:42.010867 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea61aa-aa5f-4c2a-806c-83fc61f996ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:42.011577 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea61aa-aa5f-4c2a-806c-83fc61f996ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:11:42.011881 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea61aa-aa5f-4c2a-806c-83fc61f996ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:42.013594 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea61aa-aa5f-4c2a-806c-83fc61f996ad admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:42.026203 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1134/2233] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 17:11:42.031081 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea61aa-aa5f-4c2a-806c-83fc61f996ad admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:42.040241 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea61aa-aa5f-4c2a-806c-83fc61f996ad admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:42.045017 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55820c5-fbfd-4043-b01a-13bd05dab0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:42.045635 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55820c5-fbfd-4043-b01a-13bd05dab0bb admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:42.046088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55820c5-fbfd-4043-b01a-13bd05dab0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:42.046370 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55820c5-fbfd-4043-b01a-13bd05dab0bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:42.047759 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55820c5-fbfd-4043-b01a-13bd05dab0bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:42.049266 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b30d8904-62f5-40f7-82dd-69606a44837a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e6535e0682c4e749a05d6de62e1deae', 'request_id': 'req-b30d8904-62f5-40f7-82dd-69606a44837a'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:42.049619 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55820c5-fbfd-4043-b01a-13bd05dab0bb admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:42.055423 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b30d8904-62f5-40f7-82dd-69606a44837a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e6535e0682c4e749a05d6de62e1deae', 'request_id': 'req-b30d8904-62f5-40f7-82dd-69606a44837a'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:42.067292 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b30d8904-62f5-40f7-82dd-69606a44837a admin admin] The token cache is being invalidate because project 1e6535e0682c4e749a05d6de62e1deae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:11:42.067576 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b30d8904-62f5-40f7-82dd-69606a44837a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:42.069543 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b30d8904-62f5-40f7-82dd-69606a44837a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:42.069705 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1100/2234] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:11:41 2022] DELETE /identity/v3/projects/1e6535e0682c4e749a05d6de62e1deae => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:42.074477 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b8f0e-2afc-420c-a51b-3f8018ec40fa None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:42.074874 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b8f0e-2afc-420c-a51b-3f8018ec40fa None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:42.075201 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b8f0e-2afc-420c-a51b-3f8018ec40fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:42.094106 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-d62b8f0e-2afc-420c-a51b-3f8018ec40fa None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:42.095364 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d62b8f0e-2afc-420c-a51b-3f8018ec40fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:42.103724 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1101/2235] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:11:42.111519 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218840af-dc4b-46a7-8f02-ebab34aba21b None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:42.111805 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218840af-dc4b-46a7-8f02-ebab34aba21b None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:42.112081 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218840af-dc4b-46a7-8f02-ebab34aba21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:42.132412 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-218840af-dc4b-46a7-8f02-ebab34aba21b None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:42.133667 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-218840af-dc4b-46a7-8f02-ebab34aba21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:42.142210 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1102/2236] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:42.146292 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218840af-dc4b-46a7-8f02-ebab34aba21b None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:42.156230 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218840af-dc4b-46a7-8f02-ebab34aba21b None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:42.162443 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897eed6-0585-4939-8d43-8ebd6c616763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:42.163210 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897eed6-0585-4939-8d43-8ebd6c616763 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:42.163518 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897eed6-0585-4939-8d43-8ebd6c616763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:42.163829 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897eed6-0585-4939-8d43-8ebd6c616763 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:42.164549 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897eed6-0585-4939-8d43-8ebd6c616763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:11:42.164964 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897eed6-0585-4939-8d43-8ebd6c616763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:42.166601 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897eed6-0585-4939-8d43-8ebd6c616763 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:42.172379 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1135/2237] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:11:42 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:11:42.173418 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55820c5-fbfd-4043-b01a-13bd05dab0bb admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:42.175240 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e55820c5-fbfd-4043-b01a-13bd05dab0bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:42.179547 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1103/2238] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 17:11:42.183723 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897eed6-0585-4939-8d43-8ebd6c616763 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:42.194141 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897eed6-0585-4939-8d43-8ebd6c616763 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:42.237506 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55820c5-fbfd-4043-b01a-13bd05dab0bb admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:42.242895 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcabe4a-16b1-44a0-bb67-db2e9cd6ccbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:42.243560 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcabe4a-16b1-44a0-bb67-db2e9cd6ccbf admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:42.243973 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcabe4a-16b1-44a0-bb67-db2e9cd6ccbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:42.244249 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcabe4a-16b1-44a0-bb67-db2e9cd6ccbf admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:42.245071 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcabe4a-16b1-44a0-bb67-db2e9cd6ccbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:42.247041 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcabe4a-16b1-44a0-bb67-db2e9cd6ccbf admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:42.247629 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79b837-e716-42b0-89c4-86acd8c0cd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:42.248286 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79b837-e716-42b0-89c4-86acd8c0cd74 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:42.248571 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79b837-e716-42b0-89c4-86acd8c0cd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:42.248980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79b837-e716-42b0-89c4-86acd8c0cd74 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:42.250494 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79b837-e716-42b0-89c4-86acd8c0cd74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:42.252623 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79b837-e716-42b0-89c4-86acd8c0cd74 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:42.371075 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1136/2239] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:11:42 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:11:42.374438 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcabe4a-16b1-44a0-bb67-db2e9cd6ccbf admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:42.385218 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcabe4a-16b1-44a0-bb67-db2e9cd6ccbf admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:42.389938 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878bb64-99f8-43a8-95eb-6a471efdfaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:42.391797 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878bb64-99f8-43a8-95eb-6a471efdfaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:42.392078 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878bb64-99f8-43a8-95eb-6a471efdfaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:42.392353 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878bb64-99f8-43a8-95eb-6a471efdfaa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:42.393062 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878bb64-99f8-43a8-95eb-6a471efdfaa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:42.394628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878bb64-99f8-43a8-95eb-6a471efdfaa6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:42.405037 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1137/2240] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:11:42.407397 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1104/2241] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:11:42 2022] POST /identity/v3/projects => generated 365 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:11:42.410015 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878bb64-99f8-43a8-95eb-6a471efdfaa6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:42.410159 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79b837-e716-42b0-89c4-86acd8c0cd74 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:42.419649 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878bb64-99f8-43a8-95eb-6a471efdfaa6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:42.479641 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644eb482-867e-427e-a853-6dcc58e67899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:42.480299 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eb482-867e-427e-a853-6dcc58e67899 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:42.480575 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eb482-867e-427e-a853-6dcc58e67899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:42.480847 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eb482-867e-427e-a853-6dcc58e67899 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:42.481285 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79b837-e716-42b0-89c4-86acd8c0cd74 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:42.481606 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644eb482-867e-427e-a853-6dcc58e67899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:42.483232 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644eb482-867e-427e-a853-6dcc58e67899 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:42.494229 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5d22a-4126-4da6-945e-2305c6f1bc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:42.494768 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1138/2242] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:11:42.494970 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5d22a-4126-4da6-945e-2305c6f1bc7b admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:42.495340 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5d22a-4126-4da6-945e-2305c6f1bc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:42.495643 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5d22a-4126-4da6-945e-2305c6f1bc7b admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:42.496439 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5d22a-4126-4da6-945e-2305c6f1bc7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:42.498451 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5d22a-4126-4da6-945e-2305c6f1bc7b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:42.498567 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644eb482-867e-427e-a853-6dcc58e67899 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:42.511274 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644eb482-867e-427e-a853-6dcc58e67899 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:42.516437 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a16cc-ae5d-4adc-b2fe-123e10b947df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:42.517368 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a16cc-ae5d-4adc-b2fe-123e10b947df admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:42.517678 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a16cc-ae5d-4adc-b2fe-123e10b947df admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:42.517999 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a16cc-ae5d-4adc-b2fe-123e10b947df admin admin] PATH_INFO: `/v3/projects/33623ad207bb4b9a94d71d55346a2e4b/users/9a3d90839b69414f92c44b09afbcebf0/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:42.535996 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a16cc-ae5d-4adc-b2fe-123e10b947df admin admin] RBAC: Authorizing `identity:create_grant(project_id=33623ad207bb4b9a94d71d55346a2e4b, user_id=9a3d90839b69414f92c44b09afbcebf0, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:42.539780 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a16cc-ae5d-4adc-b2fe-123e10b947df admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:42.655271 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1105/2243] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:11:42 2022] POST /identity/v3/users => generated 283 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:11:42.660007 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5d22a-4126-4da6-945e-2305c6f1bc7b admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:42.669325 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5d22a-4126-4da6-945e-2305c6f1bc7b admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:42.676620 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdfb30-61d6-43c6-a2fb-e28a847ab6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:42.676620 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdfb30-61d6-43c6-a2fb-e28a847ab6ba admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:42.676620 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdfb30-61d6-43c6-a2fb-e28a847ab6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:42.676620 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdfb30-61d6-43c6-a2fb-e28a847ab6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:42.676932 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfdfb30-61d6-43c6-a2fb-e28a847ab6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:42.677903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1139/2244] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:42 2022] PUT /identity/v3/projects/33623ad207bb4b9a94d71d55346a2e4b/users/9a3d90839b69414f92c44b09afbcebf0/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:11:42.678208 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfdfb30-61d6-43c6-a2fb-e28a847ab6ba admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:42.688395 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1106/2245] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:11:42.688604 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defea4db-3e65-4113-8943-24ab0640e63f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:42.689004 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defea4db-3e65-4113-8943-24ab0640e63f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:42.689287 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defea4db-3e65-4113-8943-24ab0640e63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:42.692080 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdfb30-61d6-43c6-a2fb-e28a847ab6ba admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:42.701631 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdfb30-61d6-43c6-a2fb-e28a847ab6ba admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:42.715064 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-defea4db-3e65-4113-8943-24ab0640e63f None None] MFA Rules not processed for user `9a3d90839b69414f92c44b09afbcebf0`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:42.722492 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-defea4db-3e65-4113-8943-24ab0640e63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:42.757593 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f4b5b-81fb-47c7-bb8d-b2122986b6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:42.758256 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f4b5b-81fb-47c7-bb8d-b2122986b6be admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:42.758539 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f4b5b-81fb-47c7-bb8d-b2122986b6be admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:42.758845 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f4b5b-81fb-47c7-bb8d-b2122986b6be admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:42.759577 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f4b5b-81fb-47c7-bb8d-b2122986b6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:42.761167 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f4b5b-81fb-47c7-bb8d-b2122986b6be admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:42.771899 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1107/2246] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:11:42.776127 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f4b5b-81fb-47c7-bb8d-b2122986b6be admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:42.786535 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f4b5b-81fb-47c7-bb8d-b2122986b6be admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:42.790306 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1140/2247] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:11:42.791337 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defea4db-3e65-4113-8943-24ab0640e63f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:42.791621 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d443db-35a9-43c8-8094-01261f86aea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:42.792514 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d443db-35a9-43c8-8094-01261f86aea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:42.792798 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d443db-35a9-43c8-8094-01261f86aea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:42.793229 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d443db-35a9-43c8-8094-01261f86aea9 admin admin] PATH_INFO: `/v3/projects/29b1f17925bc4a49a2c72b515b7025d7/users/9009dbf3935c4ba199828848bac9bbb4/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:42.808659 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defea4db-3e65-4113-8943-24ab0640e63f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:42.809722 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d443db-35a9-43c8-8094-01261f86aea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b1f17925bc4a49a2c72b515b7025d7, user_id=9009dbf3935c4ba199828848bac9bbb4, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:42.813229 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d443db-35a9-43c8-8094-01261f86aea9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:42.814099 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abf537-c2d4-4bab-aa7d-dfbfaa3181a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:42.814790 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abf537-c2d4-4bab-aa7d-dfbfaa3181a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:42.815076 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abf537-c2d4-4bab-aa7d-dfbfaa3181a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:42.815355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abf537-c2d4-4bab-aa7d-dfbfaa3181a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:42.816069 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abf537-c2d4-4bab-aa7d-dfbfaa3181a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:42.817961 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abf537-c2d4-4bab-aa7d-dfbfaa3181a1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:42.902522 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1108/2248] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:42 2022] PUT /identity/v3/projects/29b1f17925bc4a49a2c72b515b7025d7/users/9009dbf3935c4ba199828848bac9bbb4/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:11:42.920407 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff46a9-b74c-4a40-87be-55c0f88f401b None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:42.920630 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff46a9-b74c-4a40-87be-55c0f88f401b None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:42.920910 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff46a9-b74c-4a40-87be-55c0f88f401b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:42.949357 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-61ff46a9-b74c-4a40-87be-55c0f88f401b None None] MFA Rules not processed for user `9009dbf3935c4ba199828848bac9bbb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:42.950579 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-61ff46a9-b74c-4a40-87be-55c0f88f401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:42.991300 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1141/2249] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:11:42 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:11:42.992310 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abf537-c2d4-4bab-aa7d-dfbfaa3181a1 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:43.013739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1109/2250] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:11:43.018895 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff46a9-b74c-4a40-87be-55c0f88f401b None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:43.052638 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abf537-c2d4-4bab-aa7d-dfbfaa3181a1 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:43.057363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec4ffd-33de-4b85-b36f-1cbbdad562cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:43.058023 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec4ffd-33de-4b85-b36f-1cbbdad562cf admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:43.058303 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec4ffd-33de-4b85-b36f-1cbbdad562cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:43.058573 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec4ffd-33de-4b85-b36f-1cbbdad562cf admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:43.059290 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec4ffd-33de-4b85-b36f-1cbbdad562cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:43.061223 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec4ffd-33de-4b85-b36f-1cbbdad562cf admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:43.079353 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff46a9-b74c-4a40-87be-55c0f88f401b None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:43.084033 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5083e67-1978-4451-a4b4-12cd631a1599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:43.084681 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5083e67-1978-4451-a4b4-12cd631a1599 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:43.085127 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5083e67-1978-4451-a4b4-12cd631a1599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:43.085412 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5083e67-1978-4451-a4b4-12cd631a1599 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:43.086106 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5083e67-1978-4451-a4b4-12cd631a1599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:43.088022 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5083e67-1978-4451-a4b4-12cd631a1599 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:43.141071 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1142/2251] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:11:42 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:11:43.145025 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec4ffd-33de-4b85-b36f-1cbbdad562cf admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:43.154465 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec4ffd-33de-4b85-b36f-1cbbdad562cf admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:43.159868 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1b506-5638-420c-b638-010f38775d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:43.160505 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1b506-5638-420c-b638-010f38775d28 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:43.160788 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1b506-5638-420c-b638-010f38775d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:43.161067 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1b506-5638-420c-b638-010f38775d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:43.161779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1b506-5638-420c-b638-010f38775d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:43.163398 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1b506-5638-420c-b638-010f38775d28 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:43.173123 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1143/2252] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:11:43.176862 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1b506-5638-420c-b638-010f38775d28 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:43.186461 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1b506-5638-420c-b638-010f38775d28 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:43.191479 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b04b2-ce2e-4d7e-82f7-841ae0d368ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:43.192180 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b04b2-ce2e-4d7e-82f7-841ae0d368ab admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:43.192441 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b04b2-ce2e-4d7e-82f7-841ae0d368ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:43.192715 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b04b2-ce2e-4d7e-82f7-841ae0d368ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:43.193426 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b04b2-ce2e-4d7e-82f7-841ae0d368ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:43.195039 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b04b2-ce2e-4d7e-82f7-841ae0d368ab admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:43.207841 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1144/2253] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:11:43.211543 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b04b2-ce2e-4d7e-82f7-841ae0d368ab admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:43.215499 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1110/2254] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:11:43 2022] POST /identity/v3/projects => generated 365 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:11:43.221841 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b04b2-ce2e-4d7e-82f7-841ae0d368ab admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:43.223119 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5083e67-1978-4451-a4b4-12cd631a1599 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:43.284375 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dbae8-6860-4055-91d5-a300fb402fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:43.284867 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5083e67-1978-4451-a4b4-12cd631a1599 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:43.285132 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dbae8-6860-4055-91d5-a300fb402fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:43.285417 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dbae8-6860-4055-91d5-a300fb402fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:43.285691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dbae8-6860-4055-91d5-a300fb402fe1 admin admin] PATH_INFO: `/v3/projects/d6605f86632b467b804bf7dd67a2cb62/users/1cd0e30160e84e56964589f9fd102240/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:43.290162 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130262f0-cce6-4b9d-837e-bf43a7849859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:43.290874 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130262f0-cce6-4b9d-837e-bf43a7849859 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:43.291159 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130262f0-cce6-4b9d-837e-bf43a7849859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:43.291508 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130262f0-cce6-4b9d-837e-bf43a7849859 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:43.292123 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130262f0-cce6-4b9d-837e-bf43a7849859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:43.294048 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130262f0-cce6-4b9d-837e-bf43a7849859 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:43.302796 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dbae8-6860-4055-91d5-a300fb402fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6605f86632b467b804bf7dd67a2cb62, user_id=1cd0e30160e84e56964589f9fd102240, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:43.305681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dbae8-6860-4055-91d5-a300fb402fe1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:43.404871 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1111/2255] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:11:43 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:11:43.409051 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130262f0-cce6-4b9d-837e-bf43a7849859 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:43.418604 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130262f0-cce6-4b9d-837e-bf43a7849859 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:43.423956 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d364a1-4fff-46af-9263-1faf70f1f8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:43.424861 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d364a1-4fff-46af-9263-1faf70f1f8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:43.425292 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d364a1-4fff-46af-9263-1faf70f1f8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:43.425695 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d364a1-4fff-46af-9263-1faf70f1f8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:43.426717 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d364a1-4fff-46af-9263-1faf70f1f8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:43.428927 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d364a1-4fff-46af-9263-1faf70f1f8d5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:43.440249 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1112/2256] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:11:43.443666 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1145/2257] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:43 2022] PUT /identity/v3/projects/d6605f86632b467b804bf7dd67a2cb62/users/1cd0e30160e84e56964589f9fd102240/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:11:43.444280 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d364a1-4fff-46af-9263-1faf70f1f8d5 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:43.454940 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d364a1-4fff-46af-9263-1faf70f1f8d5 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:43.461503 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af0c7e-e7fb-4baf-a98a-bf61b7f13ee1 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:43.461790 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af0c7e-e7fb-4baf-a98a-bf61b7f13ee1 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:43.462062 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af0c7e-e7fb-4baf-a98a-bf61b7f13ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:43.490190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-05af0c7e-e7fb-4baf-a98a-bf61b7f13ee1 None None] MFA Rules not processed for user `1cd0e30160e84e56964589f9fd102240`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:43.491556 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-05af0c7e-e7fb-4baf-a98a-bf61b7f13ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:43.511873 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff1793-08e5-46f9-aa1c-11eeb4e2c3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:43.512755 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff1793-08e5-46f9-aa1c-11eeb4e2c3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:43.513034 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff1793-08e5-46f9-aa1c-11eeb4e2c3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:43.513309 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff1793-08e5-46f9-aa1c-11eeb4e2c3d6 admin admin] PATH_INFO: `/v3/projects/640c28e7752b483ca3201ffc84b3a9d2/users/7a0eeb5b2bb841febefb87d4b6be3753/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:43.528968 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff1793-08e5-46f9-aa1c-11eeb4e2c3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=640c28e7752b483ca3201ffc84b3a9d2, user_id=7a0eeb5b2bb841febefb87d4b6be3753, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:43.532330 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff1793-08e5-46f9-aa1c-11eeb4e2c3d6 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:43.558514 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1146/2258] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:11:43.563667 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af0c7e-e7fb-4baf-a98a-bf61b7f13ee1 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:43.573776 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af0c7e-e7fb-4baf-a98a-bf61b7f13ee1 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:43.580743 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74b6e5-b97b-4299-8728-151f9f7289b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:43.581401 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74b6e5-b97b-4299-8728-151f9f7289b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:43.581678 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74b6e5-b97b-4299-8728-151f9f7289b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:43.581950 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74b6e5-b97b-4299-8728-151f9f7289b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:43.582633 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74b6e5-b97b-4299-8728-151f9f7289b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:43.584617 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74b6e5-b97b-4299-8728-151f9f7289b6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:43.633047 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1113/2259] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:43 2022] PUT /identity/v3/projects/640c28e7752b483ca3201ffc84b3a9d2/users/7a0eeb5b2bb841febefb87d4b6be3753/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:11:43.642893 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff1793-08e5-46f9-aa1c-11eeb4e2c3d6 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:43.690266 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1147/2260] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:11:43 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:11:43.691269 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74b6e5-b97b-4299-8728-151f9f7289b6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:43.708708 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff1793-08e5-46f9-aa1c-11eeb4e2c3d6 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:43.755253 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74b6e5-b97b-4299-8728-151f9f7289b6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:43.760382 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b895114-4806-4433-83d6-4d26f82c9325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:43.760939 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895114-4806-4433-83d6-4d26f82c9325 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:43.761224 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895114-4806-4433-83d6-4d26f82c9325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:43.761501 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895114-4806-4433-83d6-4d26f82c9325 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:43.762424 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b895114-4806-4433-83d6-4d26f82c9325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:43.764368 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b895114-4806-4433-83d6-4d26f82c9325 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:43.778822 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b392a-941a-4433-b489-dfbc937f4066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:43.779638 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b392a-941a-4433-b489-dfbc937f4066 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:43.779921 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b392a-941a-4433-b489-dfbc937f4066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:43.780345 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b392a-941a-4433-b489-dfbc937f4066 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:43.780976 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b392a-941a-4433-b489-dfbc937f4066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:43.782761 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b392a-941a-4433-b489-dfbc937f4066 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:43.795360 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1114/2261] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:11:43.797345 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b392a-941a-4433-b489-dfbc937f4066 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:43.806907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b392a-941a-4433-b489-dfbc937f4066 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:43.811464 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0940839-5b03-4eac-8b1c-255f755bac5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:43.813151 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0940839-5b03-4eac-8b1c-255f755bac5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:43.813426 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0940839-5b03-4eac-8b1c-255f755bac5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:43.813699 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0940839-5b03-4eac-8b1c-255f755bac5b admin admin] PATH_INFO: `/v3/projects/640c28e7752b483ca3201ffc84b3a9d2/users/7a0eeb5b2bb841febefb87d4b6be3753/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:43.815669 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0940839-5b03-4eac-8b1c-255f755bac5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=640c28e7752b483ca3201ffc84b3a9d2, user_id=7a0eeb5b2bb841febefb87d4b6be3753, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:43.818225 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0940839-5b03-4eac-8b1c-255f755bac5b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:43.828036 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1115/2262] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:43 2022] PUT /identity/v3/projects/640c28e7752b483ca3201ffc84b3a9d2/users/7a0eeb5b2bb841febefb87d4b6be3753/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:11:43.837638 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b06944-c3a6-4b6a-8f17-0fecd27a135c None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:43.837921 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b06944-c3a6-4b6a-8f17-0fecd27a135c None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:43.838195 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b06944-c3a6-4b6a-8f17-0fecd27a135c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:43.864350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-e7b06944-c3a6-4b6a-8f17-0fecd27a135c None None] MFA Rules not processed for user `7a0eeb5b2bb841febefb87d4b6be3753`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:43.865572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e7b06944-c3a6-4b6a-8f17-0fecd27a135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:43.906519 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1148/2263] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:11:43 2022] POST /identity/v3/users => generated 294 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:11:43.910163 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b895114-4806-4433-83d6-4d26f82c9325 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:43.920222 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b895114-4806-4433-83d6-4d26f82c9325 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:43.935844 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1116/2264] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:11:43.950395 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b06944-c3a6-4b6a-8f17-0fecd27a135c None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:43.950395 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e7b06944-c3a6-4b6a-8f17-0fecd27a135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:43.981180 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b3b9b-aac1-45ec-9db0-3c03377d7b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:43.982335 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b3b9b-aac1-45ec-9db0-3c03377d7b26 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:43.982741 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b3b9b-aac1-45ec-9db0-3c03377d7b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:43.989731 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b3b9b-aac1-45ec-9db0-3c03377d7b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:43.989731 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b3b9b-aac1-45ec-9db0-3c03377d7b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:43.989731 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b3b9b-aac1-45ec-9db0-3c03377d7b26 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:43.997852 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1149/2265] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:11:44.004361 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b3b9b-aac1-45ec-9db0-3c03377d7b26 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:44.019717 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b3b9b-aac1-45ec-9db0-3c03377d7b26 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:44.024387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb225d6-e8b6-4aa0-bad7-e05ec0af1344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:44.025608 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb225d6-e8b6-4aa0-bad7-e05ec0af1344 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:44.025891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb225d6-e8b6-4aa0-bad7-e05ec0af1344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:44.026161 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb225d6-e8b6-4aa0-bad7-e05ec0af1344 admin admin] PATH_INFO: `/v3/projects/ff870cfb0b6a4706a051ad695f5ea104/users/afd912fdbafa4d77955ef78ef65017ca/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:44.033229 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b06944-c3a6-4b6a-8f17-0fecd27a135c None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:44.037416 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133e2fe-b56a-4eb1-af01-04269837610e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:44.038192 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133e2fe-b56a-4eb1-af01-04269837610e service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:44.038958 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133e2fe-b56a-4eb1-af01-04269837610e service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:44.038958 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133e2fe-b56a-4eb1-af01-04269837610e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:44.043650 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb225d6-e8b6-4aa0-bad7-e05ec0af1344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff870cfb0b6a4706a051ad695f5ea104, user_id=afd912fdbafa4d77955ef78ef65017ca, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:44.046400 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb225d6-e8b6-4aa0-bad7-e05ec0af1344 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:44.050680 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133e2fe-b56a-4eb1-af01-04269837610e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:44.052329 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133e2fe-b56a-4eb1-af01-04269837610e service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:44.064426 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1117/2266] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:11:44.129875 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1150/2267] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:44 2022] PUT /identity/v3/projects/ff870cfb0b6a4706a051ad695f5ea104/users/afd912fdbafa4d77955ef78ef65017ca/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:11:44.133821 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133e2fe-b56a-4eb1-af01-04269837610e service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:44.144232 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133e2fe-b56a-4eb1-af01-04269837610e service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:44.211308 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5501b-c30b-4c57-81d9-33eae756dcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:44.212550 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5501b-c30b-4c57-81d9-33eae756dcdf admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:44.212841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5501b-c30b-4c57-81d9-33eae756dcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:44.213322 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5501b-c30b-4c57-81d9-33eae756dcdf admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:44.214207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5501b-c30b-4c57-81d9-33eae756dcdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:44.216207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5501b-c30b-4c57-81d9-33eae756dcdf admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:44.228720 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1118/2268] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:11:44.233201 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb225d6-e8b6-4aa0-bad7-e05ec0af1344 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:44.244433 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb225d6-e8b6-4aa0-bad7-e05ec0af1344 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:44.249086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34190b-12cc-465b-98b9-d8ec4c950ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:44.250208 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34190b-12cc-465b-98b9-d8ec4c950ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:44.250484 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34190b-12cc-465b-98b9-d8ec4c950ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:44.250816 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34190b-12cc-465b-98b9-d8ec4c950ddb admin admin] PATH_INFO: `/v3/projects/ff870cfb0b6a4706a051ad695f5ea104/users/afd912fdbafa4d77955ef78ef65017ca/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:44.252766 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34190b-12cc-465b-98b9-d8ec4c950ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff870cfb0b6a4706a051ad695f5ea104, user_id=afd912fdbafa4d77955ef78ef65017ca, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:44.255460 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34190b-12cc-465b-98b9-d8ec4c950ddb admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:44.267976 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1151/2269] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:44 2022] PUT /identity/v3/projects/ff870cfb0b6a4706a051ad695f5ea104/users/afd912fdbafa4d77955ef78ef65017ca/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:11:44.279020 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89828968-56ae-4fd9-a8ef-c20f48769d46 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:44.279331 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89828968-56ae-4fd9-a8ef-c20f48769d46 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:44.280100 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89828968-56ae-4fd9-a8ef-c20f48769d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:44.309606 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34190b-12cc-465b-98b9-d8ec4c950ddb admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:44.312880 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-89828968-56ae-4fd9-a8ef-c20f48769d46 None None] MFA Rules not processed for user `afd912fdbafa4d77955ef78ef65017ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:44.314525 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-89828968-56ae-4fd9-a8ef-c20f48769d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:44.379326 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34190b-12cc-465b-98b9-d8ec4c950ddb admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:44.386681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59320687-7cb3-4b81-aaa2-bb398ed00257 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:44.386681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59320687-7cb3-4b81-aaa2-bb398ed00257 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:44.386681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59320687-7cb3-4b81-aaa2-bb398ed00257 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:44.386681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59320687-7cb3-4b81-aaa2-bb398ed00257 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:44.431638 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1119/2270] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:44.443737 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89828968-56ae-4fd9-a8ef-c20f48769d46 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:44.445775 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-89828968-56ae-4fd9-a8ef-c20f48769d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:44.466482 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89828968-56ae-4fd9-a8ef-c20f48769d46 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:44.472134 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bec4c2-e65e-45c4-bcb3-2dbcd98bad4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:44.472804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bec4c2-e65e-45c4-bcb3-2dbcd98bad4c service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:44.473092 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bec4c2-e65e-45c4-bcb3-2dbcd98bad4c service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:44.473369 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bec4c2-e65e-45c4-bcb3-2dbcd98bad4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:44.476748 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59320687-7cb3-4b81-aaa2-bb398ed00257 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:44.478423 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59320687-7cb3-4b81-aaa2-bb398ed00257 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:44.488743 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1152/2271] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:11:44.532244 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bec4c2-e65e-45c4-bcb3-2dbcd98bad4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:44.533677 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bec4c2-e65e-45c4-bcb3-2dbcd98bad4c service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:44.542844 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1120/2272] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:11:48.690167 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59320687-7cb3-4b81-aaa2-bb398ed00257 service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:48.698465 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59320687-7cb3-4b81-aaa2-bb398ed00257 service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:48.701965 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be06fbb-dea9-410f-8946-e96d36fc68ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:48.702588 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be06fbb-dea9-410f-8946-e96d36fc68ae service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:48.702896 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be06fbb-dea9-410f-8946-e96d36fc68ae service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:48.703167 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be06fbb-dea9-410f-8946-e96d36fc68ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:48.758316 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be06fbb-dea9-410f-8946-e96d36fc68ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:48.759778 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be06fbb-dea9-410f-8946-e96d36fc68ae service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:48.769450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1153/2273] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:11:51.196646 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bec4c2-e65e-45c4-bcb3-2dbcd98bad4c service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:51.205517 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bec4c2-e65e-45c4-bcb3-2dbcd98bad4c service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:51.209311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad106e1-6fd4-427e-8f57-e3c711b228d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:51.209938 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad106e1-6fd4-427e-8f57-e3c711b228d9 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:51.210216 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad106e1-6fd4-427e-8f57-e3c711b228d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:51.210489 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad106e1-6fd4-427e-8f57-e3c711b228d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:51.219466 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad106e1-6fd4-427e-8f57-e3c711b228d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:51.221008 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad106e1-6fd4-427e-8f57-e3c711b228d9 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:51.230228 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1121/2274] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:11:55.828200 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be06fbb-dea9-410f-8946-e96d36fc68ae service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:55.889370 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be06fbb-dea9-410f-8946-e96d36fc68ae service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:55.894708 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df539c35-dd20-4a99-9827-7502f221372f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:55.895566 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df539c35-dd20-4a99-9827-7502f221372f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:55.895845 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df539c35-dd20-4a99-9827-7502f221372f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:55.896115 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df539c35-dd20-4a99-9827-7502f221372f admin admin] PATH_INFO: `/v3/users/9009dbf3935c4ba199828848bac9bbb4` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:55.897303 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df539c35-dd20-4a99-9827-7502f221372f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9009dbf3935c4ba199828848bac9bbb4)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:55.899230 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df539c35-dd20-4a99-9827-7502f221372f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:56.136311 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-df539c35-dd20-4a99-9827-7502f221372f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9009dbf3935c4ba199828848bac9bbb4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:56.136969 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-df539c35-dd20-4a99-9827-7502f221372f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9009dbf3935c4ba199828848bac9bbb4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:56.148701 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-df539c35-dd20-4a99-9827-7502f221372f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9009dbf3935c4ba199828848bac9bbb4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:56.155231 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-df539c35-dd20-4a99-9827-7502f221372f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9009dbf3935c4ba199828848bac9bbb4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:56.155856 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-df539c35-dd20-4a99-9827-7502f221372f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9009dbf3935c4ba199828848bac9bbb4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:56.260915 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1154/2275] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:11:55 2022] DELETE /identity/v3/users/9009dbf3935c4ba199828848bac9bbb4 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:56.281989 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a94d17-1874-4010-8217-c044f57872ec None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:56.281989 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a94d17-1874-4010-8217-c044f57872ec None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:56.281989 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a94d17-1874-4010-8217-c044f57872ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:56.285161 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-49a94d17-1874-4010-8217-c044f57872ec None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:56.286388 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-49a94d17-1874-4010-8217-c044f57872ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:56.352508 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1122/2276] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:56.363386 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df539c35-dd20-4a99-9827-7502f221372f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:56.364876 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-df539c35-dd20-4a99-9827-7502f221372f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:56.426087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df539c35-dd20-4a99-9827-7502f221372f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:56.429751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601ac99-db71-4eb9-a95c-14c2c7332bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:56.430399 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601ac99-db71-4eb9-a95c-14c2c7332bbe service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:56.430710 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601ac99-db71-4eb9-a95c-14c2c7332bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:56.430988 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601ac99-db71-4eb9-a95c-14c2c7332bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:56.448022 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601ac99-db71-4eb9-a95c-14c2c7332bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:56.448022 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601ac99-db71-4eb9-a95c-14c2c7332bbe service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:56.457315 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1155/2277] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:11:56.902023 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a94d17-1874-4010-8217-c044f57872ec None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:56.903470 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-49a94d17-1874-4010-8217-c044f57872ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:56.915165 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a94d17-1874-4010-8217-c044f57872ec None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:56.920074 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425c54f-5439-483e-897f-fae4ed301bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:56.920917 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425c54f-5439-483e-897f-fae4ed301bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:56.921261 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425c54f-5439-483e-897f-fae4ed301bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:56.921457 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425c54f-5439-483e-897f-fae4ed301bb3 admin admin] PATH_INFO: `/v3/projects/29b1f17925bc4a49a2c72b515b7025d7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:56.922824 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425c54f-5439-483e-897f-fae4ed301bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29b1f17925bc4a49a2c72b515b7025d7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:56.924705 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425c54f-5439-483e-897f-fae4ed301bb3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:57.049825 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6425c54f-5439-483e-897f-fae4ed301bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b1f17925bc4a49a2c72b515b7025d7', 'request_id': 'req-6425c54f-5439-483e-897f-fae4ed301bb3'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:57.175088 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6425c54f-5439-483e-897f-fae4ed301bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b1f17925bc4a49a2c72b515b7025d7', 'request_id': 'req-6425c54f-5439-483e-897f-fae4ed301bb3'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:57.181640 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6425c54f-5439-483e-897f-fae4ed301bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b1f17925bc4a49a2c72b515b7025d7', 'request_id': 'req-6425c54f-5439-483e-897f-fae4ed301bb3'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:57.194422 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6425c54f-5439-483e-897f-fae4ed301bb3 admin admin] The token cache is being invalidate because project 29b1f17925bc4a49a2c72b515b7025d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:11:57.199205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6425c54f-5439-483e-897f-fae4ed301bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:57.199205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6425c54f-5439-483e-897f-fae4ed301bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:57.199205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1123/2278] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:11:56 2022] DELETE /identity/v3/projects/29b1f17925bc4a49a2c72b515b7025d7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:11:57.201440 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601ac99-db71-4eb9-a95c-14c2c7332bbe service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:57.213288 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601ac99-db71-4eb9-a95c-14c2c7332bbe service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:57.276883 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79044fbc-fb07-49e7-8e58-e482e8aa33e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:57.277772 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79044fbc-fb07-49e7-8e58-e482e8aa33e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:57.278058 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79044fbc-fb07-49e7-8e58-e482e8aa33e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:57.278338 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79044fbc-fb07-49e7-8e58-e482e8aa33e7 admin admin] PATH_INFO: `/v3/users/7a0eeb5b2bb841febefb87d4b6be3753` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:57.279546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79044fbc-fb07-49e7-8e58-e482e8aa33e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a0eeb5b2bb841febefb87d4b6be3753)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:57.285155 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79044fbc-fb07-49e7-8e58-e482e8aa33e7 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:57.566116 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-79044fbc-fb07-49e7-8e58-e482e8aa33e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a0eeb5b2bb841febefb87d4b6be3753'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:57.566863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-79044fbc-fb07-49e7-8e58-e482e8aa33e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a0eeb5b2bb841febefb87d4b6be3753'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:57.580243 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-79044fbc-fb07-49e7-8e58-e482e8aa33e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a0eeb5b2bb841febefb87d4b6be3753'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:57.587540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-79044fbc-fb07-49e7-8e58-e482e8aa33e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a0eeb5b2bb841febefb87d4b6be3753'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:57.588294 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-79044fbc-fb07-49e7-8e58-e482e8aa33e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a0eeb5b2bb841febefb87d4b6be3753'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:57.671424 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1156/2279] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:11:57 2022] DELETE /identity/v3/users/7a0eeb5b2bb841febefb87d4b6be3753 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:58.102619 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425c54f-5439-483e-897f-fae4ed301bb3 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:58.104181 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6425c54f-5439-483e-897f-fae4ed301bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:58.117420 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425c54f-5439-483e-897f-fae4ed301bb3 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:58.172815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0ae4a-7895-4036-9987-8601922d17df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:58.173669 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0ae4a-7895-4036-9987-8601922d17df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:58.173951 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0ae4a-7895-4036-9987-8601922d17df admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:58.174225 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0ae4a-7895-4036-9987-8601922d17df admin admin] PATH_INFO: `/v3/projects/640c28e7752b483ca3201ffc84b3a9d2` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:58.175447 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0ae4a-7895-4036-9987-8601922d17df admin admin] RBAC: Authorizing `identity:delete_project(project_id=640c28e7752b483ca3201ffc84b3a9d2)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:58.177355 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0ae4a-7895-4036-9987-8601922d17df admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:58.334283 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-cbe0ae4a-7895-4036-9987-8601922d17df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '640c28e7752b483ca3201ffc84b3a9d2', 'request_id': 'req-cbe0ae4a-7895-4036-9987-8601922d17df'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:58.443249 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-cbe0ae4a-7895-4036-9987-8601922d17df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '640c28e7752b483ca3201ffc84b3a9d2', 'request_id': 'req-cbe0ae4a-7895-4036-9987-8601922d17df'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:58.449166 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-cbe0ae4a-7895-4036-9987-8601922d17df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '640c28e7752b483ca3201ffc84b3a9d2', 'request_id': 'req-cbe0ae4a-7895-4036-9987-8601922d17df'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:58.461081 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-cbe0ae4a-7895-4036-9987-8601922d17df admin admin] The token cache is being invalidate because project 640c28e7752b483ca3201ffc84b3a9d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:11:58.461369 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-cbe0ae4a-7895-4036-9987-8601922d17df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:58.462003 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-cbe0ae4a-7895-4036-9987-8601922d17df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:11:58.463756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1124/2280] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:11:58 2022] DELETE /identity/v3/projects/640c28e7752b483ca3201ffc84b3a9d2 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:58.468763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff36aa-a215-46f0-ad67-f8103be4e04e None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:58.469217 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff36aa-a215-46f0-ad67-f8103be4e04e None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:58.469451 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff36aa-a215-46f0-ad67-f8103be4e04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:58.497915 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-5cff36aa-a215-46f0-ad67-f8103be4e04e None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:58.499222 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5cff36aa-a215-46f0-ad67-f8103be4e04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:58.559197 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1157/2281] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:58.567712 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab56b9-ebc9-4210-960f-306b0809717c None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:58.567999 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab56b9-ebc9-4210-960f-306b0809717c None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:58.568271 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab56b9-ebc9-4210-960f-306b0809717c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:58.587829 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-9eab56b9-ebc9-4210-960f-306b0809717c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:58.589059 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-9eab56b9-ebc9-4210-960f-306b0809717c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:58.597755 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1125/2282] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:11:58.604868 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff36aa-a215-46f0-ad67-f8103be4e04e None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:58.614732 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff36aa-a215-46f0-ad67-f8103be4e04e None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:58.623170 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a240496-095d-4063-b754-9be8bfc5f17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:58.623889 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a240496-095d-4063-b754-9be8bfc5f17c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:58.624256 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a240496-095d-4063-b754-9be8bfc5f17c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:58.624593 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a240496-095d-4063-b754-9be8bfc5f17c admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:58.626253 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a240496-095d-4063-b754-9be8bfc5f17c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:11:58.626613 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a240496-095d-4063-b754-9be8bfc5f17c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:58.628210 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a240496-095d-4063-b754-9be8bfc5f17c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:58.640882 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1158/2283] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:11:58.645642 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab56b9-ebc9-4210-960f-306b0809717c None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:58.655335 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab56b9-ebc9-4210-960f-306b0809717c None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:58.661742 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9b44e-163e-4dc1-bcb4-c868809d1a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:58.662402 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9b44e-163e-4dc1-bcb4-c868809d1a10 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:58.662835 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9b44e-163e-4dc1-bcb4-c868809d1a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:58.663273 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9b44e-163e-4dc1-bcb4-c868809d1a10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:58.663975 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9b44e-163e-4dc1-bcb4-c868809d1a10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:58.666047 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9b44e-163e-4dc1-bcb4-c868809d1a10 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:58.768196 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1126/2284] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:11:58 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:11:58.769658 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a240496-095d-4063-b754-9be8bfc5f17c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:58.779724 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a240496-095d-4063-b754-9be8bfc5f17c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:58.836688 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a5877-0780-4bc8-a4eb-725d6c141054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:58.837299 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a5877-0780-4bc8-a4eb-725d6c141054 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:58.837579 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a5877-0780-4bc8-a4eb-725d6c141054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:58.837849 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a5877-0780-4bc8-a4eb-725d6c141054 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:58.838533 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a5877-0780-4bc8-a4eb-725d6c141054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:58.840718 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a5877-0780-4bc8-a4eb-725d6c141054 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:58.946115 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1159/2285] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:11:58 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:11:58.947085 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9b44e-163e-4dc1-bcb4-c868809d1a10 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:58.957702 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9b44e-163e-4dc1-bcb4-c868809d1a10 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:58.962468 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90309d-4b4a-4681-88a4-0f48d89c23f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:58.963130 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90309d-4b4a-4681-88a4-0f48d89c23f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:58.963408 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90309d-4b4a-4681-88a4-0f48d89c23f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:58.963678 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90309d-4b4a-4681-88a4-0f48d89c23f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:58.964654 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90309d-4b4a-4681-88a4-0f48d89c23f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:58.965942 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90309d-4b4a-4681-88a4-0f48d89c23f6 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:58.977254 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1127/2286] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:11:58.981603 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a5877-0780-4bc8-a4eb-725d6c141054 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:58.992756 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a5877-0780-4bc8-a4eb-725d6c141054 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:58.997509 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231586b5-db1f-4559-9bfa-34c05b76fe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:58.998156 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231586b5-db1f-4559-9bfa-34c05b76fe96 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:58.998441 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231586b5-db1f-4559-9bfa-34c05b76fe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:58.998759 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231586b5-db1f-4559-9bfa-34c05b76fe96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:58.999488 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231586b5-db1f-4559-9bfa-34c05b76fe96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:59.001702 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231586b5-db1f-4559-9bfa-34c05b76fe96 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:59.011554 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1160/2287] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:11:59.015886 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90309d-4b4a-4681-88a4-0f48d89c23f6 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:59.026125 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90309d-4b4a-4681-88a4-0f48d89c23f6 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:59.030906 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a4452-a01f-48c3-bafe-f829cc75b27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:59.032682 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a4452-a01f-48c3-bafe-f829cc75b27a admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:59.032988 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a4452-a01f-48c3-bafe-f829cc75b27a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:59.033263 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a4452-a01f-48c3-bafe-f829cc75b27a admin admin] PATH_INFO: `/v3/projects/e7431bfce5cc445ead5805dbafd8ca7b/users/bf2732af2e9e4eccb1f889aa5c75b428/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:59.048735 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a4452-a01f-48c3-bafe-f829cc75b27a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7431bfce5cc445ead5805dbafd8ca7b, user_id=bf2732af2e9e4eccb1f889aa5c75b428, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:59.051399 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a4452-a01f-48c3-bafe-f829cc75b27a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:59.193464 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1128/2288] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:59 2022] PUT /identity/v3/projects/e7431bfce5cc445ead5805dbafd8ca7b/users/bf2732af2e9e4eccb1f889aa5c75b428/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:11:59.204900 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2be5a6-139a-407f-8a61-cb9cb12f7057 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:59.205197 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2be5a6-139a-407f-8a61-cb9cb12f7057 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:59.205531 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2be5a6-139a-407f-8a61-cb9cb12f7057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:59.237333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-6b2be5a6-139a-407f-8a61-cb9cb12f7057 None None] MFA Rules not processed for user `bf2732af2e9e4eccb1f889aa5c75b428`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:11:59.238625 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-6b2be5a6-139a-407f-8a61-cb9cb12f7057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:11:59.301137 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1161/2289] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:11:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:11:59.305888 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a4452-a01f-48c3-bafe-f829cc75b27a admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:59.370447 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a4452-a01f-48c3-bafe-f829cc75b27a admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:59.376003 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee305f87-cb98-4b35-ac85-669950960e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:59.376662 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee305f87-cb98-4b35-ac85-669950960e34 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:59.376945 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee305f87-cb98-4b35-ac85-669950960e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:59.377220 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee305f87-cb98-4b35-ac85-669950960e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:59.377911 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee305f87-cb98-4b35-ac85-669950960e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:59.379827 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee305f87-cb98-4b35-ac85-669950960e34 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:59.621839 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1129/2290] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:11:59 2022] POST /identity/v3/projects => generated 383 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:11:59.626130 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2be5a6-139a-407f-8a61-cb9cb12f7057 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:59.637068 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2be5a6-139a-407f-8a61-cb9cb12f7057 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:59.694894 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c14e8-8e52-4de7-bb66-3d2202d1cd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:59.695559 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c14e8-8e52-4de7-bb66-3d2202d1cd46 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:59.695847 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c14e8-8e52-4de7-bb66-3d2202d1cd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:59.696124 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c14e8-8e52-4de7-bb66-3d2202d1cd46 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:59.696807 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c14e8-8e52-4de7-bb66-3d2202d1cd46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:59.698779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c14e8-8e52-4de7-bb66-3d2202d1cd46 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:59.836999 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1162/2291] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:11:59 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:11:59.838235 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee305f87-cb98-4b35-ac85-669950960e34 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:59.849554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee305f87-cb98-4b35-ac85-669950960e34 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:59.854394 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1951a-4449-4446-8694-6d242384143c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:59.857614 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1951a-4449-4446-8694-6d242384143c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:59.857614 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1951a-4449-4446-8694-6d242384143c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:59.857614 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1951a-4449-4446-8694-6d242384143c admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:59.857614 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1951a-4449-4446-8694-6d242384143c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:59.857939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1951a-4449-4446-8694-6d242384143c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:11:59.871646 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1130/2292] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:11:59.876494 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c14e8-8e52-4de7-bb66-3d2202d1cd46 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:11:59.886531 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c14e8-8e52-4de7-bb66-3d2202d1cd46 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:11:59.891815 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cd543-0235-4cf7-b64d-75b66e41277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:11:59.892913 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cd543-0235-4cf7-b64d-75b66e41277a admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:11:59.893197 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cd543-0235-4cf7-b64d-75b66e41277a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:11:59.893473 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cd543-0235-4cf7-b64d-75b66e41277a admin admin] PATH_INFO: `/v3/projects/331bf55101ae4f35aa1cad1ce05fac4f/users/96aa4b4e8d50488e85040f47bd439fdb/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:11:59.910437 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4cd543-0235-4cf7-b64d-75b66e41277a admin admin] RBAC: Authorizing `identity:create_grant(project_id=331bf55101ae4f35aa1cad1ce05fac4f, user_id=96aa4b4e8d50488e85040f47bd439fdb, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:11:59.914598 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4cd543-0235-4cf7-b64d-75b66e41277a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:00.004439 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1951a-4449-4446-8694-6d242384143c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:00.006473 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e3e1951a-4449-4446-8694-6d242384143c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:00.019207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1951a-4449-4446-8694-6d242384143c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:00.024089 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113fd4e-4ccc-4602-a1f1-e2a9a87ad29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:00.025262 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113fd4e-4ccc-4602-a1f1-e2a9a87ad29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:00.025608 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113fd4e-4ccc-4602-a1f1-e2a9a87ad29e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:00.025973 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113fd4e-4ccc-4602-a1f1-e2a9a87ad29e admin admin] PATH_INFO: `/v3/users/b05848f087f54926ae2c5bcb82b0dbc8` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:00.027469 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113fd4e-4ccc-4602-a1f1-e2a9a87ad29e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05848f087f54926ae2c5bcb82b0dbc8)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:00.029769 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113fd4e-4ccc-4602-a1f1-e2a9a87ad29e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:00.045650 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1163/2293] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:11:59 2022] PUT /identity/v3/projects/331bf55101ae4f35aa1cad1ce05fac4f/users/96aa4b4e8d50488e85040f47bd439fdb/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:12:00.052045 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cd543-0235-4cf7-b64d-75b66e41277a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:00.114021 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cd543-0235-4cf7-b64d-75b66e41277a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:00.120683 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5dc27-2876-4445-8ef8-34effd2401a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:00.121381 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5dc27-2876-4445-8ef8-34effd2401a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:00.121660 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5dc27-2876-4445-8ef8-34effd2401a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:00.121936 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5dc27-2876-4445-8ef8-34effd2401a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:00.122672 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5dc27-2876-4445-8ef8-34effd2401a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:00.124265 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5dc27-2876-4445-8ef8-34effd2401a6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:00.135191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1164/2294] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:12:00.142390 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5dc27-2876-4445-8ef8-34effd2401a6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:00.153616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5dc27-2876-4445-8ef8-34effd2401a6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:00.163485 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899ff7d-badd-4a70-aa45-2cd97b4073fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:00.164986 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899ff7d-badd-4a70-aa45-2cd97b4073fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:00.165258 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899ff7d-badd-4a70-aa45-2cd97b4073fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:00.165536 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899ff7d-badd-4a70-aa45-2cd97b4073fa admin admin] PATH_INFO: `/v3/projects/331bf55101ae4f35aa1cad1ce05fac4f/users/96aa4b4e8d50488e85040f47bd439fdb/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:00.167737 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899ff7d-badd-4a70-aa45-2cd97b4073fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=331bf55101ae4f35aa1cad1ce05fac4f, user_id=96aa4b4e8d50488e85040f47bd439fdb, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:00.170468 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899ff7d-badd-4a70-aa45-2cd97b4073fa admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:00.181545 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1165/2295] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:12:00 2022] PUT /identity/v3/projects/331bf55101ae4f35aa1cad1ce05fac4f/users/96aa4b4e8d50488e85040f47bd439fdb/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:12:00.193898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ffe9-ef5b-4e9e-b52e-c7f88779e931 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:00.194191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ffe9-ef5b-4e9e-b52e-c7f88779e931 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:00.194472 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ffe9-ef5b-4e9e-b52e-c7f88779e931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:00.221878 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-5757ffe9-ef5b-4e9e-b52e-c7f88779e931 None None] MFA Rules not processed for user `96aa4b4e8d50488e85040f47bd439fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:00.223149 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5757ffe9-ef5b-4e9e-b52e-c7f88779e931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:00.246784 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-9113fd4e-4ccc-4602-a1f1-e2a9a87ad29e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05848f087f54926ae2c5bcb82b0dbc8'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:00.247526 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-9113fd4e-4ccc-4602-a1f1-e2a9a87ad29e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05848f087f54926ae2c5bcb82b0dbc8'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:00.260114 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-9113fd4e-4ccc-4602-a1f1-e2a9a87ad29e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05848f087f54926ae2c5bcb82b0dbc8'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:00.267061 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-9113fd4e-4ccc-4602-a1f1-e2a9a87ad29e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05848f087f54926ae2c5bcb82b0dbc8'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:00.293318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1166/2296] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:12:00.304251 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ffe9-ef5b-4e9e-b52e-c7f88779e931 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:00.305640 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5757ffe9-ef5b-4e9e-b52e-c7f88779e931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:00.351886 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-9113fd4e-4ccc-4602-a1f1-e2a9a87ad29e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05848f087f54926ae2c5bcb82b0dbc8'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:00.358187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1131/2297] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:12:00 2022] DELETE /identity/v3/users/b05848f087f54926ae2c5bcb82b0dbc8 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:12:00.361933 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ffe9-ef5b-4e9e-b52e-c7f88779e931 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:00.363203 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815c3c4-592c-49b7-9501-98238721cb6c None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:00.363553 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815c3c4-592c-49b7-9501-98238721cb6c None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:00.363772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815c3c4-592c-49b7-9501-98238721cb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:00.383006 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-b815c3c4-592c-49b7-9501-98238721cb6c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:00.384252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b815c3c4-592c-49b7-9501-98238721cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:00.412169 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e87cdc-2333-4af4-a99c-283cd39e0bc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:00.412894 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e87cdc-2333-4af4-a99c-283cd39e0bc2 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:00.416442 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e87cdc-2333-4af4-a99c-283cd39e0bc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:00.416442 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e87cdc-2333-4af4-a99c-283cd39e0bc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:00.443613 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1132/2298] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:12:00.453681 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815c3c4-592c-49b7-9501-98238721cb6c None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:00.455242 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b815c3c4-592c-49b7-9501-98238721cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:00.479909 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e87cdc-2333-4af4-a99c-283cd39e0bc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:00.481343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e87cdc-2333-4af4-a99c-283cd39e0bc2 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:00.492662 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1167/2299] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:12:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:12:00.518735 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815c3c4-592c-49b7-9501-98238721cb6c None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:00.527864 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a163884-0eb6-45c7-8459-30bac957e7b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:00.527864 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a163884-0eb6-45c7-8459-30bac957e7b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:00.527864 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a163884-0eb6-45c7-8459-30bac957e7b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:00.527864 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a163884-0eb6-45c7-8459-30bac957e7b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:00.538188 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a163884-0eb6-45c7-8459-30bac957e7b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:00.540009 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a163884-0eb6-45c7-8459-30bac957e7b6 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:00.551346 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1133/2300] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:12:00.569682 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e87cdc-2333-4af4-a99c-283cd39e0bc2 service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:00.571256 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f9e87cdc-2333-4af4-a99c-283cd39e0bc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:00.589156 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e87cdc-2333-4af4-a99c-283cd39e0bc2 service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:00.594918 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4d310-b732-49af-8f83-2fcb69a191bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:00.596047 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4d310-b732-49af-8f83-2fcb69a191bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:00.596390 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4d310-b732-49af-8f83-2fcb69a191bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:00.596753 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4d310-b732-49af-8f83-2fcb69a191bc admin admin] PATH_INFO: `/v3/users/9a3d90839b69414f92c44b09afbcebf0` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:00.598039 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4d310-b732-49af-8f83-2fcb69a191bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3d90839b69414f92c44b09afbcebf0)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:00.600120 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4d310-b732-49af-8f83-2fcb69a191bc admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:00.693230 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a163884-0eb6-45c7-8459-30bac957e7b6 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:00.694776 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-9a163884-0eb6-45c7-8459-30bac957e7b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:00.706832 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a163884-0eb6-45c7-8459-30bac957e7b6 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:00.710425 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a2341-8131-4efc-a9be-e51938bc7932 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:00.711091 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a2341-8131-4efc-a9be-e51938bc7932 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:00.711372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a2341-8131-4efc-a9be-e51938bc7932 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:00.711646 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a2341-8131-4efc-a9be-e51938bc7932 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:00.713397 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-9e2a2341-8131-4efc-a9be-e51938bc7932 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:00.772762 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a2341-8131-4efc-a9be-e51938bc7932 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:00.774205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a2341-8131-4efc-a9be-e51938bc7932 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:00.784357 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1134/2301] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:12:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:12:00.824167 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-bad4d310-b732-49af-8f83-2fcb69a191bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3d90839b69414f92c44b09afbcebf0'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:00.825159 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-bad4d310-b732-49af-8f83-2fcb69a191bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3d90839b69414f92c44b09afbcebf0'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:00.840606 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-bad4d310-b732-49af-8f83-2fcb69a191bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3d90839b69414f92c44b09afbcebf0'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:00.848872 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-bad4d310-b732-49af-8f83-2fcb69a191bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3d90839b69414f92c44b09afbcebf0'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:00.849655 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-bad4d310-b732-49af-8f83-2fcb69a191bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3d90839b69414f92c44b09afbcebf0'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:00.980900 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1168/2302] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:12:00 2022] DELETE /identity/v3/users/9a3d90839b69414f92c44b09afbcebf0 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:12:00.985031 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07308361-533e-45f7-bc0b-4461971ff1df None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:00.985389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07308361-533e-45f7-bc0b-4461971ff1df None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:00.985739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07308361-533e-45f7-bc0b-4461971ff1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:01.009151 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-07308361-533e-45f7-bc0b-4461971ff1df None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:01.009151 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-07308361-533e-45f7-bc0b-4461971ff1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:01.081866 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4d310-b732-49af-8f83-2fcb69a191bc admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:01.083704 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-bad4d310-b732-49af-8f83-2fcb69a191bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:01.084894 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1135/2303] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:12:01.095106 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07308361-533e-45f7-bc0b-4461971ff1df None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:01.096785 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-07308361-533e-45f7-bc0b-4461971ff1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:01.106095 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4d310-b732-49af-8f83-2fcb69a191bc admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:01.111374 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e677831-345e-400e-9346-fd683215c36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:01.112339 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e677831-345e-400e-9346-fd683215c36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:01.112634 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e677831-345e-400e-9346-fd683215c36c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:01.112972 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e677831-345e-400e-9346-fd683215c36c admin admin] PATH_INFO: `/v3/projects/cc1e186de2174542b0eed634e37384ea` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:01.114263 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e677831-345e-400e-9346-fd683215c36c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc1e186de2174542b0eed634e37384ea)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:01.116379 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e677831-345e-400e-9346-fd683215c36c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:01.182773 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07308361-533e-45f7-bc0b-4461971ff1df None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:01.186958 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41bd9d-90f8-47f1-9982-35454a7d4f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:01.187652 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41bd9d-90f8-47f1-9982-35454a7d4f58 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:01.187925 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41bd9d-90f8-47f1-9982-35454a7d4f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:01.189725 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41bd9d-90f8-47f1-9982-35454a7d4f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:01.202806 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41bd9d-90f8-47f1-9982-35454a7d4f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:01.202806 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41bd9d-90f8-47f1-9982-35454a7d4f58 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:01.214172 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1136/2304] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:12:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:12:01.241654 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-8e677831-345e-400e-9346-fd683215c36c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc1e186de2174542b0eed634e37384ea', 'request_id': 'req-8e677831-345e-400e-9346-fd683215c36c'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:01.358485 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41bd9d-90f8-47f1-9982-35454a7d4f58 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:01.360093 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-4e41bd9d-90f8-47f1-9982-35454a7d4f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:01.373127 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41bd9d-90f8-47f1-9982-35454a7d4f58 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:01.378291 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-8e677831-345e-400e-9346-fd683215c36c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc1e186de2174542b0eed634e37384ea', 'request_id': 'req-8e677831-345e-400e-9346-fd683215c36c'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:01.381810 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-8e677831-345e-400e-9346-fd683215c36c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc1e186de2174542b0eed634e37384ea', 'request_id': 'req-8e677831-345e-400e-9346-fd683215c36c'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:01.394747 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-8e677831-345e-400e-9346-fd683215c36c admin admin] The token cache is being invalidate because project cc1e186de2174542b0eed634e37384ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:12:01.395085 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-8e677831-345e-400e-9346-fd683215c36c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:01.395768 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-8e677831-345e-400e-9346-fd683215c36c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:01.397373 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1169/2305] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:12:01 2022] DELETE /identity/v3/projects/cc1e186de2174542b0eed634e37384ea => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:12:01.453961 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4698f6-a086-4495-b7c9-637532b32647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:01.454239 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4698f6-a086-4495-b7c9-637532b32647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:01.454985 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4698f6-a086-4495-b7c9-637532b32647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:01.455323 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4698f6-a086-4495-b7c9-637532b32647 admin admin] PATH_INFO: `/v3/users/bf2732af2e9e4eccb1f889aa5c75b428` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:01.456797 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4698f6-a086-4495-b7c9-637532b32647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf2732af2e9e4eccb1f889aa5c75b428)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:01.458829 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4698f6-a086-4495-b7c9-637532b32647 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:01.636777 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-2b4698f6-a086-4495-b7c9-637532b32647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf2732af2e9e4eccb1f889aa5c75b428'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:01.638065 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-2b4698f6-a086-4495-b7c9-637532b32647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf2732af2e9e4eccb1f889aa5c75b428'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:01.652673 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-2b4698f6-a086-4495-b7c9-637532b32647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf2732af2e9e4eccb1f889aa5c75b428'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:01.660135 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-2b4698f6-a086-4495-b7c9-637532b32647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf2732af2e9e4eccb1f889aa5c75b428'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:01.689172 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e677831-345e-400e-9346-fd683215c36c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:01.690764 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8e677831-345e-400e-9346-fd683215c36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:01.703886 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e677831-345e-400e-9346-fd683215c36c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:01.708921 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e80da-ba49-4e82-9116-5283b7527252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:01.709788 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e80da-ba49-4e82-9116-5283b7527252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:01.710067 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e80da-ba49-4e82-9116-5283b7527252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:01.710356 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e80da-ba49-4e82-9116-5283b7527252 admin admin] PATH_INFO: `/v3/projects/33623ad207bb4b9a94d71d55346a2e4b` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:01.711588 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e80da-ba49-4e82-9116-5283b7527252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33623ad207bb4b9a94d71d55346a2e4b)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:01.713491 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e80da-ba49-4e82-9116-5283b7527252 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:01.757776 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-2b4698f6-a086-4495-b7c9-637532b32647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf2732af2e9e4eccb1f889aa5c75b428'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:01.764282 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1137/2306] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:12:01 2022] DELETE /identity/v3/users/bf2732af2e9e4eccb1f889aa5c75b428 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:12:01.768916 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d3e49-b9e0-427c-a357-c27f71936489 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:01.769257 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d3e49-b9e0-427c-a357-c27f71936489 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:01.769580 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d3e49-b9e0-427c-a357-c27f71936489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:01.789077 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-114d3e49-b9e0-427c-a357-c27f71936489 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:01.790266 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-114d3e49-b9e0-427c-a357-c27f71936489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:01.826446 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-323e80da-ba49-4e82-9116-5283b7527252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33623ad207bb4b9a94d71d55346a2e4b', 'request_id': 'req-323e80da-ba49-4e82-9116-5283b7527252'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:01.850140 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1138/2307] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:12:01.860538 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d3e49-b9e0-427c-a357-c27f71936489 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:01.861866 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-114d3e49-b9e0-427c-a357-c27f71936489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:01.894851 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-323e80da-ba49-4e82-9116-5283b7527252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33623ad207bb4b9a94d71d55346a2e4b', 'request_id': 'req-323e80da-ba49-4e82-9116-5283b7527252'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:01.903360 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-323e80da-ba49-4e82-9116-5283b7527252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33623ad207bb4b9a94d71d55346a2e4b', 'request_id': 'req-323e80da-ba49-4e82-9116-5283b7527252'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:01.915116 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-323e80da-ba49-4e82-9116-5283b7527252 admin admin] The token cache is being invalidate because project 33623ad207bb4b9a94d71d55346a2e4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:12:01.915408 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-323e80da-ba49-4e82-9116-5283b7527252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:01.916087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-323e80da-ba49-4e82-9116-5283b7527252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:01.917674 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1170/2308] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:12:01 2022] DELETE /identity/v3/projects/33623ad207bb4b9a94d71d55346a2e4b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:12:01.921477 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e80da-ba49-4e82-9116-5283b7527252 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:01.923476 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-323e80da-ba49-4e82-9116-5283b7527252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:01.928429 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d3e49-b9e0-427c-a357-c27f71936489 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:01.981654 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9eabf-e1fb-46cf-97d0-d976a372116d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:01.982198 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9eabf-e1fb-46cf-97d0-d976a372116d service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:01.982661 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9eabf-e1fb-46cf-97d0-d976a372116d service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:01.982772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9eabf-e1fb-46cf-97d0-d976a372116d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:01.985046 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e6c9eabf-e1fb-46cf-97d0-d976a372116d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:01.996520 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e80da-ba49-4e82-9116-5283b7527252 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:01.997980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9eabf-e1fb-46cf-97d0-d976a372116d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:01.999469 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9eabf-e1fb-46cf-97d0-d976a372116d service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:02.002550 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed0ae9-491e-455e-8964-96b3c4b6761f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:02.003482 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed0ae9-491e-455e-8964-96b3c4b6761f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:02.005863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed0ae9-491e-455e-8964-96b3c4b6761f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:02.005863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed0ae9-491e-455e-8964-96b3c4b6761f admin admin] PATH_INFO: `/v3/users/1cd0e30160e84e56964589f9fd102240` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:02.005863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed0ae9-491e-455e-8964-96b3c4b6761f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd0e30160e84e56964589f9fd102240)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:02.007379 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed0ae9-491e-455e-8964-96b3c4b6761f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:02.010921 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1139/2309] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:12:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:12:02.212594 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2eed0ae9-491e-455e-8964-96b3c4b6761f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd0e30160e84e56964589f9fd102240'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:02.213541 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2eed0ae9-491e-455e-8964-96b3c4b6761f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd0e30160e84e56964589f9fd102240'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:02.226916 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2eed0ae9-491e-455e-8964-96b3c4b6761f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd0e30160e84e56964589f9fd102240'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:02.235620 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2eed0ae9-491e-455e-8964-96b3c4b6761f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd0e30160e84e56964589f9fd102240'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:02.237941 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2eed0ae9-491e-455e-8964-96b3c4b6761f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd0e30160e84e56964589f9fd102240'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:02.342193 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1171/2310] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:12:01 2022] DELETE /identity/v3/users/1cd0e30160e84e56964589f9fd102240 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:12:02.708532 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9eabf-e1fb-46cf-97d0-d976a372116d service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:02.710012 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e6c9eabf-e1fb-46cf-97d0-d976a372116d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:02.721916 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9eabf-e1fb-46cf-97d0-d976a372116d service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:02.786938 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828cde4-27ba-47db-a411-98a4fed06cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:02.789013 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828cde4-27ba-47db-a411-98a4fed06cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:02.789013 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828cde4-27ba-47db-a411-98a4fed06cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:02.789013 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828cde4-27ba-47db-a411-98a4fed06cd3 admin admin] PATH_INFO: `/v3/projects/e7431bfce5cc445ead5805dbafd8ca7b` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:02.789530 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828cde4-27ba-47db-a411-98a4fed06cd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7431bfce5cc445ead5805dbafd8ca7b)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:02.791444 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828cde4-27ba-47db-a411-98a4fed06cd3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:02.931546 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-7828cde4-27ba-47db-a411-98a4fed06cd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7431bfce5cc445ead5805dbafd8ca7b', 'request_id': 'req-7828cde4-27ba-47db-a411-98a4fed06cd3'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.030582 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed0ae9-491e-455e-8964-96b3c4b6761f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:03.032360 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-7828cde4-27ba-47db-a411-98a4fed06cd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7431bfce5cc445ead5805dbafd8ca7b', 'request_id': 'req-7828cde4-27ba-47db-a411-98a4fed06cd3'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.033735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2eed0ae9-491e-455e-8964-96b3c4b6761f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:03.039654 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-7828cde4-27ba-47db-a411-98a4fed06cd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7431bfce5cc445ead5805dbafd8ca7b', 'request_id': 'req-7828cde4-27ba-47db-a411-98a4fed06cd3'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.047640 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed0ae9-491e-455e-8964-96b3c4b6761f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:03.054716 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-7828cde4-27ba-47db-a411-98a4fed06cd3 admin admin] The token cache is being invalidate because project e7431bfce5cc445ead5805dbafd8ca7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:12:03.055015 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-7828cde4-27ba-47db-a411-98a4fed06cd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.055684 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-7828cde4-27ba-47db-a411-98a4fed06cd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.057678 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1140/2311] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:12:02 2022] DELETE /identity/v3/projects/e7431bfce5cc445ead5805dbafd8ca7b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:12:03.062009 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828cde4-27ba-47db-a411-98a4fed06cd3 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:03.064862 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-7828cde4-27ba-47db-a411-98a4fed06cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:03.135287 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ca8ac-49e1-4f07-af61-89b4acee1de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:03.135905 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828cde4-27ba-47db-a411-98a4fed06cd3 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:03.136641 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ca8ac-49e1-4f07-af61-89b4acee1de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:03.136924 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ca8ac-49e1-4f07-af61-89b4acee1de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:03.137201 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ca8ac-49e1-4f07-af61-89b4acee1de4 admin admin] PATH_INFO: `/v3/projects/d6605f86632b467b804bf7dd67a2cb62` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:03.138389 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ca8ac-49e1-4f07-af61-89b4acee1de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6605f86632b467b804bf7dd67a2cb62)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:03.141080 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ca8ac-49e1-4f07-af61-89b4acee1de4 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:03.141977 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88904a5-938f-4104-a437-61a3d845c748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:03.142884 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88904a5-938f-4104-a437-61a3d845c748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:03.143151 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88904a5-938f-4104-a437-61a3d845c748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:03.143424 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88904a5-938f-4104-a437-61a3d845c748 admin admin] PATH_INFO: `/v3/users/96aa4b4e8d50488e85040f47bd439fdb` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:03.144763 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88904a5-938f-4104-a437-61a3d845c748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96aa4b4e8d50488e85040f47bd439fdb)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:03.146759 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88904a5-938f-4104-a437-61a3d845c748 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:03.283270 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-aa8ca8ac-49e1-4f07-af61-89b4acee1de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6605f86632b467b804bf7dd67a2cb62', 'request_id': 'req-aa8ca8ac-49e1-4f07-af61-89b4acee1de4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.357548 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-aa8ca8ac-49e1-4f07-af61-89b4acee1de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6605f86632b467b804bf7dd67a2cb62', 'request_id': 'req-aa8ca8ac-49e1-4f07-af61-89b4acee1de4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.364173 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-aa8ca8ac-49e1-4f07-af61-89b4acee1de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6605f86632b467b804bf7dd67a2cb62', 'request_id': 'req-aa8ca8ac-49e1-4f07-af61-89b4acee1de4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.376366 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-aa8ca8ac-49e1-4f07-af61-89b4acee1de4 admin admin] The token cache is being invalidate because project d6605f86632b467b804bf7dd67a2cb62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:12:03.376652 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-aa8ca8ac-49e1-4f07-af61-89b4acee1de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.377336 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-aa8ca8ac-49e1-4f07-af61-89b4acee1de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.378865 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1172/2312] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:12:03 2022] DELETE /identity/v3/projects/d6605f86632b467b804bf7dd67a2cb62 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:12:03.379684 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ca8ac-49e1-4f07-af61-89b4acee1de4 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:03.380983 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-aa8ca8ac-49e1-4f07-af61-89b4acee1de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:03.398187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f88904a5-938f-4104-a437-61a3d845c748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96aa4b4e8d50488e85040f47bd439fdb'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.399291 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f88904a5-938f-4104-a437-61a3d845c748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96aa4b4e8d50488e85040f47bd439fdb'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.411062 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f88904a5-938f-4104-a437-61a3d845c748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96aa4b4e8d50488e85040f47bd439fdb'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.418053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f88904a5-938f-4104-a437-61a3d845c748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96aa4b4e8d50488e85040f47bd439fdb'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.443984 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ca8ac-49e1-4f07-af61-89b4acee1de4 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:03.448877 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e4aae-06d2-485f-8aae-7b1df02e9367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:03.449787 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e4aae-06d2-485f-8aae-7b1df02e9367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:03.450072 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e4aae-06d2-485f-8aae-7b1df02e9367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:03.450350 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e4aae-06d2-485f-8aae-7b1df02e9367 admin admin] PATH_INFO: `/v3/users/6de69d16071448a18486af7f86e1099e` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:03.451584 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e4aae-06d2-485f-8aae-7b1df02e9367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de69d16071448a18486af7f86e1099e)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:03.453749 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e4aae-06d2-485f-8aae-7b1df02e9367 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:03.494355 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f88904a5-938f-4104-a437-61a3d845c748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96aa4b4e8d50488e85040f47bd439fdb'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.501361 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1141/2313] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:12:03 2022] DELETE /identity/v3/users/96aa4b4e8d50488e85040f47bd439fdb => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:12:03.502278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88904a5-938f-4104-a437-61a3d845c748 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:03.503625 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f88904a5-938f-4104-a437-61a3d845c748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:03.584387 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88904a5-938f-4104-a437-61a3d845c748 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:03.592800 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538aace-2ffa-4e88-92e5-3015dd83ca6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:03.594365 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538aace-2ffa-4e88-92e5-3015dd83ca6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:03.594776 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538aace-2ffa-4e88-92e5-3015dd83ca6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:03.595026 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538aace-2ffa-4e88-92e5-3015dd83ca6b admin admin] PATH_INFO: `/v3/users/afd912fdbafa4d77955ef78ef65017ca` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:03.598850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538aace-2ffa-4e88-92e5-3015dd83ca6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd912fdbafa4d77955ef78ef65017ca)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:03.601438 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538aace-2ffa-4e88-92e5-3015dd83ca6b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:03.650950 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d84e4aae-06d2-485f-8aae-7b1df02e9367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de69d16071448a18486af7f86e1099e'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.651616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d84e4aae-06d2-485f-8aae-7b1df02e9367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de69d16071448a18486af7f86e1099e'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.663679 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d84e4aae-06d2-485f-8aae-7b1df02e9367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de69d16071448a18486af7f86e1099e'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.670225 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d84e4aae-06d2-485f-8aae-7b1df02e9367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de69d16071448a18486af7f86e1099e'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.670934 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d84e4aae-06d2-485f-8aae-7b1df02e9367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de69d16071448a18486af7f86e1099e'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.791173 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1173/2314] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:12:03 2022] DELETE /identity/v3/users/6de69d16071448a18486af7f86e1099e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:12:03.829281 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d538aace-2ffa-4e88-92e5-3015dd83ca6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd912fdbafa4d77955ef78ef65017ca'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.830227 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d538aace-2ffa-4e88-92e5-3015dd83ca6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd912fdbafa4d77955ef78ef65017ca'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.847753 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d538aace-2ffa-4e88-92e5-3015dd83ca6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd912fdbafa4d77955ef78ef65017ca'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.855146 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d538aace-2ffa-4e88-92e5-3015dd83ca6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd912fdbafa4d77955ef78ef65017ca'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.930419 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e4aae-06d2-485f-8aae-7b1df02e9367 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:03.932056 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d84e4aae-06d2-485f-8aae-7b1df02e9367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:03.951563 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d538aace-2ffa-4e88-92e5-3015dd83ca6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd912fdbafa4d77955ef78ef65017ca'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:03.962558 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1142/2315] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:12:03 2022] DELETE /identity/v3/users/afd912fdbafa4d77955ef78ef65017ca => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:12:04.010478 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e4aae-06d2-485f-8aae-7b1df02e9367 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:04.067568 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff1153-1bd8-44b7-85e7-57961f564d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:04.068433 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff1153-1bd8-44b7-85e7-57961f564d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:04.068894 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff1153-1bd8-44b7-85e7-57961f564d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:04.069184 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff1153-1bd8-44b7-85e7-57961f564d48 admin admin] PATH_INFO: `/v3/projects/331bf55101ae4f35aa1cad1ce05fac4f` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:04.070417 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff1153-1bd8-44b7-85e7-57961f564d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=331bf55101ae4f35aa1cad1ce05fac4f)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:04.072363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff1153-1bd8-44b7-85e7-57961f564d48 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:04.091057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538aace-2ffa-4e88-92e5-3015dd83ca6b admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:04.092901 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d538aace-2ffa-4e88-92e5-3015dd83ca6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:04.108572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538aace-2ffa-4e88-92e5-3015dd83ca6b admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:04.114077 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f737c8-d86f-4bb8-a953-10ae23a7bbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:04.114989 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f737c8-d86f-4bb8-a953-10ae23a7bbc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:04.115293 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f737c8-d86f-4bb8-a953-10ae23a7bbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:04.115617 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f737c8-d86f-4bb8-a953-10ae23a7bbc4 admin admin] PATH_INFO: `/v3/projects/63f78708814244819cdb333190650f23` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:04.122126 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f737c8-d86f-4bb8-a953-10ae23a7bbc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f78708814244819cdb333190650f23)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:04.122636 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f737c8-d86f-4bb8-a953-10ae23a7bbc4 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:04.222890 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5ff1153-1bd8-44b7-85e7-57961f564d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '331bf55101ae4f35aa1cad1ce05fac4f', 'request_id': 'req-b5ff1153-1bd8-44b7-85e7-57961f564d48'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.278482 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-53f737c8-d86f-4bb8-a953-10ae23a7bbc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f78708814244819cdb333190650f23', 'request_id': 'req-53f737c8-d86f-4bb8-a953-10ae23a7bbc4'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.300477 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5ff1153-1bd8-44b7-85e7-57961f564d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '331bf55101ae4f35aa1cad1ce05fac4f', 'request_id': 'req-b5ff1153-1bd8-44b7-85e7-57961f564d48'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.308928 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5ff1153-1bd8-44b7-85e7-57961f564d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '331bf55101ae4f35aa1cad1ce05fac4f', 'request_id': 'req-b5ff1153-1bd8-44b7-85e7-57961f564d48'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.318251 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5ff1153-1bd8-44b7-85e7-57961f564d48 admin admin] The token cache is being invalidate because project 331bf55101ae4f35aa1cad1ce05fac4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:12:04.318582 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5ff1153-1bd8-44b7-85e7-57961f564d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.319274 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5ff1153-1bd8-44b7-85e7-57961f564d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.320844 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1174/2316] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:12:03 2022] DELETE /identity/v3/projects/331bf55101ae4f35aa1cad1ce05fac4f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:12:04.325473 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a4f43-ceca-4a58-ab3f-65fc537a21e9 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:04.325762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a4f43-ceca-4a58-ab3f-65fc537a21e9 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:04.326043 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a4f43-ceca-4a58-ab3f-65fc537a21e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:04.345669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-013a4f43-ceca-4a58-ab3f-65fc537a21e9 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:04.347017 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-013a4f43-ceca-4a58-ab3f-65fc537a21e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:04.392275 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-53f737c8-d86f-4bb8-a953-10ae23a7bbc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f78708814244819cdb333190650f23', 'request_id': 'req-53f737c8-d86f-4bb8-a953-10ae23a7bbc4'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.398028 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-53f737c8-d86f-4bb8-a953-10ae23a7bbc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f78708814244819cdb333190650f23', 'request_id': 'req-53f737c8-d86f-4bb8-a953-10ae23a7bbc4'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.407985 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1175/2317] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:12:04.409592 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-53f737c8-d86f-4bb8-a953-10ae23a7bbc4 admin admin] The token cache is being invalidate because project 63f78708814244819cdb333190650f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:12:04.409878 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-53f737c8-d86f-4bb8-a953-10ae23a7bbc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.410527 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-53f737c8-d86f-4bb8-a953-10ae23a7bbc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.412084 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1143/2318] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:12:04 2022] DELETE /identity/v3/projects/63f78708814244819cdb333190650f23 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:12:04.416791 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b191c6c-2aec-4e04-86d5-0685747986e4 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:04.417217 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b191c6c-2aec-4e04-86d5-0685747986e4 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:04.417354 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b191c6c-2aec-4e04-86d5-0685747986e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:04.418097 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f737c8-d86f-4bb8-a953-10ae23a7bbc4 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:04.419500 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-53f737c8-d86f-4bb8-a953-10ae23a7bbc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:04.433168 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f737c8-d86f-4bb8-a953-10ae23a7bbc4 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:04.436349 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-8b191c6c-2aec-4e04-86d5-0685747986e4 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:04.437680 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8b191c6c-2aec-4e04-86d5-0685747986e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:04.438549 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0312a-6971-46f8-b99e-1f3f1407e895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:04.439531 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0312a-6971-46f8-b99e-1f3f1407e895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:04.439863 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0312a-6971-46f8-b99e-1f3f1407e895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:04.440215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0312a-6971-46f8-b99e-1f3f1407e895 admin admin] PATH_INFO: `/v3/users/3e29ab52bedf49cd95caf440de31f700` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:04.441552 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0312a-6971-46f8-b99e-1f3f1407e895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e29ab52bedf49cd95caf440de31f700)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:04.443568 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0312a-6971-46f8-b99e-1f3f1407e895 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:04.447456 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1176/2319] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:12:04.448672 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b191c6c-2aec-4e04-86d5-0685747986e4 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:04.450095 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8b191c6c-2aec-4e04-86d5-0685747986e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:04.464237 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b191c6c-2aec-4e04-86d5-0685747986e4 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:04.470713 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223056bf-85b7-4502-aa9a-c177decb85e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:04.471625 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223056bf-85b7-4502-aa9a-c177decb85e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:04.471911 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223056bf-85b7-4502-aa9a-c177decb85e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:04.472228 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223056bf-85b7-4502-aa9a-c177decb85e2 admin admin] PATH_INFO: `/v3/projects/ff870cfb0b6a4706a051ad695f5ea104` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:04.473538 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223056bf-85b7-4502-aa9a-c177decb85e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff870cfb0b6a4706a051ad695f5ea104)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:04.475356 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223056bf-85b7-4502-aa9a-c177decb85e2 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:04.651198 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-223056bf-85b7-4502-aa9a-c177decb85e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff870cfb0b6a4706a051ad695f5ea104', 'request_id': 'req-223056bf-85b7-4502-aa9a-c177decb85e2'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.651405 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-58a0312a-6971-46f8-b99e-1f3f1407e895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e29ab52bedf49cd95caf440de31f700'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.651876 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-58a0312a-6971-46f8-b99e-1f3f1407e895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e29ab52bedf49cd95caf440de31f700'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.665088 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-58a0312a-6971-46f8-b99e-1f3f1407e895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e29ab52bedf49cd95caf440de31f700'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.671725 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-58a0312a-6971-46f8-b99e-1f3f1407e895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e29ab52bedf49cd95caf440de31f700'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.717445 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-223056bf-85b7-4502-aa9a-c177decb85e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff870cfb0b6a4706a051ad695f5ea104', 'request_id': 'req-223056bf-85b7-4502-aa9a-c177decb85e2'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.725739 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-223056bf-85b7-4502-aa9a-c177decb85e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff870cfb0b6a4706a051ad695f5ea104', 'request_id': 'req-223056bf-85b7-4502-aa9a-c177decb85e2'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.734904 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-223056bf-85b7-4502-aa9a-c177decb85e2 admin admin] The token cache is being invalidate because project ff870cfb0b6a4706a051ad695f5ea104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:12:04.735186 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-223056bf-85b7-4502-aa9a-c177decb85e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.735856 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-223056bf-85b7-4502-aa9a-c177decb85e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.737404 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1177/2320] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:12:04 2022] DELETE /identity/v3/projects/ff870cfb0b6a4706a051ad695f5ea104 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:12:04.738259 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223056bf-85b7-4502-aa9a-c177decb85e2 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:04.740077 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-223056bf-85b7-4502-aa9a-c177decb85e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:04.797956 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-58a0312a-6971-46f8-b99e-1f3f1407e895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e29ab52bedf49cd95caf440de31f700'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:04.804177 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223056bf-85b7-4502-aa9a-c177decb85e2 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:04.804984 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1144/2321] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:12:04 2022] DELETE /identity/v3/users/3e29ab52bedf49cd95caf440de31f700 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:12:04.807182 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc52ce-b6cd-44d2-bcb7-7bbea15fb865 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:04.807612 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc52ce-b6cd-44d2-bcb7-7bbea15fb865 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:04.808077 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc52ce-b6cd-44d2-bcb7-7bbea15fb865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:04.829872 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-f3cc52ce-b6cd-44d2-bcb7-7bbea15fb865 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:04.836772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f3cc52ce-b6cd-44d2-bcb7-7bbea15fb865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:04.881217 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b3ff6-9b28-4632-83ca-92249cc25475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:04.881217 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b3ff6-9b28-4632-83ca-92249cc25475 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:04.881217 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b3ff6-9b28-4632-83ca-92249cc25475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:04.881217 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b3ff6-9b28-4632-83ca-92249cc25475 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:04.882190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b3ff6-9b28-4632-83ca-92249cc25475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:12:04.882934 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b3ff6-9b28-4632-83ca-92249cc25475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:04.885393 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b3ff6-9b28-4632-83ca-92249cc25475 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:04.899207 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1178/2322] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:12:04.904191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b3ff6-9b28-4632-83ca-92249cc25475 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:04.910197 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1145/2323] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:12:04.918501 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdec6d3-e814-4260-af50-3e0f82e0852b None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:04.918896 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdec6d3-e814-4260-af50-3e0f82e0852b None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:04.919402 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdec6d3-e814-4260-af50-3e0f82e0852b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:04.922805 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b3ff6-9b28-4632-83ca-92249cc25475 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:04.927856 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008faee-4ed3-4436-911d-be119f359747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:04.928505 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008faee-4ed3-4436-911d-be119f359747 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:04.928786 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008faee-4ed3-4436-911d-be119f359747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:04.929056 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008faee-4ed3-4436-911d-be119f359747 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:04.929882 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008faee-4ed3-4436-911d-be119f359747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:04.931823 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008faee-4ed3-4436-911d-be119f359747 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:04.945901 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-cbdec6d3-e814-4260-af50-3e0f82e0852b None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:04.945901 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-cbdec6d3-e814-4260-af50-3e0f82e0852b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:04.950274 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1146/2324] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:12:04.955733 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdec6d3-e814-4260-af50-3e0f82e0852b None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:04.964944 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdec6d3-e814-4260-af50-3e0f82e0852b None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:04.970210 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147c20c-c855-480e-bd3c-89c282532848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:04.970905 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147c20c-c855-480e-bd3c-89c282532848 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:04.971196 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147c20c-c855-480e-bd3c-89c282532848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:04.971481 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147c20c-c855-480e-bd3c-89c282532848 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:04.972200 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147c20c-c855-480e-bd3c-89c282532848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:12:04.972509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147c20c-c855-480e-bd3c-89c282532848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:04.974495 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147c20c-c855-480e-bd3c-89c282532848 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:04.990534 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1147/2325] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 17:12:04.991600 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147c20c-c855-480e-bd3c-89c282532848 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:05.002148 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147c20c-c855-480e-bd3c-89c282532848 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:05.006769 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170af3c2-600a-4bd1-a21e-4117b229a471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:05.007392 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170af3c2-600a-4bd1-a21e-4117b229a471 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:05.007669 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170af3c2-600a-4bd1-a21e-4117b229a471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:05.007939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170af3c2-600a-4bd1-a21e-4117b229a471 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:05.008607 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170af3c2-600a-4bd1-a21e-4117b229a471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:05.010461 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170af3c2-600a-4bd1-a21e-4117b229a471 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:05.102224 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1179/2326] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:12:04 2022] POST /identity/v3/projects => generated 361 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:12:05.106491 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008faee-4ed3-4436-911d-be119f359747 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:05.143680 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1148/2327] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:12:04 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:12:05.147495 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170af3c2-600a-4bd1-a21e-4117b229a471 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:05.149949 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-170af3c2-600a-4bd1-a21e-4117b229a471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:05.170918 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008faee-4ed3-4436-911d-be119f359747 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:05.213834 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170af3c2-600a-4bd1-a21e-4117b229a471 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:05.219042 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5bf55-af93-42bf-8908-edc78e2fd5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:05.219895 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5bf55-af93-42bf-8908-edc78e2fd5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:05.220172 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5bf55-af93-42bf-8908-edc78e2fd5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:05.220440 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5bf55-af93-42bf-8908-edc78e2fd5b2 admin admin] PATH_INFO: `/v3/projects/2c8cccebbfc24182b49896f016d5b84b` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:05.221708 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5bf55-af93-42bf-8908-edc78e2fd5b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c8cccebbfc24182b49896f016d5b84b)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:05.223593 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5bf55-af93-42bf-8908-edc78e2fd5b2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:05.228767 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce3a40-8a13-40a0-a58f-79c03d1124b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:05.229430 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce3a40-8a13-40a0-a58f-79c03d1124b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:05.229974 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce3a40-8a13-40a0-a58f-79c03d1124b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:05.229974 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce3a40-8a13-40a0-a58f-79c03d1124b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:05.230675 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce3a40-8a13-40a0-a58f-79c03d1124b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:05.232729 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce3a40-8a13-40a0-a58f-79c03d1124b0 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:05.375161 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1180/2328] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:12:05 2022] POST /identity/v3/users => generated 281 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:12:05.376024 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce3a40-8a13-40a0-a58f-79c03d1124b0 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:05.385850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce3a40-8a13-40a0-a58f-79c03d1124b0 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:05.391470 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b519f62-eb46-48c5-9666-0d2e7078664e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:05.392104 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b519f62-eb46-48c5-9666-0d2e7078664e admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:05.392383 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b519f62-eb46-48c5-9666-0d2e7078664e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:05.392652 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b519f62-eb46-48c5-9666-0d2e7078664e admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:05.393366 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b519f62-eb46-48c5-9666-0d2e7078664e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:05.395328 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b519f62-eb46-48c5-9666-0d2e7078664e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:05.422909 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d4d5bf55-af93-42bf-8908-edc78e2fd5b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c8cccebbfc24182b49896f016d5b84b', 'request_id': 'req-d4d5bf55-af93-42bf-8908-edc78e2fd5b2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:05.523920 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1181/2329] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:12:05 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:12:05.524918 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b519f62-eb46-48c5-9666-0d2e7078664e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:05.535776 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b519f62-eb46-48c5-9666-0d2e7078664e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:05.580480 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d4d5bf55-af93-42bf-8908-edc78e2fd5b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c8cccebbfc24182b49896f016d5b84b', 'request_id': 'req-d4d5bf55-af93-42bf-8908-edc78e2fd5b2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:05.587185 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d4d5bf55-af93-42bf-8908-edc78e2fd5b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c8cccebbfc24182b49896f016d5b84b', 'request_id': 'req-d4d5bf55-af93-42bf-8908-edc78e2fd5b2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:05.595468 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a1559-ff0e-4ea8-8a30-218b17668320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:05.596151 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a1559-ff0e-4ea8-8a30-218b17668320 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:05.596433 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a1559-ff0e-4ea8-8a30-218b17668320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:05.596714 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a1559-ff0e-4ea8-8a30-218b17668320 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:05.597479 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a1559-ff0e-4ea8-8a30-218b17668320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:05.599073 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a1559-ff0e-4ea8-8a30-218b17668320 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:05.599903 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d4d5bf55-af93-42bf-8908-edc78e2fd5b2 admin admin] The token cache is being invalidate because project 2c8cccebbfc24182b49896f016d5b84b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:12:05.600191 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d4d5bf55-af93-42bf-8908-edc78e2fd5b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:05.600866 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d4d5bf55-af93-42bf-8908-edc78e2fd5b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:05.602429 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1149/2330] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:12:05 2022] DELETE /identity/v3/projects/2c8cccebbfc24182b49896f016d5b84b => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:12:05.603298 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5bf55-af93-42bf-8908-edc78e2fd5b2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:05.604582 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d4d5bf55-af93-42bf-8908-edc78e2fd5b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:05.609645 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1182/2331] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:12:05.611459 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab2542-d929-41ca-80bf-41a6ba0133f8 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:05.611848 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab2542-d929-41ca-80bf-41a6ba0133f8 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:05.612299 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab2542-d929-41ca-80bf-41a6ba0133f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:05.617847 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5bf55-af93-42bf-8908-edc78e2fd5b2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:05.622622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91e7ab-f104-4739-9e22-4dd1c6103a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:05.623300 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91e7ab-f104-4739-9e22-4dd1c6103a33 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:05.623583 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91e7ab-f104-4739-9e22-4dd1c6103a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:05.623862 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91e7ab-f104-4739-9e22-4dd1c6103a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:05.624645 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91e7ab-f104-4739-9e22-4dd1c6103a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:05.626312 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91e7ab-f104-4739-9e22-4dd1c6103a33 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:05.634686 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-dbab2542-d929-41ca-80bf-41a6ba0133f8 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:05.636036 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-dbab2542-d929-41ca-80bf-41a6ba0133f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:05.636999 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1150/2332] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:12:05.637952 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91e7ab-f104-4739-9e22-4dd1c6103a33 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:05.639603 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-ee91e7ab-f104-4739-9e22-4dd1c6103a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:05.646602 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1183/2333] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:12:05.647518 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab2542-d929-41ca-80bf-41a6ba0133f8 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:05.654680 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91e7ab-f104-4739-9e22-4dd1c6103a33 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:05.658300 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab2542-d929-41ca-80bf-41a6ba0133f8 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:05.660029 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8320f5-cb37-460d-8545-94a51a9837c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:05.660679 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8320f5-cb37-460d-8545-94a51a9837c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:05.661014 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8320f5-cb37-460d-8545-94a51a9837c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:05.661249 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8320f5-cb37-460d-8545-94a51a9837c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:05.661957 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8320f5-cb37-460d-8545-94a51a9837c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:05.662980 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78d668-0fc9-47aa-84c7-6628d0de4e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:05.663556 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8320f5-cb37-460d-8545-94a51a9837c0 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:05.663648 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78d668-0fc9-47aa-84c7-6628d0de4e1e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:05.663905 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78d668-0fc9-47aa-84c7-6628d0de4e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:05.664190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78d668-0fc9-47aa-84c7-6628d0de4e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:05.664913 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78d668-0fc9-47aa-84c7-6628d0de4e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:05.666477 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78d668-0fc9-47aa-84c7-6628d0de4e1e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:05.677025 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1184/2334] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:12:05.680616 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1151/2335] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:12:05.680751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93339d9-080a-44f5-bcbe-b9b300c56920 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:05.680751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93339d9-080a-44f5-bcbe-b9b300c56920 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:05.680751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93339d9-080a-44f5-bcbe-b9b300c56920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:05.689480 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8320f5-cb37-460d-8545-94a51a9837c0 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:05.691198 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8320f5-cb37-460d-8545-94a51a9837c0 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:05.696068 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a734b-9d46-496c-92ff-a6191494d89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:05.696919 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a734b-9d46-496c-92ff-a6191494d89c admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:05.697197 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a734b-9d46-496c-92ff-a6191494d89c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:05.697488 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a734b-9d46-496c-92ff-a6191494d89c admin admin] PATH_INFO: `/v3/projects/c29eb1ac33c24a3798cba5101d14f625/users/0ff0c4568ec648df92d45f4aa870af8c/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:05.699063 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-d93339d9-080a-44f5-bcbe-b9b300c56920 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:05.700274 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d93339d9-080a-44f5-bcbe-b9b300c56920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:05.709082 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1185/2336] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:12:05.712443 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93339d9-080a-44f5-bcbe-b9b300c56920 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:05.712884 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a734b-9d46-496c-92ff-a6191494d89c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29eb1ac33c24a3798cba5101d14f625, user_id=0ff0c4568ec648df92d45f4aa870af8c, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:05.715547 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a734b-9d46-496c-92ff-a6191494d89c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:05.720277 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93339d9-080a-44f5-bcbe-b9b300c56920 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:05.725039 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300a1ea-dcc3-430f-ae7c-6e4f0076caf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:05.725887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300a1ea-dcc3-430f-ae7c-6e4f0076caf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:05.726171 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300a1ea-dcc3-430f-ae7c-6e4f0076caf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:05.726446 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300a1ea-dcc3-430f-ae7c-6e4f0076caf1 admin admin] PATH_INFO: `/v3/projects/6ca2d2f14f8c4639a8345e5dad4380f4/users/c8a6e26ab37b4f9d9d438e7fa727802d/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:05.740653 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300a1ea-dcc3-430f-ae7c-6e4f0076caf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca2d2f14f8c4639a8345e5dad4380f4, user_id=c8a6e26ab37b4f9d9d438e7fa727802d, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:05.743712 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300a1ea-dcc3-430f-ae7c-6e4f0076caf1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:05.808417 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1152/2337] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:12:05 2022] PUT /identity/v3/projects/c29eb1ac33c24a3798cba5101d14f625/users/0ff0c4568ec648df92d45f4aa870af8c/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:12:05.809422 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a734b-9d46-496c-92ff-a6191494d89c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:05.869019 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a734b-9d46-496c-92ff-a6191494d89c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:05.872126 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1186/2338] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:12:05 2022] PUT /identity/v3/projects/6ca2d2f14f8c4639a8345e5dad4380f4/users/c8a6e26ab37b4f9d9d438e7fa727802d/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:12:05.876651 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ec668-b362-4c63-920c-bd25eb385b7b None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:05.876651 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ec668-b362-4c63-920c-bd25eb385b7b None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:05.876651 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ec668-b362-4c63-920c-bd25eb385b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:05.912752 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-657ec668-b362-4c63-920c-bd25eb385b7b None None] MFA Rules not processed for user `0ff0c4568ec648df92d45f4aa870af8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:05.913892 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-657ec668-b362-4c63-920c-bd25eb385b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:05.933381 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85d8ff-a082-4af0-9c15-78d3920d6f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:05.934054 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85d8ff-a082-4af0-9c15-78d3920d6f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:05.934336 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85d8ff-a082-4af0-9c15-78d3920d6f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:05.934607 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85d8ff-a082-4af0-9c15-78d3920d6f94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:05.935361 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85d8ff-a082-4af0-9c15-78d3920d6f94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:12:05.935666 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85d8ff-a082-4af0-9c15-78d3920d6f94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:05.938070 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85d8ff-a082-4af0-9c15-78d3920d6f94 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:05.950853 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1153/2339] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:12:05.952185 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abce24-29db-4c39-8315-8300a19aef97 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:05.952470 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abce24-29db-4c39-8315-8300a19aef97 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:05.952845 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abce24-29db-4c39-8315-8300a19aef97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:05.972559 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-c8abce24-29db-4c39-8315-8300a19aef97 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:05.973766 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-c8abce24-29db-4c39-8315-8300a19aef97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:05.982311 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1187/2340] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:12:05.982957 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ec668-b362-4c63-920c-bd25eb385b7b None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:05.984093 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1154/2341] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:12:05.997195 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ec668-b362-4c63-920c-bd25eb385b7b None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:05.998829 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abce24-29db-4c39-8315-8300a19aef97 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:06.001349 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-c8abce24-29db-4c39-8315-8300a19aef97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:06.007523 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2541cf-3162-4e91-9153-6a0c19fb39f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:06.007523 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2541cf-3162-4e91-9153-6a0c19fb39f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:06.007523 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2541cf-3162-4e91-9153-6a0c19fb39f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:06.007523 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2541cf-3162-4e91-9153-6a0c19fb39f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:06.007944 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2541cf-3162-4e91-9153-6a0c19fb39f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:06.007944 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2541cf-3162-4e91-9153-6a0c19fb39f3 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:06.067369 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abce24-29db-4c39-8315-8300a19aef97 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:06.071274 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845a722-2e77-4e32-ac0c-a08a618fb9f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:06.075815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845a722-2e77-4e32-ac0c-a08a618fb9f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:06.075815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845a722-2e77-4e32-ac0c-a08a618fb9f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:06.075815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845a722-2e77-4e32-ac0c-a08a618fb9f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:06.082129 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845a722-2e77-4e32-ac0c-a08a618fb9f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:06.083569 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845a722-2e77-4e32-ac0c-a08a618fb9f6 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:06.092929 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1155/2342] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:12:06.093785 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845a722-2e77-4e32-ac0c-a08a618fb9f6 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:06.095203 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-2845a722-2e77-4e32-ac0c-a08a618fb9f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:06.105675 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1188/2343] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:12:05 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:12:06.110397 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2541cf-3162-4e91-9153-6a0c19fb39f3 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:06.162185 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845a722-2e77-4e32-ac0c-a08a618fb9f6 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:06.183885 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2541cf-3162-4e91-9153-6a0c19fb39f3 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:06.185833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246cd7c-dd5f-473c-89c7-2def8cfd472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:06.186552 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246cd7c-dd5f-473c-89c7-2def8cfd472b admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:06.186897 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246cd7c-dd5f-473c-89c7-2def8cfd472b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:06.187736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246cd7c-dd5f-473c-89c7-2def8cfd472b admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:06.188850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246cd7c-dd5f-473c-89c7-2def8cfd472b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:06.190836 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246cd7c-dd5f-473c-89c7-2def8cfd472b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:06.213413 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f2318-6c65-4499-9e4b-f9e5f08b2d2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:06.214073 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f2318-6c65-4499-9e4b-f9e5f08b2d2d service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:06.214353 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f2318-6c65-4499-9e4b-f9e5f08b2d2d service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:06.214626 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f2318-6c65-4499-9e4b-f9e5f08b2d2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:06.272506 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f2318-6c65-4499-9e4b-f9e5f08b2d2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:06.273922 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f2318-6c65-4499-9e4b-f9e5f08b2d2d service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:06.283024 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1156/2344] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:12:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:12:06.297004 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f2318-6c65-4499-9e4b-f9e5f08b2d2d service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:06.308356 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f2318-6c65-4499-9e4b-f9e5f08b2d2d service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:06.313696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623e7e6-e897-4efd-811d-6a1c23b5edde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:06.314563 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623e7e6-e897-4efd-811d-6a1c23b5edde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:06.314875 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623e7e6-e897-4efd-811d-6a1c23b5edde admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:06.315152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623e7e6-e897-4efd-811d-6a1c23b5edde admin admin] PATH_INFO: `/v3/users/0ff0c4568ec648df92d45f4aa870af8c` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:06.316356 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623e7e6-e897-4efd-811d-6a1c23b5edde admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff0c4568ec648df92d45f4aa870af8c)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:06.318267 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623e7e6-e897-4efd-811d-6a1c23b5edde admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:06.433498 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1189/2345] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:12:06 2022] POST /identity/v3/users => generated 292 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:12:06.438297 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246cd7c-dd5f-473c-89c7-2def8cfd472b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:06.449216 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246cd7c-dd5f-473c-89c7-2def8cfd472b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:06.454486 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d655d2c-f084-4d54-9be7-5861f3acff2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:06.455215 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d655d2c-f084-4d54-9be7-5861f3acff2b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:06.455565 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d655d2c-f084-4d54-9be7-5861f3acff2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:06.455910 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d655d2c-f084-4d54-9be7-5861f3acff2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:06.456807 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d655d2c-f084-4d54-9be7-5861f3acff2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:06.458575 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d655d2c-f084-4d54-9be7-5861f3acff2b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:06.469782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1190/2346] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:12:06.476590 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d655d2c-f084-4d54-9be7-5861f3acff2b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:06.487626 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d655d2c-f084-4d54-9be7-5861f3acff2b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:06.493604 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79118eb7-edbf-4ae0-9407-3aac0bc11a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:06.495373 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79118eb7-edbf-4ae0-9407-3aac0bc11a85 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:06.495373 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79118eb7-edbf-4ae0-9407-3aac0bc11a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:06.495373 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79118eb7-edbf-4ae0-9407-3aac0bc11a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:06.496689 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79118eb7-edbf-4ae0-9407-3aac0bc11a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:06.497122 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79118eb7-edbf-4ae0-9407-3aac0bc11a85 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:06.508583 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1191/2347] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:12:06.512794 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79118eb7-edbf-4ae0-9407-3aac0bc11a85 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:06.522735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79118eb7-edbf-4ae0-9407-3aac0bc11a85 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:06.531637 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855737e-549f-4021-b1b1-9a5913d85ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:06.533503 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855737e-549f-4021-b1b1-9a5913d85ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:06.533778 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855737e-549f-4021-b1b1-9a5913d85ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:06.534050 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855737e-549f-4021-b1b1-9a5913d85ea2 admin admin] PATH_INFO: `/v3/projects/812b2eae09ba4f67be10a5953729f190/users/0902146bb25b40c09d572cec30b7a7b1/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:06.543137 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0623e7e6-e897-4efd-811d-6a1c23b5edde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff0c4568ec648df92d45f4aa870af8c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:06.543878 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0623e7e6-e897-4efd-811d-6a1c23b5edde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff0c4568ec648df92d45f4aa870af8c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:06.551117 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855737e-549f-4021-b1b1-9a5913d85ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=812b2eae09ba4f67be10a5953729f190, user_id=0902146bb25b40c09d572cec30b7a7b1, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:06.553871 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855737e-549f-4021-b1b1-9a5913d85ea2 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:06.557638 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0623e7e6-e897-4efd-811d-6a1c23b5edde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff0c4568ec648df92d45f4aa870af8c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:06.564546 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0623e7e6-e897-4efd-811d-6a1c23b5edde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff0c4568ec648df92d45f4aa870af8c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:06.650818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1192/2348] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:12:06 2022] PUT /identity/v3/projects/812b2eae09ba4f67be10a5953729f190/users/0902146bb25b40c09d572cec30b7a7b1/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:12:06.650818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a5269-7be1-49ec-94f7-3db31710a21f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:06.650818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a5269-7be1-49ec-94f7-3db31710a21f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:06.650818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a5269-7be1-49ec-94f7-3db31710a21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:06.661985 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-007a5269-7be1-49ec-94f7-3db31710a21f None None] MFA Rules not processed for user `b5ea1801f0674e8297e2cd8a964333d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:06.663225 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-007a5269-7be1-49ec-94f7-3db31710a21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:06.721861 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0623e7e6-e897-4efd-811d-6a1c23b5edde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff0c4568ec648df92d45f4aa870af8c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:06.722070 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1193/2349] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:12:06.723121 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23698cc3-0e70-4673-8ab8-028a5d480af0 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:06.723409 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23698cc3-0e70-4673-8ab8-028a5d480af0 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:06.723692 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23698cc3-0e70-4673-8ab8-028a5d480af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:06.736969 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1157/2350] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:12:06 2022] DELETE /identity/v3/users/0ff0c4568ec648df92d45f4aa870af8c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:12:06.738461 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be593945-dde2-4a6c-8055-fa2ab6345358 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:06.738855 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be593945-dde2-4a6c-8055-fa2ab6345358 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:06.739195 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be593945-dde2-4a6c-8055-fa2ab6345358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:06.753000 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-23698cc3-0e70-4673-8ab8-028a5d480af0 None None] MFA Rules not processed for user `0902146bb25b40c09d572cec30b7a7b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:06.754301 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-23698cc3-0e70-4673-8ab8-028a5d480af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:06.759736 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-be593945-dde2-4a6c-8055-fa2ab6345358 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:06.760912 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-be593945-dde2-4a6c-8055-fa2ab6345358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:06.825693 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1158/2351] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:12:06.827471 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1194/2352] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:12:06.835986 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be593945-dde2-4a6c-8055-fa2ab6345358 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:06.837214 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23698cc3-0e70-4673-8ab8-028a5d480af0 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:06.838781 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-23698cc3-0e70-4673-8ab8-028a5d480af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:06.839539 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-be593945-dde2-4a6c-8055-fa2ab6345358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:06.908012 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be593945-dde2-4a6c-8055-fa2ab6345358 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:06.911953 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacae12-b22d-42ed-8647-03e2b10733f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:06.912610 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacae12-b22d-42ed-8647-03e2b10733f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:06.918502 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacae12-b22d-42ed-8647-03e2b10733f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:06.918502 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacae12-b22d-42ed-8647-03e2b10733f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:06.924377 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acacae12-b22d-42ed-8647-03e2b10733f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:06.925823 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acacae12-b22d-42ed-8647-03e2b10733f6 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:06.936785 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1159/2353] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:12:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:12:07.078753 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23698cc3-0e70-4673-8ab8-028a5d480af0 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:07.086394 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ceb15-1118-4b4d-8eab-48b5067c709d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:07.086394 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ceb15-1118-4b4d-8eab-48b5067c709d service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:07.086394 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ceb15-1118-4b4d-8eab-48b5067c709d service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:07.086394 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ceb15-1118-4b4d-8eab-48b5067c709d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:07.097147 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ceb15-1118-4b4d-8eab-48b5067c709d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:07.099728 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ceb15-1118-4b4d-8eab-48b5067c709d service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:07.113239 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1195/2354] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:12:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:12:07.134941 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacae12-b22d-42ed-8647-03e2b10733f6 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:07.136443 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-acacae12-b22d-42ed-8647-03e2b10733f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:07.150263 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacae12-b22d-42ed-8647-03e2b10733f6 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:07.155604 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745d4d0-53ae-4942-ba74-70ce0003d9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:07.156680 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745d4d0-53ae-4942-ba74-70ce0003d9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:07.157207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745d4d0-53ae-4942-ba74-70ce0003d9da admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:07.157207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745d4d0-53ae-4942-ba74-70ce0003d9da admin admin] PATH_INFO: `/v3/users/0902146bb25b40c09d572cec30b7a7b1` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:07.159150 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745d4d0-53ae-4942-ba74-70ce0003d9da admin admin] RBAC: Authorizing `identity:delete_user(user_id=0902146bb25b40c09d572cec30b7a7b1)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:07.161198 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745d4d0-53ae-4942-ba74-70ce0003d9da admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:07.410750 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b745d4d0-53ae-4942-ba74-70ce0003d9da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0902146bb25b40c09d572cec30b7a7b1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:07.411422 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b745d4d0-53ae-4942-ba74-70ce0003d9da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0902146bb25b40c09d572cec30b7a7b1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:07.423561 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b745d4d0-53ae-4942-ba74-70ce0003d9da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0902146bb25b40c09d572cec30b7a7b1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:07.430166 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b745d4d0-53ae-4942-ba74-70ce0003d9da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0902146bb25b40c09d572cec30b7a7b1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:07.534933 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-b745d4d0-53ae-4942-ba74-70ce0003d9da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0902146bb25b40c09d572cec30b7a7b1'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:07.541550 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1160/2355] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:12:07 2022] DELETE /identity/v3/users/0902146bb25b40c09d572cec30b7a7b1 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:12:07.545975 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32417b8-ce54-4afd-9a61-44c3d27ed6f1 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:07.546265 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32417b8-ce54-4afd-9a61-44c3d27ed6f1 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:07.546588 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32417b8-ce54-4afd-9a61-44c3d27ed6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:07.565367 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-a32417b8-ce54-4afd-9a61-44c3d27ed6f1 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:07.567090 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a32417b8-ce54-4afd-9a61-44c3d27ed6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:07.634964 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1196/2356] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:12:07.644698 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745d4d0-53ae-4942-ba74-70ce0003d9da admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:07.646108 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b745d4d0-53ae-4942-ba74-70ce0003d9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:07.695052 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32417b8-ce54-4afd-9a61-44c3d27ed6f1 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:07.697024 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a32417b8-ce54-4afd-9a61-44c3d27ed6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:07.724955 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745d4d0-53ae-4942-ba74-70ce0003d9da admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:07.729371 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf25d5-24c3-4b2a-b766-963ab23f42df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:07.729625 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32417b8-ce54-4afd-9a61-44c3d27ed6f1 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:07.735452 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf25d5-24c3-4b2a-b766-963ab23f42df service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:07.735452 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf25d5-24c3-4b2a-b766-963ab23f42df service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:07.735452 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf25d5-24c3-4b2a-b766-963ab23f42df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:07.744134 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf25d5-24c3-4b2a-b766-963ab23f42df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:07.745708 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6869b81-7fab-4505-99d9-8b663662f63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:07.746601 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6869b81-7fab-4505-99d9-8b663662f63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:07.746972 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6869b81-7fab-4505-99d9-8b663662f63d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:07.747245 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6869b81-7fab-4505-99d9-8b663662f63d admin admin] PATH_INFO: `/v3/projects/c29eb1ac33c24a3798cba5101d14f625` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:07.748577 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6869b81-7fab-4505-99d9-8b663662f63d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c29eb1ac33c24a3798cba5101d14f625)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:07.749154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf25d5-24c3-4b2a-b766-963ab23f42df service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:07.751508 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6869b81-7fab-4505-99d9-8b663662f63d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:07.761367 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1161/2357] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:12:07.872321 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e6869b81-7fab-4505-99d9-8b663662f63d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c29eb1ac33c24a3798cba5101d14f625', 'request_id': 'req-e6869b81-7fab-4505-99d9-8b663662f63d'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:07.951546 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e6869b81-7fab-4505-99d9-8b663662f63d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c29eb1ac33c24a3798cba5101d14f625', 'request_id': 'req-e6869b81-7fab-4505-99d9-8b663662f63d'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:07.960039 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e6869b81-7fab-4505-99d9-8b663662f63d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c29eb1ac33c24a3798cba5101d14f625', 'request_id': 'req-e6869b81-7fab-4505-99d9-8b663662f63d'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:07.977751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e6869b81-7fab-4505-99d9-8b663662f63d admin admin] The token cache is being invalidate because project c29eb1ac33c24a3798cba5101d14f625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:12:07.978330 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e6869b81-7fab-4505-99d9-8b663662f63d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:07.979310 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e6869b81-7fab-4505-99d9-8b663662f63d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:07.981761 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1197/2358] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:12:07 2022] DELETE /identity/v3/projects/c29eb1ac33c24a3798cba5101d14f625 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:12:07.987017 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da97803-6e08-445a-9b7f-2f4682979817 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:07.993087 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da97803-6e08-445a-9b7f-2f4682979817 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:07.993087 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da97803-6e08-445a-9b7f-2f4682979817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:08.017069 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-8da97803-6e08-445a-9b7f-2f4682979817 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:08.018335 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-8da97803-6e08-445a-9b7f-2f4682979817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:08.045574 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf903bc-3920-40ad-b4d1-0c90e22ab80f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:08.045913 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf903bc-3920-40ad-b4d1-0c90e22ab80f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:08.046143 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf903bc-3920-40ad-b4d1-0c90e22ab80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:08.100633 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-cdf903bc-3920-40ad-b4d1-0c90e22ab80f None None] MFA Rules not processed for user `c8a6e26ab37b4f9d9d438e7fa727802d`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:08.101858 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-cdf903bc-3920-40ad-b4d1-0c90e22ab80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:08.114839 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1162/2359] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:12:08.120681 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e6841-9492-48f0-b8fe-443bdf0f4563 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:08.125178 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e6841-9492-48f0-b8fe-443bdf0f4563 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:08.125178 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e6841-9492-48f0-b8fe-443bdf0f4563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:08.155408 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-1d6e6841-9492-48f0-b8fe-443bdf0f4563 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:08.159613 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-1d6e6841-9492-48f0-b8fe-443bdf0f4563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:08.166218 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1163/2360] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:12:08.170446 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e6841-9492-48f0-b8fe-443bdf0f4563 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:08.181217 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e6841-9492-48f0-b8fe-443bdf0f4563 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:08.188165 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752713d1-dd30-4b12-9b6d-80bd3c30d4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:08.189808 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752713d1-dd30-4b12-9b6d-80bd3c30d4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:08.189808 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752713d1-dd30-4b12-9b6d-80bd3c30d4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:08.189808 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752713d1-dd30-4b12-9b6d-80bd3c30d4f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:08.190149 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752713d1-dd30-4b12-9b6d-80bd3c30d4f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:12:08.190317 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752713d1-dd30-4b12-9b6d-80bd3c30d4f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:08.194736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1198/2361] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:12:08.195278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752713d1-dd30-4b12-9b6d-80bd3c30d4f8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:08.200654 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf903bc-3920-40ad-b4d1-0c90e22ab80f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:08.202254 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-cdf903bc-3920-40ad-b4d1-0c90e22ab80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:08.214514 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1164/2362] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 17:12:08.236393 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752713d1-dd30-4b12-9b6d-80bd3c30d4f8 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:08.247358 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752713d1-dd30-4b12-9b6d-80bd3c30d4f8 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:08.253316 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1483d4-1981-42ce-b91d-352379ff2898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:08.254105 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1483d4-1981-42ce-b91d-352379ff2898 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:08.254383 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1483d4-1981-42ce-b91d-352379ff2898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:08.254680 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1483d4-1981-42ce-b91d-352379ff2898 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:08.255378 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1483d4-1981-42ce-b91d-352379ff2898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:08.258147 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1483d4-1981-42ce-b91d-352379ff2898 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:08.290812 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf903bc-3920-40ad-b4d1-0c90e22ab80f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:08.294297 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6ec29-2b1d-4780-b21e-8d3338717611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:08.294982 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6ec29-2b1d-4780-b21e-8d3338717611 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:08.295257 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6ec29-2b1d-4780-b21e-8d3338717611 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:08.295529 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6ec29-2b1d-4780-b21e-8d3338717611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:08.309105 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6ec29-2b1d-4780-b21e-8d3338717611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:08.310564 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6ec29-2b1d-4780-b21e-8d3338717611 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:08.329004 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1199/2363] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:12:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:12:08.330562 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6ec29-2b1d-4780-b21e-8d3338717611 service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:08.335761 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-9ca6ec29-2b1d-4780-b21e-8d3338717611 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:08.371082 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6ec29-2b1d-4780-b21e-8d3338717611 service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:08.381354 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88deb9-48d0-47aa-9d02-e4fba0b6b682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:08.382408 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88deb9-48d0-47aa-9d02-e4fba0b6b682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:08.382889 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88deb9-48d0-47aa-9d02-e4fba0b6b682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:08.383314 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88deb9-48d0-47aa-9d02-e4fba0b6b682 admin admin] PATH_INFO: `/v3/projects/812b2eae09ba4f67be10a5953729f190` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:08.384747 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88deb9-48d0-47aa-9d02-e4fba0b6b682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=812b2eae09ba4f67be10a5953729f190)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:08.387115 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88deb9-48d0-47aa-9d02-e4fba0b6b682 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:08.388518 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1165/2364] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:12:08 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:12:08.396040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1483d4-1981-42ce-b91d-352379ff2898 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:08.499392 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1483d4-1981-42ce-b91d-352379ff2898 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:08.507057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0199902-fea0-40d7-971a-ee536f910ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:08.508244 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0199902-fea0-40d7-971a-ee536f910ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:08.508836 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0199902-fea0-40d7-971a-ee536f910ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:08.509214 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0199902-fea0-40d7-971a-ee536f910ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:08.510289 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0199902-fea0-40d7-971a-ee536f910ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:08.512700 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0199902-fea0-40d7-971a-ee536f910ba3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:08.541481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-af88deb9-48d0-47aa-9d02-e4fba0b6b682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '812b2eae09ba4f67be10a5953729f190', 'request_id': 'req-af88deb9-48d0-47aa-9d02-e4fba0b6b682'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:08.683453 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1166/2365] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:12:08 2022] POST /identity/v3/users => generated 289 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:12:08.687592 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0199902-fea0-40d7-971a-ee536f910ba3 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:08.697476 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0199902-fea0-40d7-971a-ee536f910ba3 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:08.705563 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-af88deb9-48d0-47aa-9d02-e4fba0b6b682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '812b2eae09ba4f67be10a5953729f190', 'request_id': 'req-af88deb9-48d0-47aa-9d02-e4fba0b6b682'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:08.715201 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-af88deb9-48d0-47aa-9d02-e4fba0b6b682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '812b2eae09ba4f67be10a5953729f190', 'request_id': 'req-af88deb9-48d0-47aa-9d02-e4fba0b6b682'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:08.728738 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-af88deb9-48d0-47aa-9d02-e4fba0b6b682 admin admin] The token cache is being invalidate because project 812b2eae09ba4f67be10a5953729f190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:12:08.729060 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-af88deb9-48d0-47aa-9d02-e4fba0b6b682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:08.729707 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-af88deb9-48d0-47aa-9d02-e4fba0b6b682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:08.731301 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1200/2366] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:12:08 2022] DELETE /identity/v3/projects/812b2eae09ba4f67be10a5953729f190 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:12:08.737115 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729870db-faed-4b33-a917-7d792e262e75 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:08.737663 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729870db-faed-4b33-a917-7d792e262e75 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:08.738089 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729870db-faed-4b33-a917-7d792e262e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:08.760237 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-729870db-faed-4b33-a917-7d792e262e75 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:08.761531 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-729870db-faed-4b33-a917-7d792e262e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:08.767769 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73ff40-f3ce-4194-89c6-f7eaf656164c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:08.768806 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73ff40-f3ce-4194-89c6-f7eaf656164c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:08.769092 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73ff40-f3ce-4194-89c6-f7eaf656164c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:08.769580 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73ff40-f3ce-4194-89c6-f7eaf656164c admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:08.770387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1201/2367] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:12:08.770989 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73ff40-f3ce-4194-89c6-f7eaf656164c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:08.773904 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73ff40-f3ce-4194-89c6-f7eaf656164c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:08.779030 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0e307-6c6a-4a11-ae1b-04b4bd4cdd33 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:08.779333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0e307-6c6a-4a11-ae1b-04b4bd4cdd33 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:08.779815 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0e307-6c6a-4a11-ae1b-04b4bd4cdd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:08.788009 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1167/2368] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:12:08.791739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73ff40-f3ce-4194-89c6-f7eaf656164c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:08.793591 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-8d73ff40-f3ce-4194-89c6-f7eaf656164c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:08.799116 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-1cd0e307-6c6a-4a11-ae1b-04b4bd4cdd33 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:08.800405 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-1cd0e307-6c6a-4a11-ae1b-04b4bd4cdd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:08.817454 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73ff40-f3ce-4194-89c6-f7eaf656164c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:08.817574 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1202/2369] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:12:08.817670 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7de49-ae4e-4f44-8b3f-91b5a262aaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:08.817670 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7de49-ae4e-4f44-8b3f-91b5a262aaae admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:08.817670 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7de49-ae4e-4f44-8b3f-91b5a262aaae admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:08.817670 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7de49-ae4e-4f44-8b3f-91b5a262aaae admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:08.817953 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7de49-ae4e-4f44-8b3f-91b5a262aaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:08.817953 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7de49-ae4e-4f44-8b3f-91b5a262aaae admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:08.820294 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0e307-6c6a-4a11-ae1b-04b4bd4cdd33 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:08.834128 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1168/2370] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:12:08.834326 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0e307-6c6a-4a11-ae1b-04b4bd4cdd33 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:08.835423 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7de49-ae4e-4f44-8b3f-91b5a262aaae admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:08.836698 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd81a4-8015-4c09-92b5-cf48d0565102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:08.837352 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd81a4-8015-4c09-92b5-cf48d0565102 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:08.837634 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd81a4-8015-4c09-92b5-cf48d0565102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:08.837910 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd81a4-8015-4c09-92b5-cf48d0565102 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:08.838629 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd81a4-8015-4c09-92b5-cf48d0565102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:12:08.838977 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd81a4-8015-4c09-92b5-cf48d0565102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:08.840562 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd81a4-8015-4c09-92b5-cf48d0565102 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:08.846376 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7de49-ae4e-4f44-8b3f-91b5a262aaae admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:08.851289 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06c98d-5ed2-4726-89eb-42d94d8249df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:08.852165 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06c98d-5ed2-4726-89eb-42d94d8249df admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:08.852472 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06c98d-5ed2-4726-89eb-42d94d8249df admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:08.852746 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06c98d-5ed2-4726-89eb-42d94d8249df admin admin] PATH_INFO: `/v3/projects/20c60018c14c4b388d2c13fb0ec78c00/users/3ca710cf46184d70850eaf5e605dbab9/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:08.852952 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1203/2371] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 17:12:08.857255 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd81a4-8015-4c09-92b5-cf48d0565102 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:08.867341 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd81a4-8015-4c09-92b5-cf48d0565102 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:08.867960 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06c98d-5ed2-4726-89eb-42d94d8249df admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c60018c14c4b388d2c13fb0ec78c00, user_id=3ca710cf46184d70850eaf5e605dbab9, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:08.870569 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06c98d-5ed2-4726-89eb-42d94d8249df admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:08.872323 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8ae7f-158a-42d7-b6ac-9370e77b379a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:08.874256 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8ae7f-158a-42d7-b6ac-9370e77b379a admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:08.874256 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8ae7f-158a-42d7-b6ac-9370e77b379a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:08.874256 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8ae7f-158a-42d7-b6ac-9370e77b379a admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:08.874256 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8ae7f-158a-42d7-b6ac-9370e77b379a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:08.876821 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8ae7f-158a-42d7-b6ac-9370e77b379a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:08.980568 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1169/2372] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:12:08 2022] PUT /identity/v3/projects/20c60018c14c4b388d2c13fb0ec78c00/users/3ca710cf46184d70850eaf5e605dbab9/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:12:08.991703 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb576e-7709-427b-a02e-3800181dc356 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:08.992539 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb576e-7709-427b-a02e-3800181dc356 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:08.992539 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb576e-7709-427b-a02e-3800181dc356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:09.018819 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-b3cb576e-7709-427b-a02e-3800181dc356 None None] MFA Rules not processed for user `3ca710cf46184d70850eaf5e605dbab9`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:09.020005 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b3cb576e-7709-427b-a02e-3800181dc356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:09.042677 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1204/2373] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:12:08 2022] POST /identity/v3/projects => generated 363 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:12:09.043528 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8ae7f-158a-42d7-b6ac-9370e77b379a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:09.089295 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1170/2374] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:12:09.099737 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb576e-7709-427b-a02e-3800181dc356 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:09.101078 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b3cb576e-7709-427b-a02e-3800181dc356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:09.111588 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8ae7f-158a-42d7-b6ac-9370e77b379a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:09.116289 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a61b2-7331-4957-9b82-2aaf8a1e79e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:09.117310 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a61b2-7331-4957-9b82-2aaf8a1e79e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:09.117626 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a61b2-7331-4957-9b82-2aaf8a1e79e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:09.117894 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a61b2-7331-4957-9b82-2aaf8a1e79e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:09.118780 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a61b2-7331-4957-9b82-2aaf8a1e79e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:09.120767 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a61b2-7331-4957-9b82-2aaf8a1e79e1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:09.157275 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb576e-7709-427b-a02e-3800181dc356 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:09.211199 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba77a0-3ed4-4902-b78a-f2dd95a3ab4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:09.211903 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba77a0-3ed4-4902-b78a-f2dd95a3ab4d service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:09.212175 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba77a0-3ed4-4902-b78a-f2dd95a3ab4d service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:09.212724 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba77a0-3ed4-4902-b78a-f2dd95a3ab4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:09.262105 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1205/2375] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:12:09 2022] POST /identity/v3/users => generated 282 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:12:09.294047 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba77a0-3ed4-4902-b78a-f2dd95a3ab4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:09.294047 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba77a0-3ed4-4902-b78a-f2dd95a3ab4d service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:09.294047 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1171/2376] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:12:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:12:09.297704 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a61b2-7331-4957-9b82-2aaf8a1e79e1 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:09.308059 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a61b2-7331-4957-9b82-2aaf8a1e79e1 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:09.314930 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30332275-d33a-4d40-a160-387e00f67c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:09.315655 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30332275-d33a-4d40-a160-387e00f67c16 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:09.316047 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30332275-d33a-4d40-a160-387e00f67c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:09.316481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30332275-d33a-4d40-a160-387e00f67c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:09.317516 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30332275-d33a-4d40-a160-387e00f67c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:09.319511 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30332275-d33a-4d40-a160-387e00f67c16 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:09.335747 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1206/2377] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:12:09.358279 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba77a0-3ed4-4902-b78a-f2dd95a3ab4d service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:09.381514 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba77a0-3ed4-4902-b78a-f2dd95a3ab4d service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:09.393483 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bb548-9235-4629-8d7b-a5f7ac85694c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:09.402919 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bb548-9235-4629-8d7b-a5f7ac85694c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:09.402919 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bb548-9235-4629-8d7b-a5f7ac85694c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:09.402919 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bb548-9235-4629-8d7b-a5f7ac85694c admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:09.402919 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bb548-9235-4629-8d7b-a5f7ac85694c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:09.402919 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bb548-9235-4629-8d7b-a5f7ac85694c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:09.412040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1172/2378] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:12:09.415343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30332275-d33a-4d40-a160-387e00f67c16 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:09.434248 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30332275-d33a-4d40-a160-387e00f67c16 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:09.442190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5db380-b1b3-4ac8-a76e-4fa959d27e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:09.443204 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5db380-b1b3-4ac8-a76e-4fa959d27e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:09.443677 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5db380-b1b3-4ac8-a76e-4fa959d27e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:09.444016 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5db380-b1b3-4ac8-a76e-4fa959d27e05 admin admin] PATH_INFO: `/v3/projects/3a9236a5787b46e38bd2439da0ec2191/users/863896a128254e818a0382ee7da77861/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:09.459196 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5db380-b1b3-4ac8-a76e-4fa959d27e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9236a5787b46e38bd2439da0ec2191, user_id=863896a128254e818a0382ee7da77861, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:09.461784 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5db380-b1b3-4ac8-a76e-4fa959d27e05 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:09.596070 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1207/2379] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:12:09 2022] PUT /identity/v3/projects/3a9236a5787b46e38bd2439da0ec2191/users/863896a128254e818a0382ee7da77861/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:12:09.606277 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423331a5-0a7d-4486-93fa-1fff81759fd7 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:09.606553 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423331a5-0a7d-4486-93fa-1fff81759fd7 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:09.607272 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423331a5-0a7d-4486-93fa-1fff81759fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:09.636280 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-423331a5-0a7d-4486-93fa-1fff81759fd7 None None] MFA Rules not processed for user `863896a128254e818a0382ee7da77861`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:09.637488 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-423331a5-0a7d-4486-93fa-1fff81759fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:09.719279 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1173/2380] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:12:09.725177 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5db380-b1b3-4ac8-a76e-4fa959d27e05 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:09.727350 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-4b5db380-b1b3-4ac8-a76e-4fa959d27e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:09.783616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5db380-b1b3-4ac8-a76e-4fa959d27e05 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:09.787288 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e7aa8-695c-412c-bdd5-457c3e3a755c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:09.787964 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e7aa8-695c-412c-bdd5-457c3e3a755c service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:09.788188 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e7aa8-695c-412c-bdd5-457c3e3a755c service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:09.788471 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e7aa8-695c-412c-bdd5-457c3e3a755c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:09.797343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e7aa8-695c-412c-bdd5-457c3e3a755c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:09.800925 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e7aa8-695c-412c-bdd5-457c3e3a755c service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:09.808333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1208/2381] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:12:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:12:11.331229 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a550afa-62d6-48b8-841b-4386ea825ccd None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:11.331703 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a550afa-62d6-48b8-841b-4386ea825ccd None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:11.331795 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a550afa-62d6-48b8-841b-4386ea825ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:11.350566 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-0a550afa-62d6-48b8-841b-4386ea825ccd None None] MFA Rules not processed for user `c8a6e26ab37b4f9d9d438e7fa727802d`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:11.351928 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-0a550afa-62d6-48b8-841b-4386ea825ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:11.409789 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1174/2382] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:12:42.843867 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e7aa8-695c-412c-bdd5-457c3e3a755c service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:42.845648 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-508e7aa8-695c-412c-bdd5-457c3e3a755c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:42.960800 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e7aa8-695c-412c-bdd5-457c3e3a755c service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:42.966002 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438c69a-ba32-4c69-8cca-c0bc35674841 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae711b94b32a431ab880aa8f6068ff25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:42.966786 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438c69a-ba32-4c69-8cca-c0bc35674841 service placement] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:42.967154 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438c69a-ba32-4c69-8cca-c0bc35674841 service placement] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:42.967519 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438c69a-ba32-4c69-8cca-c0bc35674841 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:42.969422 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-b438c69a-ba32-4c69-8cca-c0bc35674841 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:42.981728 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438c69a-ba32-4c69-8cca-c0bc35674841 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:42.983322 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438c69a-ba32-4c69-8cca-c0bc35674841 service placement] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:42.994111 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1209/2383] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:12:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:12:46.423894 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a550afa-62d6-48b8-841b-4386ea825ccd None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:46.488220 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a550afa-62d6-48b8-841b-4386ea825ccd None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:46.497080 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a678497-b716-45df-baca-0dfc81e73582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:46.497983 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a678497-b716-45df-baca-0dfc81e73582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:46.498223 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a678497-b716-45df-baca-0dfc81e73582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:46.498493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a678497-b716-45df-baca-0dfc81e73582 admin admin] PATH_INFO: `/v3/users/3ca710cf46184d70850eaf5e605dbab9` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:46.499744 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a678497-b716-45df-baca-0dfc81e73582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca710cf46184d70850eaf5e605dbab9)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:46.501670 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a678497-b716-45df-baca-0dfc81e73582 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:46.698405 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0a678497-b716-45df-baca-0dfc81e73582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca710cf46184d70850eaf5e605dbab9'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:46.699547 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0a678497-b716-45df-baca-0dfc81e73582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca710cf46184d70850eaf5e605dbab9'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:46.713177 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0a678497-b716-45df-baca-0dfc81e73582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca710cf46184d70850eaf5e605dbab9'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:46.720780 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0a678497-b716-45df-baca-0dfc81e73582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca710cf46184d70850eaf5e605dbab9'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:46.790870 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0a678497-b716-45df-baca-0dfc81e73582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca710cf46184d70850eaf5e605dbab9'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:46.797907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1175/2384] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:12:46 2022] DELETE /identity/v3/users/3ca710cf46184d70850eaf5e605dbab9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:12:46.803305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deec01-fbed-430e-a5fa-4d46dcfe412f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:46.803841 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deec01-fbed-430e-a5fa-4d46dcfe412f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:46.804061 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deec01-fbed-430e-a5fa-4d46dcfe412f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:46.811098 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a678497-b716-45df-baca-0dfc81e73582 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:46.812774 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-0a678497-b716-45df-baca-0dfc81e73582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:46.826103 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-40deec01-fbed-430e-a5fa-4d46dcfe412f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:46.828175 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-40deec01-fbed-430e-a5fa-4d46dcfe412f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:46.873765 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a678497-b716-45df-baca-0dfc81e73582 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:46.877529 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e6b2c-87c5-43be-bd59-e4476f46c5fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:46.878171 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e6b2c-87c5-43be-bd59-e4476f46c5fe service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:46.883403 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e6b2c-87c5-43be-bd59-e4476f46c5fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:46.883403 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e6b2c-87c5-43be-bd59-e4476f46c5fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:46.883403 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-305e6b2c-87c5-43be-bd59-e4476f46c5fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:46.896106 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1210/2385] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:12:46.903945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40deec01-fbed-430e-a5fa-4d46dcfe412f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:46.914961 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40deec01-fbed-430e-a5fa-4d46dcfe412f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:46.918901 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0bd3a-cfa9-4391-9695-42630bf94dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:46.919543 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0bd3a-cfa9-4391-9695-42630bf94dba service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:46.919830 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0bd3a-cfa9-4391-9695-42630bf94dba service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:46.920110 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0bd3a-cfa9-4391-9695-42630bf94dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:46.930998 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0bd3a-cfa9-4391-9695-42630bf94dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:46.932935 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0bd3a-cfa9-4391-9695-42630bf94dba service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:46.943996 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1211/2386] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:12:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:12:46.966352 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e6b2c-87c5-43be-bd59-e4476f46c5fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:46.967897 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e6b2c-87c5-43be-bd59-e4476f46c5fe service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:46.979090 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1176/2387] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:12:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:12:47.431488 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0bd3a-cfa9-4391-9695-42630bf94dba service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:12:47.433930 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-72b0bd3a-cfa9-4391-9695-42630bf94dba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:47.449865 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0bd3a-cfa9-4391-9695-42630bf94dba service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:12:47.461183 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13184072-8ff2-41bd-8035-27077ba925fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:12:47.463073 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13184072-8ff2-41bd-8035-27077ba925fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:47.463355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13184072-8ff2-41bd-8035-27077ba925fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:47.463628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13184072-8ff2-41bd-8035-27077ba925fb admin admin] PATH_INFO: `/v3/projects/20c60018c14c4b388d2c13fb0ec78c00` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:47.465531 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13184072-8ff2-41bd-8035-27077ba925fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=20c60018c14c4b388d2c13fb0ec78c00)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:12:47.468067 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13184072-8ff2-41bd-8035-27077ba925fb admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:12:47.609394 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-13184072-8ff2-41bd-8035-27077ba925fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20c60018c14c4b388d2c13fb0ec78c00', 'request_id': 'req-13184072-8ff2-41bd-8035-27077ba925fb'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:47.688384 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-13184072-8ff2-41bd-8035-27077ba925fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20c60018c14c4b388d2c13fb0ec78c00', 'request_id': 'req-13184072-8ff2-41bd-8035-27077ba925fb'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:47.694907 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-13184072-8ff2-41bd-8035-27077ba925fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20c60018c14c4b388d2c13fb0ec78c00', 'request_id': 'req-13184072-8ff2-41bd-8035-27077ba925fb'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:47.707791 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-13184072-8ff2-41bd-8035-27077ba925fb admin admin] The token cache is being invalidate because project 20c60018c14c4b388d2c13fb0ec78c00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:12:47.708463 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-13184072-8ff2-41bd-8035-27077ba925fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:47.709380 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-13184072-8ff2-41bd-8035-27077ba925fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:12:47.711803 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1212/2388] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:12:47 2022] DELETE /identity/v3/projects/20c60018c14c4b388d2c13fb0ec78c00 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:12:50.980133 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35626efc-1510-45f6-80b8-3cfc82a373ef None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:12:50.980716 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35626efc-1510-45f6-80b8-3cfc82a373ef None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:12:50.980716 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35626efc-1510-45f6-80b8-3cfc82a373ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:12:50.998848 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-35626efc-1510-45f6-80b8-3cfc82a373ef None None] MFA Rules not processed for user `c8a6e26ab37b4f9d9d438e7fa727802d`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:12:51.000060 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-35626efc-1510-45f6-80b8-3cfc82a373ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:12:51.056293 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1177/2389] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:12:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:13:22.668260 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf945f-731a-4ec3-8e54-cc90dd20fa2f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:22.669020 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf945f-731a-4ec3-8e54-cc90dd20fa2f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:22.669375 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf945f-731a-4ec3-8e54-cc90dd20fa2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:22.738532 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-3fdf945f-731a-4ec3-8e54-cc90dd20fa2f None None] MFA Rules not processed for user `fa9ea7738c634318a532ebca2e564745`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:13:22.740069 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-3fdf945f-731a-4ec3-8e54-cc90dd20fa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:22.859556 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1213/2390] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Feb 16 17:13:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:13:22.912118 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35626efc-1510-45f6-80b8-3cfc82a373ef None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:22.913511 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-35626efc-1510-45f6-80b8-3cfc82a373ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:23.005655 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35626efc-1510-45f6-80b8-3cfc82a373ef None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:23.010837 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c03f9c-9672-4164-9774-5157f058780a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc59cb98783b4353a405b8b9a3a9d592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:23.011477 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c03f9c-9672-4164-9774-5157f058780a service swift] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:23.011756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c03f9c-9672-4164-9774-5157f058780a service swift] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:23.012029 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c03f9c-9672-4164-9774-5157f058780a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:23.020594 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c03f9c-9672-4164-9774-5157f058780a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:23.022125 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c03f9c-9672-4164-9774-5157f058780a service swift] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:23.030201 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1178/2391] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Feb 16 17:13:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 17:13:24.069898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf945f-731a-4ec3-8e54-cc90dd20fa2f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:24.076453 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-3fdf945f-731a-4ec3-8e54-cc90dd20fa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:24.150175 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf945f-731a-4ec3-8e54-cc90dd20fa2f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:24.155704 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef041074-c1ca-4623-8aa6-2ad0087f558a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:24.156601 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef041074-c1ca-4623-8aa6-2ad0087f558a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:24.157025 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef041074-c1ca-4623-8aa6-2ad0087f558a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:24.157325 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef041074-c1ca-4623-8aa6-2ad0087f558a admin admin] PATH_INFO: `/v3/users/863896a128254e818a0382ee7da77861` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:24.158561 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef041074-c1ca-4623-8aa6-2ad0087f558a admin admin] RBAC: Authorizing `identity:delete_user(user_id=863896a128254e818a0382ee7da77861)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:24.161188 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef041074-c1ca-4623-8aa6-2ad0087f558a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:24.342035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-ef041074-c1ca-4623-8aa6-2ad0087f558a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '863896a128254e818a0382ee7da77861'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:24.342626 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-ef041074-c1ca-4623-8aa6-2ad0087f558a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '863896a128254e818a0382ee7da77861'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:24.355522 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-ef041074-c1ca-4623-8aa6-2ad0087f558a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '863896a128254e818a0382ee7da77861'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:24.362488 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-ef041074-c1ca-4623-8aa6-2ad0087f558a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '863896a128254e818a0382ee7da77861'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:24.363259 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-ef041074-c1ca-4623-8aa6-2ad0087f558a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '863896a128254e818a0382ee7da77861'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:24.608557 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1214/2392] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:13:24 2022] DELETE /identity/v3/users/863896a128254e818a0382ee7da77861 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:13:24.613689 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b2394-2773-4132-b0b4-8d2350edfc63 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:24.614361 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b2394-2773-4132-b0b4-8d2350edfc63 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:24.614361 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b2394-2773-4132-b0b4-8d2350edfc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:24.637350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-b52b2394-2773-4132-b0b4-8d2350edfc63 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:13:24.638997 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b52b2394-2773-4132-b0b4-8d2350edfc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:24.710413 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1179/2393] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:13:24.721270 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef041074-c1ca-4623-8aa6-2ad0087f558a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:24.722805 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-ef041074-c1ca-4623-8aa6-2ad0087f558a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:24.794784 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef041074-c1ca-4623-8aa6-2ad0087f558a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:24.799434 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13162fdf-885f-43d7-8e9d-07e03b082dd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:24.800087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13162fdf-885f-43d7-8e9d-07e03b082dd4 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:24.800367 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13162fdf-885f-43d7-8e9d-07e03b082dd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:24.800638 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13162fdf-885f-43d7-8e9d-07e03b082dd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:24.812144 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13162fdf-885f-43d7-8e9d-07e03b082dd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:24.813835 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13162fdf-885f-43d7-8e9d-07e03b082dd4 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:24.825545 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1215/2394] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:13:25.358781 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b2394-2773-4132-b0b4-8d2350edfc63 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:25.360243 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b52b2394-2773-4132-b0b4-8d2350edfc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:25.410547 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b2394-2773-4132-b0b4-8d2350edfc63 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:25.417542 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a36ec-20ed-496a-ad7e-6631dfcc2684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:25.420102 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a36ec-20ed-496a-ad7e-6631dfcc2684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:25.420690 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a36ec-20ed-496a-ad7e-6631dfcc2684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:25.421175 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a36ec-20ed-496a-ad7e-6631dfcc2684 admin admin] PATH_INFO: `/v3/projects/3a9236a5787b46e38bd2439da0ec2191` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:25.422560 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a36ec-20ed-496a-ad7e-6631dfcc2684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a9236a5787b46e38bd2439da0ec2191)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:25.428139 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a36ec-20ed-496a-ad7e-6631dfcc2684 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:25.665556 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-993a36ec-20ed-496a-ad7e-6631dfcc2684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a9236a5787b46e38bd2439da0ec2191', 'request_id': 'req-993a36ec-20ed-496a-ad7e-6631dfcc2684'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:25.740152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-993a36ec-20ed-496a-ad7e-6631dfcc2684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a9236a5787b46e38bd2439da0ec2191', 'request_id': 'req-993a36ec-20ed-496a-ad7e-6631dfcc2684'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:25.748040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-993a36ec-20ed-496a-ad7e-6631dfcc2684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a9236a5787b46e38bd2439da0ec2191', 'request_id': 'req-993a36ec-20ed-496a-ad7e-6631dfcc2684'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:25.763221 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-993a36ec-20ed-496a-ad7e-6631dfcc2684 admin admin] The token cache is being invalidate because project 3a9236a5787b46e38bd2439da0ec2191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:13:25.763511 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-993a36ec-20ed-496a-ad7e-6631dfcc2684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:25.764560 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-993a36ec-20ed-496a-ad7e-6631dfcc2684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:25.771366 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1180/2395] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:13:25 2022] DELETE /identity/v3/projects/3a9236a5787b46e38bd2439da0ec2191 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:13:25.773029 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc4d0a-357d-409c-8c30-e7fc9c6b3409 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:25.773551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc4d0a-357d-409c-8c30-e7fc9c6b3409 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:25.773656 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc4d0a-357d-409c-8c30-e7fc9c6b3409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:25.805500 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-60bc4d0a-357d-409c-8c30-e7fc9c6b3409 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:13:25.806932 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-60bc4d0a-357d-409c-8c30-e7fc9c6b3409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:25.896960 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1216/2396] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:13:25.905144 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa6fe9-a282-4224-860b-03bbd79e0484 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:25.905676 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa6fe9-a282-4224-860b-03bbd79e0484 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:25.906115 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa6fe9-a282-4224-860b-03bbd79e0484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:25.932676 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-25aa6fe9-a282-4224-860b-03bbd79e0484 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:13:25.932676 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-25aa6fe9-a282-4224-860b-03bbd79e0484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:25.944817 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc4d0a-357d-409c-8c30-e7fc9c6b3409 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:25.951258 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1181/2397] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:13:25.955355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc4d0a-357d-409c-8c30-e7fc9c6b3409 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:25.964204 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122881c-b621-4523-9e88-61f7d23ef9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:25.965396 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122881c-b621-4523-9e88-61f7d23ef9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:25.965396 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122881c-b621-4523-9e88-61f7d23ef9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:25.966681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122881c-b621-4523-9e88-61f7d23ef9a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:25.966681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122881c-b621-4523-9e88-61f7d23ef9a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:13:25.968452 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122881c-b621-4523-9e88-61f7d23ef9a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:25.970412 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122881c-b621-4523-9e88-61f7d23ef9a9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:25.992143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa6fe9-a282-4224-860b-03bbd79e0484 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:25.997943 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1217/2398] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:13:26.004565 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa6fe9-a282-4224-860b-03bbd79e0484 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:26.011070 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e5c93-7ce9-488c-acb2-dba5b0c20336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:26.012554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e5c93-7ce9-488c-acb2-dba5b0c20336 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:26.013071 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e5c93-7ce9-488c-acb2-dba5b0c20336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:26.013560 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e5c93-7ce9-488c-acb2-dba5b0c20336 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:26.014775 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e5c93-7ce9-488c-acb2-dba5b0c20336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:26.016961 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e5c93-7ce9-488c-acb2-dba5b0c20336 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:26.209174 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1182/2399] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:13:25 2022] POST /identity/v3/projects => generated 383 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:13:26.213291 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122881c-b621-4523-9e88-61f7d23ef9a9 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:26.224530 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122881c-b621-4523-9e88-61f7d23ef9a9 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:26.323391 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd58a02-178a-407a-a399-c5ec9bccc5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:26.324330 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd58a02-178a-407a-a399-c5ec9bccc5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:26.324728 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd58a02-178a-407a-a399-c5ec9bccc5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:26.325146 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd58a02-178a-407a-a399-c5ec9bccc5f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:26.326354 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd58a02-178a-407a-a399-c5ec9bccc5f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:26.328827 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd58a02-178a-407a-a399-c5ec9bccc5f4 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:26.428194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1218/2400] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:13:26 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:13:26.432884 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e5c93-7ce9-488c-acb2-dba5b0c20336 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:26.444994 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e5c93-7ce9-488c-acb2-dba5b0c20336 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:26.453269 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9edbf-4f90-422a-a9d2-bc483c47f0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:26.454154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9edbf-4f90-422a-a9d2-bc483c47f0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:26.454484 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9edbf-4f90-422a-a9d2-bc483c47f0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:26.457349 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9edbf-4f90-422a-a9d2-bc483c47f0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:26.458697 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9edbf-4f90-422a-a9d2-bc483c47f0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:26.464295 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9edbf-4f90-422a-a9d2-bc483c47f0e5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:26.473599 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1183/2401] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:13:26.477793 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd58a02-178a-407a-a399-c5ec9bccc5f4 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:26.491853 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd58a02-178a-407a-a399-c5ec9bccc5f4 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:26.499002 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fda621-c22a-4dd3-b354-88832724c5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:26.499801 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fda621-c22a-4dd3-b354-88832724c5eb admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:26.500226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fda621-c22a-4dd3-b354-88832724c5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:26.500583 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fda621-c22a-4dd3-b354-88832724c5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:26.501426 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fda621-c22a-4dd3-b354-88832724c5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:26.503247 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fda621-c22a-4dd3-b354-88832724c5eb admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:26.519943 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9edbf-4f90-422a-a9d2-bc483c47f0e5 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:26.530504 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1219/2402] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:13:26.536646 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9edbf-4f90-422a-a9d2-bc483c47f0e5 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:26.544029 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689c90d-e395-4f27-8eca-9b1ad7b3d04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:26.544911 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689c90d-e395-4f27-8eca-9b1ad7b3d04e admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:26.545190 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689c90d-e395-4f27-8eca-9b1ad7b3d04e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:26.545460 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689c90d-e395-4f27-8eca-9b1ad7b3d04e admin admin] PATH_INFO: `/v3/projects/a588bdeff54343ac983aa1ccdd3e4480/users/9fe56e2f96394a7b93e9fb5295554bba/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:26.567497 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689c90d-e395-4f27-8eca-9b1ad7b3d04e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a588bdeff54343ac983aa1ccdd3e4480, user_id=9fe56e2f96394a7b93e9fb5295554bba, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:26.571517 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689c90d-e395-4f27-8eca-9b1ad7b3d04e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:26.648838 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1184/2403] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:13:26 2022] PUT /identity/v3/projects/a588bdeff54343ac983aa1ccdd3e4480/users/9fe56e2f96394a7b93e9fb5295554bba/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:13:26.654065 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6a95a-0797-42a2-8b15-2e789641ab6e None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:26.654527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6a95a-0797-42a2-8b15-2e789641ab6e None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:26.654974 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6a95a-0797-42a2-8b15-2e789641ab6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:26.680219 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-98a6a95a-0797-42a2-8b15-2e789641ab6e None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:13:26.682160 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-98a6a95a-0797-42a2-8b15-2e789641ab6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:26.779129 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1220/2404] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:13:26.789514 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689c90d-e395-4f27-8eca-9b1ad7b3d04e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:26.791445 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e689c90d-e395-4f27-8eca-9b1ad7b3d04e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:26.885206 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689c90d-e395-4f27-8eca-9b1ad7b3d04e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:26.890034 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526e311-8896-4521-9b28-32844e9cfa16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:26.890933 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526e311-8896-4521-9b28-32844e9cfa16 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:26.891444 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526e311-8896-4521-9b28-32844e9cfa16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:26.891848 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526e311-8896-4521-9b28-32844e9cfa16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:26.903284 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526e311-8896-4521-9b28-32844e9cfa16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:26.904837 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526e311-8896-4521-9b28-32844e9cfa16 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:26.919934 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1185/2405] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:13:28.354769 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54232afd-3db6-46b6-991c-ea573b4eb9d1 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:28.355260 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54232afd-3db6-46b6-991c-ea573b4eb9d1 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:28.355357 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54232afd-3db6-46b6-991c-ea573b4eb9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:28.395669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-54232afd-3db6-46b6-991c-ea573b4eb9d1 None None] MFA Rules not processed for user `9fe56e2f96394a7b93e9fb5295554bba`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:13:28.395669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-54232afd-3db6-46b6-991c-ea573b4eb9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:28.508222 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1221/2406] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:13:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:13:28.515025 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526e311-8896-4521-9b28-32844e9cfa16 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:28.517261 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-a526e311-8896-4521-9b28-32844e9cfa16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:28.637811 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526e311-8896-4521-9b28-32844e9cfa16 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:28.642088 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6c223-80e7-4364-80be-2e4171e66bcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:28.642827 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6c223-80e7-4364-80be-2e4171e66bcc service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:28.643288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6c223-80e7-4364-80be-2e4171e66bcc service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:28.643631 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6c223-80e7-4364-80be-2e4171e66bcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:28.652788 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6c223-80e7-4364-80be-2e4171e66bcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:28.654322 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6c223-80e7-4364-80be-2e4171e66bcc service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:28.666166 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1186/2407] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:13:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:13:31.668500 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c393fa2-922b-4108-9d4f-2ca0991f217e None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:31.669141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c393fa2-922b-4108-9d4f-2ca0991f217e None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:31.669309 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c393fa2-922b-4108-9d4f-2ca0991f217e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:31.690280 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-1c393fa2-922b-4108-9d4f-2ca0991f217e None None] MFA Rules not processed for user `9fe56e2f96394a7b93e9fb5295554bba`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:13:31.691495 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-1c393fa2-922b-4108-9d4f-2ca0991f217e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:31.713184 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1222/2408] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:13:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:13:40.514148 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5ccbd-10ef-4229-864c-a437adacd403 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:40.514730 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5ccbd-10ef-4229-864c-a437adacd403 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:40.514730 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5ccbd-10ef-4229-864c-a437adacd403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:40.532677 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-32a5ccbd-10ef-4229-864c-a437adacd403 None None] MFA Rules not processed for user `fa9ea7738c634318a532ebca2e564745`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:13:40.533872 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-32a5ccbd-10ef-4229-864c-a437adacd403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:40.592273 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1187/2409] 10.222.0.42 () {58 vars in 967 bytes} [Wed Feb 16 17:13:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:13:40.607369 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c393fa2-922b-4108-9d4f-2ca0991f217e None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:40.608801 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-1c393fa2-922b-4108-9d4f-2ca0991f217e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:40.676169 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c393fa2-922b-4108-9d4f-2ca0991f217e None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:40.681191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84736a84-25c8-418d-b220-03cda092b1b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc59cb98783b4353a405b8b9a3a9d592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:40.681828 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84736a84-25c8-418d-b220-03cda092b1b1 service swift] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:40.682106 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84736a84-25c8-418d-b220-03cda092b1b1 service swift] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:40.682374 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84736a84-25c8-418d-b220-03cda092b1b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:40.690363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84736a84-25c8-418d-b220-03cda092b1b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:40.692027 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84736a84-25c8-418d-b220-03cda092b1b1 service swift] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:40.700048 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1223/2410] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Feb 16 17:13:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 17:13:43.967805 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5ccbd-10ef-4229-864c-a437adacd403 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:43.969242 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-32a5ccbd-10ef-4229-864c-a437adacd403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:43.993152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5ccbd-10ef-4229-864c-a437adacd403 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:44.002316 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94c9f2-2a26-46d8-a612-c57ee5b0af1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:44.003241 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94c9f2-2a26-46d8-a612-c57ee5b0af1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:44.003524 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94c9f2-2a26-46d8-a612-c57ee5b0af1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:44.003797 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94c9f2-2a26-46d8-a612-c57ee5b0af1b admin admin] PATH_INFO: `/v3/users/c8a6e26ab37b4f9d9d438e7fa727802d` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:44.005020 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94c9f2-2a26-46d8-a612-c57ee5b0af1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8a6e26ab37b4f9d9d438e7fa727802d)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:44.007350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94c9f2-2a26-46d8-a612-c57ee5b0af1b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:44.191947 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-bf94c9f2-2a26-46d8-a612-c57ee5b0af1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8a6e26ab37b4f9d9d438e7fa727802d'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:44.192581 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-bf94c9f2-2a26-46d8-a612-c57ee5b0af1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8a6e26ab37b4f9d9d438e7fa727802d'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:44.203777 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-bf94c9f2-2a26-46d8-a612-c57ee5b0af1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8a6e26ab37b4f9d9d438e7fa727802d'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:44.210866 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-bf94c9f2-2a26-46d8-a612-c57ee5b0af1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8a6e26ab37b4f9d9d438e7fa727802d'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:44.287495 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-bf94c9f2-2a26-46d8-a612-c57ee5b0af1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8a6e26ab37b4f9d9d438e7fa727802d'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:44.294099 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1188/2411] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:13:43 2022] DELETE /identity/v3/users/c8a6e26ab37b4f9d9d438e7fa727802d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:13:44.581934 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84736a84-25c8-418d-b220-03cda092b1b1 service swift] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:44.600752 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84736a84-25c8-418d-b220-03cda092b1b1 service swift] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:44.652273 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5916ab3-a634-4cff-8749-3b8ee9139552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:44.653121 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5916ab3-a634-4cff-8749-3b8ee9139552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:44.653405 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5916ab3-a634-4cff-8749-3b8ee9139552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:44.653677 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5916ab3-a634-4cff-8749-3b8ee9139552 admin admin] PATH_INFO: `/v3/projects/6ca2d2f14f8c4639a8345e5dad4380f4` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:44.654894 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5916ab3-a634-4cff-8749-3b8ee9139552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ca2d2f14f8c4639a8345e5dad4380f4)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:44.656778 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5916ab3-a634-4cff-8749-3b8ee9139552 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:44.773387 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5916ab3-a634-4cff-8749-3b8ee9139552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ca2d2f14f8c4639a8345e5dad4380f4', 'request_id': 'req-b5916ab3-a634-4cff-8749-3b8ee9139552'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:44.846844 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5916ab3-a634-4cff-8749-3b8ee9139552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ca2d2f14f8c4639a8345e5dad4380f4', 'request_id': 'req-b5916ab3-a634-4cff-8749-3b8ee9139552'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:44.852925 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5916ab3-a634-4cff-8749-3b8ee9139552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ca2d2f14f8c4639a8345e5dad4380f4', 'request_id': 'req-b5916ab3-a634-4cff-8749-3b8ee9139552'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:44.864135 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5916ab3-a634-4cff-8749-3b8ee9139552 admin admin] The token cache is being invalidate because project 6ca2d2f14f8c4639a8345e5dad4380f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:13:44.864475 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5916ab3-a634-4cff-8749-3b8ee9139552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:44.865106 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5916ab3-a634-4cff-8749-3b8ee9139552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:44.866621 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1224/2412] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:13:44 2022] DELETE /identity/v3/projects/6ca2d2f14f8c4639a8345e5dad4380f4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:13:44.871792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e85a3-5d7c-48f7-b70d-075d9bea86e1 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:44.872081 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e85a3-5d7c-48f7-b70d-075d9bea86e1 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:44.872359 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e85a3-5d7c-48f7-b70d-075d9bea86e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:44.891054 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-c96e85a3-5d7c-48f7-b70d-075d9bea86e1 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:13:44.892233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-c96e85a3-5d7c-48f7-b70d-075d9bea86e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:44.949884 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1189/2413] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:13:44.957677 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b472a7a-aef9-4b7f-b94b-8ae997c17f6f None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:44.958111 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b472a7a-aef9-4b7f-b94b-8ae997c17f6f None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:44.959151 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b472a7a-aef9-4b7f-b94b-8ae997c17f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:44.980079 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-0b472a7a-aef9-4b7f-b94b-8ae997c17f6f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:13:44.981276 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0b472a7a-aef9-4b7f-b94b-8ae997c17f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:44.989717 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1225/2414] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:13:44.994286 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e85a3-5d7c-48f7-b70d-075d9bea86e1 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:45.005665 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e85a3-5d7c-48f7-b70d-075d9bea86e1 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:45.010445 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be479c-8da1-4811-80e4-827626dc5283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:45.011155 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be479c-8da1-4811-80e4-827626dc5283 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:45.011532 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be479c-8da1-4811-80e4-827626dc5283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:45.011689 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be479c-8da1-4811-80e4-827626dc5283 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:45.012471 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be479c-8da1-4811-80e4-827626dc5283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:13:45.012779 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be479c-8da1-4811-80e4-827626dc5283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:45.014381 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be479c-8da1-4811-80e4-827626dc5283 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:45.026952 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1190/2415] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:13:45.030995 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b472a7a-aef9-4b7f-b94b-8ae997c17f6f None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:45.040304 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b472a7a-aef9-4b7f-b94b-8ae997c17f6f None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:45.044890 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2b322-bf8e-43ba-8822-4e523e684a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:45.045541 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2b322-bf8e-43ba-8822-4e523e684a4e admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:45.045804 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2b322-bf8e-43ba-8822-4e523e684a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:45.046074 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2b322-bf8e-43ba-8822-4e523e684a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:45.046857 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2b322-bf8e-43ba-8822-4e523e684a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:45.048716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2b322-bf8e-43ba-8822-4e523e684a4e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:45.157125 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1226/2416] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:13:45 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:13:45.161362 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be479c-8da1-4811-80e4-827626dc5283 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:45.171356 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be479c-8da1-4811-80e4-827626dc5283 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:45.226902 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6d630-8fe6-413d-bdc8-90637d23e0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:45.227586 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6d630-8fe6-413d-bdc8-90637d23e0fb admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:45.227876 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6d630-8fe6-413d-bdc8-90637d23e0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:45.228153 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6d630-8fe6-413d-bdc8-90637d23e0fb admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:45.228845 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6d630-8fe6-413d-bdc8-90637d23e0fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:45.230806 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6d630-8fe6-413d-bdc8-90637d23e0fb admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:45.378864 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1191/2417] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:13:45 2022] POST /identity/v3/users => generated 291 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:13:45.383075 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2b322-bf8e-43ba-8822-4e523e684a4e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:45.393160 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2b322-bf8e-43ba-8822-4e523e684a4e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:45.397779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305454d3-427c-475c-babd-fb3a7a6f30d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:45.398424 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305454d3-427c-475c-babd-fb3a7a6f30d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:45.398753 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305454d3-427c-475c-babd-fb3a7a6f30d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:45.399019 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305454d3-427c-475c-babd-fb3a7a6f30d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:45.399727 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305454d3-427c-475c-babd-fb3a7a6f30d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:45.401301 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305454d3-427c-475c-babd-fb3a7a6f30d1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:45.412091 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1227/2418] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:13:45.416106 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6d630-8fe6-413d-bdc8-90637d23e0fb admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:45.427709 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6d630-8fe6-413d-bdc8-90637d23e0fb admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:45.432567 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33776f18-af5d-4a66-9c07-303b9c30a15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:45.433318 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33776f18-af5d-4a66-9c07-303b9c30a15f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:45.433604 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33776f18-af5d-4a66-9c07-303b9c30a15f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:45.433937 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33776f18-af5d-4a66-9c07-303b9c30a15f admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:45.434609 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33776f18-af5d-4a66-9c07-303b9c30a15f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:45.436206 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33776f18-af5d-4a66-9c07-303b9c30a15f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:45.447474 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1192/2419] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:13:45.451386 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305454d3-427c-475c-babd-fb3a7a6f30d1 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:45.461464 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305454d3-427c-475c-babd-fb3a7a6f30d1 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:45.466069 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16862d3c-e257-47e3-861e-ab33d83e8648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:45.466980 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16862d3c-e257-47e3-861e-ab33d83e8648 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:45.467257 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16862d3c-e257-47e3-861e-ab33d83e8648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:45.467528 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16862d3c-e257-47e3-861e-ab33d83e8648 admin admin] PATH_INFO: `/v3/projects/79e09590590243eca4d6024e2a90bff3/users/45434fb2f0684c27b1672ef9db04f44f/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:45.488342 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16862d3c-e257-47e3-861e-ab33d83e8648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e09590590243eca4d6024e2a90bff3, user_id=45434fb2f0684c27b1672ef9db04f44f, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:45.491855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16862d3c-e257-47e3-861e-ab33d83e8648 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:45.665700 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1228/2420] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:13:45 2022] PUT /identity/v3/projects/79e09590590243eca4d6024e2a90bff3/users/45434fb2f0684c27b1672ef9db04f44f/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:13:45.675707 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d118a48-e509-43ac-905e-bc02fc47c78c None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:45.675995 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d118a48-e509-43ac-905e-bc02fc47c78c None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:45.676267 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d118a48-e509-43ac-905e-bc02fc47c78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:45.711830 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-8d118a48-e509-43ac-905e-bc02fc47c78c None None] MFA Rules not processed for user `45434fb2f0684c27b1672ef9db04f44f`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:13:45.713679 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-8d118a48-e509-43ac-905e-bc02fc47c78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:45.787244 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1193/2421] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:13:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:13:45.798087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16862d3c-e257-47e3-861e-ab33d83e8648 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:45.800014 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-16862d3c-e257-47e3-861e-ab33d83e8648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:45.868540 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16862d3c-e257-47e3-861e-ab33d83e8648 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:45.872285 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24342132-347a-4ad3-8781-1eb8ce268f10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:45.872919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24342132-347a-4ad3-8781-1eb8ce268f10 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:45.873196 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24342132-347a-4ad3-8781-1eb8ce268f10 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:45.873464 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24342132-347a-4ad3-8781-1eb8ce268f10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:45.883093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24342132-347a-4ad3-8781-1eb8ce268f10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:45.884499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24342132-347a-4ad3-8781-1eb8ce268f10 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:45.893025 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1229/2422] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:13:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:13:49.940269 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71ace1-cbde-4db4-8ce4-afac1c93bf45 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:49.940741 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71ace1-cbde-4db4-8ce4-afac1c93bf45 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:49.940834 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71ace1-cbde-4db4-8ce4-afac1c93bf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:49.962554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-6b71ace1-cbde-4db4-8ce4-afac1c93bf45 None None] MFA Rules not processed for user `fa9ea7738c634318a532ebca2e564745`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:13:49.963798 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6b71ace1-cbde-4db4-8ce4-afac1c93bf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:50.024172 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1194/2423] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Feb 16 17:13:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:13:50.036716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24342132-347a-4ad3-8781-1eb8ce268f10 service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:50.038147 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-24342132-347a-4ad3-8781-1eb8ce268f10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:50.068912 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71ace1-cbde-4db4-8ce4-afac1c93bf45 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:50.112379 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24342132-347a-4ad3-8781-1eb8ce268f10 service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:50.117663 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83007435-24e9-4869-95c0-39e7b361c85d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc59cb98783b4353a405b8b9a3a9d592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:50.120818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83007435-24e9-4869-95c0-39e7b361c85d service swift] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:50.120818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83007435-24e9-4869-95c0-39e7b361c85d service swift] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:50.120818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83007435-24e9-4869-95c0-39e7b361c85d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:50.127370 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83007435-24e9-4869-95c0-39e7b361c85d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:50.128917 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83007435-24e9-4869-95c0-39e7b361c85d service swift] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:50.132562 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71ace1-cbde-4db4-8ce4-afac1c93bf45 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:50.138134 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1230/2424] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Feb 16 17:13:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 17:13:50.138303 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a893c6-ea17-4d6c-9586-ce1430445830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:50.139183 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a893c6-ea17-4d6c-9586-ce1430445830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:50.139534 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a893c6-ea17-4d6c-9586-ce1430445830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:50.139943 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a893c6-ea17-4d6c-9586-ce1430445830 admin admin] PATH_INFO: `/v3/users/45434fb2f0684c27b1672ef9db04f44f` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:50.141136 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a893c6-ea17-4d6c-9586-ce1430445830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45434fb2f0684c27b1672ef9db04f44f)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:50.142953 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a893c6-ea17-4d6c-9586-ce1430445830 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:50.386472 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d8a893c6-ea17-4d6c-9586-ce1430445830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45434fb2f0684c27b1672ef9db04f44f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:50.387773 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d8a893c6-ea17-4d6c-9586-ce1430445830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45434fb2f0684c27b1672ef9db04f44f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:50.417510 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d8a893c6-ea17-4d6c-9586-ce1430445830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45434fb2f0684c27b1672ef9db04f44f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:50.427876 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d8a893c6-ea17-4d6c-9586-ce1430445830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45434fb2f0684c27b1672ef9db04f44f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:50.509524 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d8a893c6-ea17-4d6c-9586-ce1430445830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45434fb2f0684c27b1672ef9db04f44f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:50.519756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1195/2425] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:13:50 2022] DELETE /identity/v3/users/45434fb2f0684c27b1672ef9db04f44f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:13:50.522178 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45095f7a-a987-4d45-a5ae-54bdb8056ac1 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:50.522898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45095f7a-a987-4d45-a5ae-54bdb8056ac1 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:50.522898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45095f7a-a987-4d45-a5ae-54bdb8056ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:50.564214 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-45095f7a-a987-4d45-a5ae-54bdb8056ac1 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:13:50.565561 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-45095f7a-a987-4d45-a5ae-54bdb8056ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:50.710801 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1231/2426] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:13:50.720734 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a893c6-ea17-4d6c-9586-ce1430445830 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:50.722868 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d8a893c6-ea17-4d6c-9586-ce1430445830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:50.810732 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a893c6-ea17-4d6c-9586-ce1430445830 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:50.824431 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa8033-0e75-42a5-9a29-0166e031488a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:50.825121 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa8033-0e75-42a5-9a29-0166e031488a service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:50.825367 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa8033-0e75-42a5-9a29-0166e031488a service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:50.825631 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa8033-0e75-42a5-9a29-0166e031488a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:50.838236 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa8033-0e75-42a5-9a29-0166e031488a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:50.840272 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa8033-0e75-42a5-9a29-0166e031488a service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:50.852487 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1196/2427] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:13:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:13:51.626901 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45095f7a-a987-4d45-a5ae-54bdb8056ac1 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:51.629180 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-45095f7a-a987-4d45-a5ae-54bdb8056ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:51.659718 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45095f7a-a987-4d45-a5ae-54bdb8056ac1 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:51.670311 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05d9dc-1323-4939-8c16-85c99c324816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:51.671927 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05d9dc-1323-4939-8c16-85c99c324816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:51.672434 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05d9dc-1323-4939-8c16-85c99c324816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:51.672927 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05d9dc-1323-4939-8c16-85c99c324816 admin admin] PATH_INFO: `/v3/projects/79e09590590243eca4d6024e2a90bff3` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:51.674960 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05d9dc-1323-4939-8c16-85c99c324816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79e09590590243eca4d6024e2a90bff3)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:51.677891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05d9dc-1323-4939-8c16-85c99c324816 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:51.831160 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-bd05d9dc-1323-4939-8c16-85c99c324816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79e09590590243eca4d6024e2a90bff3', 'request_id': 'req-bd05d9dc-1323-4939-8c16-85c99c324816'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:51.932876 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-bd05d9dc-1323-4939-8c16-85c99c324816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79e09590590243eca4d6024e2a90bff3', 'request_id': 'req-bd05d9dc-1323-4939-8c16-85c99c324816'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:51.939798 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-bd05d9dc-1323-4939-8c16-85c99c324816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79e09590590243eca4d6024e2a90bff3', 'request_id': 'req-bd05d9dc-1323-4939-8c16-85c99c324816'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:51.970786 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-bd05d9dc-1323-4939-8c16-85c99c324816 admin admin] The token cache is being invalidate because project 79e09590590243eca4d6024e2a90bff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:13:51.971078 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-bd05d9dc-1323-4939-8c16-85c99c324816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:51.973352 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-bd05d9dc-1323-4939-8c16-85c99c324816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:51.980164 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1232/2428] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:13:51 2022] DELETE /identity/v3/projects/79e09590590243eca4d6024e2a90bff3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:13:51.981671 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fb20d-4cbc-434b-97da-5f40d7767ac7 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:51.982119 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fb20d-4cbc-434b-97da-5f40d7767ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:51.982261 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fb20d-4cbc-434b-97da-5f40d7767ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:52.026292 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-e41fb20d-4cbc-434b-97da-5f40d7767ac7 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:13:52.027967 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e41fb20d-4cbc-434b-97da-5f40d7767ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:52.151415 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1197/2429] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:13:52.153467 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767814b-7f01-4b13-9f82-cc3dce5c98a2 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:52.154263 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767814b-7f01-4b13-9f82-cc3dce5c98a2 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:52.154587 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767814b-7f01-4b13-9f82-cc3dce5c98a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:52.176395 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-b767814b-7f01-4b13-9f82-cc3dce5c98a2 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:13:52.178238 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-b767814b-7f01-4b13-9f82-cc3dce5c98a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:52.195976 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1233/2430] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:13:52.196651 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fb20d-4cbc-434b-97da-5f40d7767ac7 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:52.207208 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fb20d-4cbc-434b-97da-5f40d7767ac7 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:52.212858 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141ee65-fba2-4482-9961-cba6680fc0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:52.213531 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141ee65-fba2-4482-9961-cba6680fc0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:52.213813 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141ee65-fba2-4482-9961-cba6680fc0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:52.214090 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141ee65-fba2-4482-9961-cba6680fc0f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:52.215565 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141ee65-fba2-4482-9961-cba6680fc0f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:13:52.215997 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141ee65-fba2-4482-9961-cba6680fc0f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:52.217633 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141ee65-fba2-4482-9961-cba6680fc0f9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:52.233245 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1198/2431] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:13:52.242382 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767814b-7f01-4b13-9f82-cc3dce5c98a2 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:52.252495 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767814b-7f01-4b13-9f82-cc3dce5c98a2 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:52.259045 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f837ff-06e0-44d6-a5a9-c57b69988005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:52.259714 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f837ff-06e0-44d6-a5a9-c57b69988005 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:52.259989 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f837ff-06e0-44d6-a5a9-c57b69988005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:52.260442 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f837ff-06e0-44d6-a5a9-c57b69988005 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:52.261299 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f837ff-06e0-44d6-a5a9-c57b69988005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:52.265803 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f837ff-06e0-44d6-a5a9-c57b69988005 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:52.375322 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1234/2432] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:13:52 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:13:52.379734 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141ee65-fba2-4482-9961-cba6680fc0f9 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:52.392088 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141ee65-fba2-4482-9961-cba6680fc0f9 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:52.489300 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce916b2d-11ac-4a1f-b030-0ae9766b4260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:52.490071 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce916b2d-11ac-4a1f-b030-0ae9766b4260 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:52.490370 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce916b2d-11ac-4a1f-b030-0ae9766b4260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:52.490664 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce916b2d-11ac-4a1f-b030-0ae9766b4260 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:52.491456 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce916b2d-11ac-4a1f-b030-0ae9766b4260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:52.493619 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce916b2d-11ac-4a1f-b030-0ae9766b4260 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:52.733666 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1199/2433] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:13:52 2022] POST /identity/v3/users => generated 286 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:13:52.738227 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f837ff-06e0-44d6-a5a9-c57b69988005 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:52.756535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f837ff-06e0-44d6-a5a9-c57b69988005 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:52.762450 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc739e8-6a2e-4181-9f36-9edbcfda203c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:52.763390 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc739e8-6a2e-4181-9f36-9edbcfda203c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:52.769195 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc739e8-6a2e-4181-9f36-9edbcfda203c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:52.769195 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc739e8-6a2e-4181-9f36-9edbcfda203c admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:52.769195 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc739e8-6a2e-4181-9f36-9edbcfda203c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:52.769195 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc739e8-6a2e-4181-9f36-9edbcfda203c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:52.796535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1235/2434] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:13:52.800586 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce916b2d-11ac-4a1f-b030-0ae9766b4260 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:52.813198 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce916b2d-11ac-4a1f-b030-0ae9766b4260 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:52.819682 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e91ba2-cd2d-4a03-be45-9fdad6a5ce48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:52.823415 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e91ba2-cd2d-4a03-be45-9fdad6a5ce48 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:52.823415 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e91ba2-cd2d-4a03-be45-9fdad6a5ce48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:52.823415 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e91ba2-cd2d-4a03-be45-9fdad6a5ce48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:52.823415 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e91ba2-cd2d-4a03-be45-9fdad6a5ce48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:52.836888 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e91ba2-cd2d-4a03-be45-9fdad6a5ce48 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:52.862335 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc739e8-6a2e-4181-9f36-9edbcfda203c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:52.872329 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1200/2435] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:13:52.874852 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc739e8-6a2e-4181-9f36-9edbcfda203c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:52.881373 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67330cab-24d6-477f-8d50-44e8c7487f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:52.882758 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67330cab-24d6-477f-8d50-44e8c7487f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:52.883244 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67330cab-24d6-477f-8d50-44e8c7487f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:52.883708 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67330cab-24d6-477f-8d50-44e8c7487f43 admin admin] PATH_INFO: `/v3/projects/30b401fc4efb4cacb5f18ef8ec0f23d8/users/28f763c7b5c148949528f958a63d685b/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:52.903134 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67330cab-24d6-477f-8d50-44e8c7487f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b401fc4efb4cacb5f18ef8ec0f23d8, user_id=28f763c7b5c148949528f958a63d685b, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:52.907721 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67330cab-24d6-477f-8d50-44e8c7487f43 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:53.094878 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714a317-d436-4e00-9df6-b890c4b578e4 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:53.095962 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714a317-d436-4e00-9df6-b890c4b578e4 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:53.096442 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714a317-d436-4e00-9df6-b890c4b578e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:53.101163 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1236/2436] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:13:52 2022] PUT /identity/v3/projects/30b401fc4efb4cacb5f18ef8ec0f23d8/users/28f763c7b5c148949528f958a63d685b/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:13:53.141569 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-1714a317-d436-4e00-9df6-b890c4b578e4 None None] MFA Rules not processed for user `28f763c7b5c148949528f958a63d685b`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:13:53.143108 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-1714a317-d436-4e00-9df6-b890c4b578e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:53.250722 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1201/2437] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:13:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:13:53.261550 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67330cab-24d6-477f-8d50-44e8c7487f43 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:53.265051 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-67330cab-24d6-477f-8d50-44e8c7487f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:53.424774 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67330cab-24d6-477f-8d50-44e8c7487f43 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:53.429292 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c3e03-5593-4417-8580-ec3b8f834432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:53.430057 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c3e03-5593-4417-8580-ec3b8f834432 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:53.430411 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c3e03-5593-4417-8580-ec3b8f834432 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:53.430796 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c3e03-5593-4417-8580-ec3b8f834432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:53.440406 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c3e03-5593-4417-8580-ec3b8f834432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:53.441924 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c3e03-5593-4417-8580-ec3b8f834432 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:53.471052 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1237/2438] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:13:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:13:53.487452 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714a317-d436-4e00-9df6-b890c4b578e4 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:53.586731 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714a317-d436-4e00-9df6-b890c4b578e4 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:53.595386 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93aebc-9870-4fbb-9177-edcabb45fb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:53.596417 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93aebc-9870-4fbb-9177-edcabb45fb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:53.596705 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93aebc-9870-4fbb-9177-edcabb45fb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:53.596983 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93aebc-9870-4fbb-9177-edcabb45fb92 admin admin] PATH_INFO: `/v3/users/28f763c7b5c148949528f958a63d685b` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:53.598474 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93aebc-9870-4fbb-9177-edcabb45fb92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28f763c7b5c148949528f958a63d685b)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:53.601678 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93aebc-9870-4fbb-9177-edcabb45fb92 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:53.806471 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-da93aebc-9870-4fbb-9177-edcabb45fb92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28f763c7b5c148949528f958a63d685b'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:53.807424 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-da93aebc-9870-4fbb-9177-edcabb45fb92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28f763c7b5c148949528f958a63d685b'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:53.820947 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-da93aebc-9870-4fbb-9177-edcabb45fb92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28f763c7b5c148949528f958a63d685b'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:53.828177 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-da93aebc-9870-4fbb-9177-edcabb45fb92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28f763c7b5c148949528f958a63d685b'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:54.008348 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-da93aebc-9870-4fbb-9177-edcabb45fb92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28f763c7b5c148949528f958a63d685b'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:54.016891 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1202/2439] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:13:53 2022] DELETE /identity/v3/users/28f763c7b5c148949528f958a63d685b => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:13:54.022686 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df5f81-759f-4f2c-a7d1-90b2b61d5518 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:54.026990 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df5f81-759f-4f2c-a7d1-90b2b61d5518 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:54.029194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df5f81-759f-4f2c-a7d1-90b2b61d5518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:54.046337 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-23df5f81-759f-4f2c-a7d1-90b2b61d5518 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:13:54.047666 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-23df5f81-759f-4f2c-a7d1-90b2b61d5518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:54.120561 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1238/2440] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:13:54.130798 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93aebc-9870-4fbb-9177-edcabb45fb92 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:54.134108 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-da93aebc-9870-4fbb-9177-edcabb45fb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:54.204191 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93aebc-9870-4fbb-9177-edcabb45fb92 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:54.209211 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40bd31-dc95-4d67-836b-ec7ed1eb770c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:54.209864 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40bd31-dc95-4d67-836b-ec7ed1eb770c service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:54.210142 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40bd31-dc95-4d67-836b-ec7ed1eb770c service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:54.210448 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40bd31-dc95-4d67-836b-ec7ed1eb770c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:54.220447 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40bd31-dc95-4d67-836b-ec7ed1eb770c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:54.222011 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40bd31-dc95-4d67-836b-ec7ed1eb770c service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:54.233238 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1203/2441] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:13:54.775442 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df5f81-759f-4f2c-a7d1-90b2b61d5518 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:13:54.777719 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-23df5f81-759f-4f2c-a7d1-90b2b61d5518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:13:54.798762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df5f81-759f-4f2c-a7d1-90b2b61d5518 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:13:54.807407 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd83c0f-779d-4250-baa7-d04dd3c896d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:13:54.808429 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd83c0f-779d-4250-baa7-d04dd3c896d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:13:54.808600 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd83c0f-779d-4250-baa7-d04dd3c896d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:13:54.808897 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd83c0f-779d-4250-baa7-d04dd3c896d9 admin admin] PATH_INFO: `/v3/projects/30b401fc4efb4cacb5f18ef8ec0f23d8` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:13:54.810065 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd83c0f-779d-4250-baa7-d04dd3c896d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b401fc4efb4cacb5f18ef8ec0f23d8)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:13:54.811996 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd83c0f-779d-4250-baa7-d04dd3c896d9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:13:54.938054 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-7cd83c0f-779d-4250-baa7-d04dd3c896d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b401fc4efb4cacb5f18ef8ec0f23d8', 'request_id': 'req-7cd83c0f-779d-4250-baa7-d04dd3c896d9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:55.024114 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-7cd83c0f-779d-4250-baa7-d04dd3c896d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b401fc4efb4cacb5f18ef8ec0f23d8', 'request_id': 'req-7cd83c0f-779d-4250-baa7-d04dd3c896d9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:55.030877 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-7cd83c0f-779d-4250-baa7-d04dd3c896d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b401fc4efb4cacb5f18ef8ec0f23d8', 'request_id': 'req-7cd83c0f-779d-4250-baa7-d04dd3c896d9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:55.044409 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-7cd83c0f-779d-4250-baa7-d04dd3c896d9 admin admin] The token cache is being invalidate because project 30b401fc4efb4cacb5f18ef8ec0f23d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:13:55.045211 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-7cd83c0f-779d-4250-baa7-d04dd3c896d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:55.046184 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-7cd83c0f-779d-4250-baa7-d04dd3c896d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:13:55.063310 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1239/2442] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:13:54 2022] DELETE /identity/v3/projects/30b401fc4efb4cacb5f18ef8ec0f23d8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:14:09.734585 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39672bc6-4411-4573-9a7a-c0b0505c305b None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:09.735231 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39672bc6-4411-4573-9a7a-c0b0505c305b None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:09.735231 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39672bc6-4411-4573-9a7a-c0b0505c305b None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:09.736975 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1204/2443] 10.222.0.42 () {54 vars in 921 bytes} [Wed Feb 16 17:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:14:09.743286 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71578146-cd60-45dd-860f-0dc29980c839 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:09.743764 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71578146-cd60-45dd-860f-0dc29980c839 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:09.743984 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71578146-cd60-45dd-860f-0dc29980c839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:09.794978 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-71578146-cd60-45dd-860f-0dc29980c839 None None] MFA Rules not processed for user `9a30603a236e4681a7702eec7029e9db`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:14:09.796159 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-71578146-cd60-45dd-860f-0dc29980c839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:09.868855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1240/2444] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Feb 16 17:14:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:14:09.881386 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39672bc6-4411-4573-9a7a-c0b0505c305b None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:14:09.883103 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-39672bc6-4411-4573-9a7a-c0b0505c305b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:09.959043 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39672bc6-4411-4573-9a7a-c0b0505c305b None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:14:09.962595 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc8b28-2b37-45dd-ae92-fd64d0cc934b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b2c52a60aa499e82129ef29f8907ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:14:09.963250 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc8b28-2b37-45dd-ae92-fd64d0cc934b service glance] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:09.963529 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc8b28-2b37-45dd-ae92-fd64d0cc934b service glance] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:09.963801 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc8b28-2b37-45dd-ae92-fd64d0cc934b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:09.974147 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc8b28-2b37-45dd-ae92-fd64d0cc934b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:14:09.975745 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc8b28-2b37-45dd-ae92-fd64d0cc934b service glance] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:14:09.986100 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1205/2445] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:14:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:14:10.180812 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3325bf-2a67-484a-b2c6-03bf2b9c301c None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:10.181098 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3325bf-2a67-484a-b2c6-03bf2b9c301c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:10.181375 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3325bf-2a67-484a-b2c6-03bf2b9c301c None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:10.183282 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1241/2446] 10.222.0.42 () {54 vars in 921 bytes} [Wed Feb 16 17:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:14:10.188571 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a971f-500b-4f8b-bb49-c8b15757a12f None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:10.188923 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a971f-500b-4f8b-bb49-c8b15757a12f None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:10.189139 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a971f-500b-4f8b-bb49-c8b15757a12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:10.209925 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-da0a971f-500b-4f8b-bb49-c8b15757a12f None None] MFA Rules not processed for user `f6db9534cc094e8281b0aa34e2cb4b46`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:14:10.211145 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-da0a971f-500b-4f8b-bb49-c8b15757a12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:10.261007 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1206/2447] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Feb 16 17:14:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:14:10.273522 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3325bf-2a67-484a-b2c6-03bf2b9c301c None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:14:10.275247 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-4f3325bf-2a67-484a-b2c6-03bf2b9c301c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:10.288132 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3325bf-2a67-484a-b2c6-03bf2b9c301c None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:14:10.291651 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da513a61-90bb-47a1-96f7-dcb5df557bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:14:10.292274 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da513a61-90bb-47a1-96f7-dcb5df557bfa service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:10.292554 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da513a61-90bb-47a1-96f7-dcb5df557bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:10.292829 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da513a61-90bb-47a1-96f7-dcb5df557bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:10.299780 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da513a61-90bb-47a1-96f7-dcb5df557bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:14:10.301179 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da513a61-90bb-47a1-96f7-dcb5df557bfa service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:14:10.308851 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1242/2448] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:14:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:14:10.396848 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f1a1e-edf7-43c3-8c86-7b35090bf9a1 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:10.397139 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f1a1e-edf7-43c3-8c86-7b35090bf9a1 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:10.397418 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f1a1e-edf7-43c3-8c86-7b35090bf9a1 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:10.399223 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1207/2449] 10.222.0.42 () {54 vars in 921 bytes} [Wed Feb 16 17:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:14:10.404373 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd53932-fbb0-45ca-9952-5bfcaf7a046a None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:10.404747 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd53932-fbb0-45ca-9952-5bfcaf7a046a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:10.404942 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd53932-fbb0-45ca-9952-5bfcaf7a046a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:10.424317 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-9dd53932-fbb0-45ca-9952-5bfcaf7a046a None None] MFA Rules not processed for user `9a30603a236e4681a7702eec7029e9db`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:14:10.425532 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-9dd53932-fbb0-45ca-9952-5bfcaf7a046a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:10.435814 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1243/2450] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Feb 16 17:14:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:14:10.446211 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f1a1e-edf7-43c3-8c86-7b35090bf9a1 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:14:10.457067 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f1a1e-edf7-43c3-8c86-7b35090bf9a1 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:14:10.461265 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377f6b9-e259-400f-9e47-ec8d8dffad2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:14:10.461887 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377f6b9-e259-400f-9e47-ec8d8dffad2c service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:10.462217 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377f6b9-e259-400f-9e47-ec8d8dffad2c service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:10.462493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377f6b9-e259-400f-9e47-ec8d8dffad2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:10.472680 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377f6b9-e259-400f-9e47-ec8d8dffad2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:14:10.474767 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377f6b9-e259-400f-9e47-ec8d8dffad2c service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:14:10.485428 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1208/2451] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:14:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:14:14.235995 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d37dc-70ff-4a0f-aef1-08ef668de7b2 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:14.236483 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d37dc-70ff-4a0f-aef1-08ef668de7b2 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:14.236582 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d37dc-70ff-4a0f-aef1-08ef668de7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:14.256068 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-c73d37dc-70ff-4a0f-aef1-08ef668de7b2 None None] MFA Rules not processed for user `fa9ea7738c634318a532ebca2e564745`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:14:14.257252 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-c73d37dc-70ff-4a0f-aef1-08ef668de7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:14.308861 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1244/2452] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Feb 16 17:14:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:14:14.321842 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377f6b9-e259-400f-9e47-ec8d8dffad2c service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:14:14.323222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-0377f6b9-e259-400f-9e47-ec8d8dffad2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:14.390093 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377f6b9-e259-400f-9e47-ec8d8dffad2c service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:14:14.395167 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3469a-466b-48e0-8060-6ea80ad4042b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc59cb98783b4353a405b8b9a3a9d592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:14:14.395871 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3469a-466b-48e0-8060-6ea80ad4042b service swift] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:14.396173 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3469a-466b-48e0-8060-6ea80ad4042b service swift] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:14.396443 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3469a-466b-48e0-8060-6ea80ad4042b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:14.404743 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3469a-466b-48e0-8060-6ea80ad4042b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:14:14.406306 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3469a-466b-48e0-8060-6ea80ad4042b service swift] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:14:14.414328 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1209/2453] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Feb 16 17:14:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 17:14:36.960050 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d37dc-70ff-4a0f-aef1-08ef668de7b2 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:14:36.971302 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d37dc-70ff-4a0f-aef1-08ef668de7b2 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:14:36.975726 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84f03a-b8e7-476b-9de1-ef273fbbf0b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:14:36.976467 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84f03a-b8e7-476b-9de1-ef273fbbf0b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:36.976956 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84f03a-b8e7-476b-9de1-ef273fbbf0b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:36.977463 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84f03a-b8e7-476b-9de1-ef273fbbf0b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:36.980176 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-de84f03a-b8e7-476b-9de1-ef273fbbf0b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:36.999627 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84f03a-b8e7-476b-9de1-ef273fbbf0b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:14:37.001197 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84f03a-b8e7-476b-9de1-ef273fbbf0b0 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:14:37.013839 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1245/2454] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:14:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:14:37.315490 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3469a-466b-48e0-8060-6ea80ad4042b service swift] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:14:37.317010 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-9af3469a-466b-48e0-8060-6ea80ad4042b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:37.382971 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3469a-466b-48e0-8060-6ea80ad4042b service swift] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:14:37.387541 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3203cb3-27c9-4ea2-ba03-039d60a33af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:14:37.388392 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3203cb3-27c9-4ea2-ba03-039d60a33af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:37.388666 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3203cb3-27c9-4ea2-ba03-039d60a33af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:37.388935 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3203cb3-27c9-4ea2-ba03-039d60a33af9 admin admin] PATH_INFO: `/v3/users/5802e711ef624ead8e35e3fce3455f8c` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:37.390110 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3203cb3-27c9-4ea2-ba03-039d60a33af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5802e711ef624ead8e35e3fce3455f8c)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:14:37.392067 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3203cb3-27c9-4ea2-ba03-039d60a33af9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:14:37.631347 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a3203cb3-27c9-4ea2-ba03-039d60a33af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5802e711ef624ead8e35e3fce3455f8c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:14:37.632004 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a3203cb3-27c9-4ea2-ba03-039d60a33af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5802e711ef624ead8e35e3fce3455f8c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:14:37.643145 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a3203cb3-27c9-4ea2-ba03-039d60a33af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5802e711ef624ead8e35e3fce3455f8c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:14:37.649949 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a3203cb3-27c9-4ea2-ba03-039d60a33af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5802e711ef624ead8e35e3fce3455f8c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:14:37.731495 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a3203cb3-27c9-4ea2-ba03-039d60a33af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5802e711ef624ead8e35e3fce3455f8c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:14:37.738806 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1210/2455] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:14:37 2022] DELETE /identity/v3/users/5802e711ef624ead8e35e3fce3455f8c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:14:38.018899 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84f03a-b8e7-476b-9de1-ef273fbbf0b0 service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:14:38.030188 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84f03a-b8e7-476b-9de1-ef273fbbf0b0 service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:14:38.087279 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a28535-bde3-4a3b-9473-d826fd5fadf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:14:38.088130 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a28535-bde3-4a3b-9473-d826fd5fadf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:38.088409 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a28535-bde3-4a3b-9473-d826fd5fadf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:38.088682 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a28535-bde3-4a3b-9473-d826fd5fadf5 admin admin] PATH_INFO: `/v3/projects/7a140809764f4e2486fbf1776ed9c33c` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:38.089860 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a28535-bde3-4a3b-9473-d826fd5fadf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a140809764f4e2486fbf1776ed9c33c)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:14:38.091804 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a28535-bde3-4a3b-9473-d826fd5fadf5 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:14:38.200145 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3203cb3-27c9-4ea2-ba03-039d60a33af9 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:14:38.201531 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-a3203cb3-27c9-4ea2-ba03-039d60a33af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:38.229462 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-57a28535-bde3-4a3b-9473-d826fd5fadf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a140809764f4e2486fbf1776ed9c33c', 'request_id': 'req-57a28535-bde3-4a3b-9473-d826fd5fadf5'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:14:38.259060 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3203cb3-27c9-4ea2-ba03-039d60a33af9 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:14:38.310118 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee15cff-89a1-4283-9747-c054eb66da40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:14:38.311157 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee15cff-89a1-4283-9747-c054eb66da40 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:38.311298 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee15cff-89a1-4283-9747-c054eb66da40 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:38.311565 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee15cff-89a1-4283-9747-c054eb66da40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:38.313659 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-7ee15cff-89a1-4283-9747-c054eb66da40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:38.330076 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-57a28535-bde3-4a3b-9473-d826fd5fadf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a140809764f4e2486fbf1776ed9c33c', 'request_id': 'req-57a28535-bde3-4a3b-9473-d826fd5fadf5'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:14:38.336905 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-57a28535-bde3-4a3b-9473-d826fd5fadf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a140809764f4e2486fbf1776ed9c33c', 'request_id': 'req-57a28535-bde3-4a3b-9473-d826fd5fadf5'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:14:38.348571 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-57a28535-bde3-4a3b-9473-d826fd5fadf5 admin admin] The token cache is being invalidate because project 7a140809764f4e2486fbf1776ed9c33c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:14:38.348859 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-57a28535-bde3-4a3b-9473-d826fd5fadf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:14:38.349541 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-57a28535-bde3-4a3b-9473-d826fd5fadf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:14:38.351408 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1246/2456] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:14:38 2022] DELETE /identity/v3/projects/7a140809764f4e2486fbf1776ed9c33c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:14:38.356276 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b88d6-3041-4b77-8653-85ccbd0dbf99 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:38.356657 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b88d6-3041-4b77-8653-85ccbd0dbf99 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:38.357002 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b88d6-3041-4b77-8653-85ccbd0dbf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:38.375933 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-7b2b88d6-3041-4b77-8653-85ccbd0dbf99 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:14:38.377133 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-7b2b88d6-3041-4b77-8653-85ccbd0dbf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:38.386342 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee15cff-89a1-4283-9747-c054eb66da40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:14:38.387806 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee15cff-89a1-4283-9747-c054eb66da40 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:14:38.399595 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1211/2457] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:14:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:14:38.441001 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1247/2458] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:14:38.448950 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b484b20-dbe7-4f38-86d0-bf91add4ca51 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:38.449239 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b484b20-dbe7-4f38-86d0-bf91add4ca51 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:38.449511 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b484b20-dbe7-4f38-86d0-bf91add4ca51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:38.467800 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-8b484b20-dbe7-4f38-86d0-bf91add4ca51 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:14:38.468973 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-8b484b20-dbe7-4f38-86d0-bf91add4ca51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:38.477196 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1212/2459] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:14:38.481336 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b88d6-3041-4b77-8653-85ccbd0dbf99 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:14:38.490847 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b88d6-3041-4b77-8653-85ccbd0dbf99 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:14:38.496351 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc9b55-59cd-4b77-af24-b1994bc1a88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:14:38.496996 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc9b55-59cd-4b77-af24-b1994bc1a88b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:38.497276 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc9b55-59cd-4b77-af24-b1994bc1a88b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:38.497544 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc9b55-59cd-4b77-af24-b1994bc1a88b admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:38.498257 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc9b55-59cd-4b77-af24-b1994bc1a88b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:14:38.498559 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc9b55-59cd-4b77-af24-b1994bc1a88b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:14:38.500179 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc9b55-59cd-4b77-af24-b1994bc1a88b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:14:38.514816 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1248/2460] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:14:38.516687 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b484b20-dbe7-4f38-86d0-bf91add4ca51 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:14:38.527750 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b484b20-dbe7-4f38-86d0-bf91add4ca51 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:14:38.533211 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053b5b9-81c8-4fa2-b768-6a2f9be1e268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:14:38.535797 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053b5b9-81c8-4fa2-b768-6a2f9be1e268 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:38.535797 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053b5b9-81c8-4fa2-b768-6a2f9be1e268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:38.535797 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053b5b9-81c8-4fa2-b768-6a2f9be1e268 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:38.535797 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053b5b9-81c8-4fa2-b768-6a2f9be1e268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:14:38.536961 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053b5b9-81c8-4fa2-b768-6a2f9be1e268 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:14:38.619521 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1213/2461] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:14:38 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:14:38.623984 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc9b55-59cd-4b77-af24-b1994bc1a88b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:14:38.635536 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc9b55-59cd-4b77-af24-b1994bc1a88b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:14:38.688973 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f96b2-b385-4bbe-9812-33ec5c1dc3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:14:38.689628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f96b2-b385-4bbe-9812-33ec5c1dc3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:38.689905 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f96b2-b385-4bbe-9812-33ec5c1dc3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:38.690172 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f96b2-b385-4bbe-9812-33ec5c1dc3e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:38.690870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f96b2-b385-4bbe-9812-33ec5c1dc3e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:14:38.692751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f96b2-b385-4bbe-9812-33ec5c1dc3e1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:14:38.760682 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1249/2462] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:14:38 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:14:38.764541 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053b5b9-81c8-4fa2-b768-6a2f9be1e268 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:14:38.775900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053b5b9-81c8-4fa2-b768-6a2f9be1e268 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:14:38.780610 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd050b-672a-49cb-9476-25998c285ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:14:38.783557 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd050b-672a-49cb-9476-25998c285ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:38.783557 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd050b-672a-49cb-9476-25998c285ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:38.783557 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd050b-672a-49cb-9476-25998c285ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:38.783557 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd050b-672a-49cb-9476-25998c285ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:14:38.784254 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd050b-672a-49cb-9476-25998c285ba7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:14:38.795235 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1214/2463] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:14:38.799298 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f96b2-b385-4bbe-9812-33ec5c1dc3e1 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:14:38.810016 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f96b2-b385-4bbe-9812-33ec5c1dc3e1 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:14:38.814903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c676f1-f058-4f86-820a-0153f426f649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:14:38.815548 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c676f1-f058-4f86-820a-0153f426f649 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:38.815831 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c676f1-f058-4f86-820a-0153f426f649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:38.816107 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c676f1-f058-4f86-820a-0153f426f649 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:38.816814 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c676f1-f058-4f86-820a-0153f426f649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:14:38.818384 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c676f1-f058-4f86-820a-0153f426f649 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:14:38.829280 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1250/2464] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:14:38.833676 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd050b-672a-49cb-9476-25998c285ba7 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:14:38.843570 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd050b-672a-49cb-9476-25998c285ba7 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:14:38.848398 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69a8c0-38fc-4bac-922e-0539ce945730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:14:38.849269 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69a8c0-38fc-4bac-922e-0539ce945730 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:38.849547 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69a8c0-38fc-4bac-922e-0539ce945730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:38.849818 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69a8c0-38fc-4bac-922e-0539ce945730 admin admin] PATH_INFO: `/v3/projects/e034cb05e3e644c88bcb85104b91730c/users/053c4165e22d472d857d9502bc5c21ff/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:38.865339 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69a8c0-38fc-4bac-922e-0539ce945730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e034cb05e3e644c88bcb85104b91730c, user_id=053c4165e22d472d857d9502bc5c21ff, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:14:38.869202 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69a8c0-38fc-4bac-922e-0539ce945730 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:14:38.925465 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1215/2465] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:14:38 2022] PUT /identity/v3/projects/e034cb05e3e644c88bcb85104b91730c/users/053c4165e22d472d857d9502bc5c21ff/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:14:38.931200 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c271a-5bf4-4def-8d76-9810a9805967 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:38.931488 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c271a-5bf4-4def-8d76-9810a9805967 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:38.931761 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c271a-5bf4-4def-8d76-9810a9805967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:38.949921 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-c30c271a-5bf4-4def-8d76-9810a9805967 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:14:38.951145 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-c30c271a-5bf4-4def-8d76-9810a9805967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:39.007787 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1251/2466] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:14:39.017434 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69a8c0-38fc-4bac-922e-0539ce945730 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:14:39.019246 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-7b69a8c0-38fc-4bac-922e-0539ce945730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:39.202291 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69a8c0-38fc-4bac-922e-0539ce945730 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:14:39.205840 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabef3ba-82a1-43ef-bce4-3a7f9a94ae8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:14:39.206459 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabef3ba-82a1-43ef-bce4-3a7f9a94ae8c service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:39.206774 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabef3ba-82a1-43ef-bce4-3a7f9a94ae8c service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:39.207042 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabef3ba-82a1-43ef-bce4-3a7f9a94ae8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:39.215930 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabef3ba-82a1-43ef-bce4-3a7f9a94ae8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:14:39.217309 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabef3ba-82a1-43ef-bce4-3a7f9a94ae8c service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:14:39.227563 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1216/2467] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:14:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:14:40.458934 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82e751-bad7-444d-af0b-207af9c2d142 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:40.459468 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82e751-bad7-444d-af0b-207af9c2d142 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:40.459468 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82e751-bad7-444d-af0b-207af9c2d142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:40.489354 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-1f82e751-bad7-444d-af0b-207af9c2d142 None None] MFA Rules not processed for user `053c4165e22d472d857d9502bc5c21ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:14:40.490716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-1f82e751-bad7-444d-af0b-207af9c2d142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:40.559239 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1252/2468] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:14:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:14:40.571558 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8a796-2eb3-4c04-a975-3841ca96689c None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:40.572098 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8a796-2eb3-4c04-a975-3841ca96689c None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:40.572098 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8a796-2eb3-4c04-a975-3841ca96689c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:40.591962 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-42d8a796-2eb3-4c04-a975-3841ca96689c None None] MFA Rules not processed for user `053c4165e22d472d857d9502bc5c21ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:14:40.593182 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-42d8a796-2eb3-4c04-a975-3841ca96689c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:40.600298 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1217/2469] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:14:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:14:40.611776 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82e751-bad7-444d-af0b-207af9c2d142 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:14:40.613189 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-1f82e751-bad7-444d-af0b-207af9c2d142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:40.687859 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82e751-bad7-444d-af0b-207af9c2d142 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:14:40.693322 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64ea17-da2f-48b3-b09c-3f6e1b6a919e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:14:40.694270 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64ea17-da2f-48b3-b09c-3f6e1b6a919e service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:40.695119 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64ea17-da2f-48b3-b09c-3f6e1b6a919e service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:40.695453 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64ea17-da2f-48b3-b09c-3f6e1b6a919e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:40.703588 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64ea17-da2f-48b3-b09c-3f6e1b6a919e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:14:40.705098 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64ea17-da2f-48b3-b09c-3f6e1b6a919e service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:14:40.715402 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1253/2470] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:14:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:14:41.334376 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8a796-2eb3-4c04-a975-3841ca96689c None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:14:41.335853 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-42d8a796-2eb3-4c04-a975-3841ca96689c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:41.405652 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8a796-2eb3-4c04-a975-3841ca96689c None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:14:41.410613 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5183f2f-e970-45a8-8284-51e7704ba06a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae711b94b32a431ab880aa8f6068ff25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:14:41.417521 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5183f2f-e970-45a8-8284-51e7704ba06a service placement] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:41.417521 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5183f2f-e970-45a8-8284-51e7704ba06a service placement] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:41.417521 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5183f2f-e970-45a8-8284-51e7704ba06a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:41.417521 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-a5183f2f-e970-45a8-8284-51e7704ba06a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:41.425972 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5183f2f-e970-45a8-8284-51e7704ba06a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:14:41.427696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5183f2f-e970-45a8-8284-51e7704ba06a service placement] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:14:41.437888 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1218/2471] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:14:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:14:45.475088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64ea17-da2f-48b3-b09c-3f6e1b6a919e service nova] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:14:45.486721 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64ea17-da2f-48b3-b09c-3f6e1b6a919e service nova] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:14:45.493021 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db910af8-f3e9-406a-a997-dcb7665fb640 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:14:45.493909 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db910af8-f3e9-406a-a997-dcb7665fb640 service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:45.494193 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db910af8-f3e9-406a-a997-dcb7665fb640 service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:45.495066 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db910af8-f3e9-406a-a997-dcb7665fb640 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:45.497093 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-db910af8-f3e9-406a-a997-dcb7665fb640 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:45.559153 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db910af8-f3e9-406a-a997-dcb7665fb640 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:14:45.561312 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db910af8-f3e9-406a-a997-dcb7665fb640 service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:14:45.571969 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1254/2472] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:14:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:14:56.435792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395bbf8-4bd2-4f1d-8788-432e61e574ee None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:56.435792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395bbf8-4bd2-4f1d-8788-432e61e574ee None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:56.435792 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395bbf8-4bd2-4f1d-8788-432e61e574ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:56.452293 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-4395bbf8-4bd2-4f1d-8788-432e61e574ee None None] MFA Rules not processed for user `fa9ea7738c634318a532ebca2e564745`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:14:56.454440 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-4395bbf8-4bd2-4f1d-8788-432e61e574ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:56.535753 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1219/2473] 10.222.0.42 () {58 vars in 967 bytes} [Wed Feb 16 17:14:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:14:56.560430 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db910af8-f3e9-406a-a997-dcb7665fb640 service nova] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:14:56.561912 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-db910af8-f3e9-406a-a997-dcb7665fb640 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:14:56.633635 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db910af8-f3e9-406a-a997-dcb7665fb640 service nova] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:14:56.639439 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66487428-b6e2-4ca1-8b7d-747d78f0adf0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc59cb98783b4353a405b8b9a3a9d592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:14:56.640085 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66487428-b6e2-4ca1-8b7d-747d78f0adf0 service swift] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:14:56.640369 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66487428-b6e2-4ca1-8b7d-747d78f0adf0 service swift] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:14:56.640645 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66487428-b6e2-4ca1-8b7d-747d78f0adf0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:14:56.650341 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66487428-b6e2-4ca1-8b7d-747d78f0adf0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:14:56.651943 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66487428-b6e2-4ca1-8b7d-747d78f0adf0 service swift] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:14:56.660455 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1255/2474] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Feb 16 17:14:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 17:15:02.290013 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395bbf8-4bd2-4f1d-8788-432e61e574ee None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:15:02.291460 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-4395bbf8-4bd2-4f1d-8788-432e61e574ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:15:02.303182 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395bbf8-4bd2-4f1d-8788-432e61e574ee None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:15:02.307695 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b34a08-eab1-4842-bd81-b7fe88d9ca14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:15:02.308333 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b34a08-eab1-4842-bd81-b7fe88d9ca14 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:15:02.308613 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b34a08-eab1-4842-bd81-b7fe88d9ca14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:15:02.309138 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b34a08-eab1-4842-bd81-b7fe88d9ca14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:15:02.310911 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d4b34a08-eab1-4842-bd81-b7fe88d9ca14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:15:02.320694 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b34a08-eab1-4842-bd81-b7fe88d9ca14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:15:02.322096 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b34a08-eab1-4842-bd81-b7fe88d9ca14 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:15:02.330249 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1220/2475] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:15:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:15:05.775034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66487428-b6e2-4ca1-8b7d-747d78f0adf0 service swift] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:15:05.776428 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-66487428-b6e2-4ca1-8b7d-747d78f0adf0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:15:05.792390 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66487428-b6e2-4ca1-8b7d-747d78f0adf0 service swift] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:15:05.797741 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56713a3-9bcb-4c45-81ff-ad8583137a5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:15:05.798458 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56713a3-9bcb-4c45-81ff-ad8583137a5f service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:15:05.798755 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56713a3-9bcb-4c45-81ff-ad8583137a5f service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:15:05.799029 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56713a3-9bcb-4c45-81ff-ad8583137a5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:15:05.800743 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-b56713a3-9bcb-4c45-81ff-ad8583137a5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:15:05.812660 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56713a3-9bcb-4c45-81ff-ad8583137a5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:15:05.814208 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56713a3-9bcb-4c45-81ff-ad8583137a5f service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:15:05.824517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1256/2476] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:15:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:15:14.666960 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae65840-dcd9-4d05-b161-f3bc02c6790b None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:15:14.667483 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae65840-dcd9-4d05-b161-f3bc02c6790b None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:15:14.667483 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae65840-dcd9-4d05-b161-f3bc02c6790b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:15:14.686377 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-cae65840-dcd9-4d05-b161-f3bc02c6790b None None] MFA Rules not processed for user `053c4165e22d472d857d9502bc5c21ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:15:14.687690 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-cae65840-dcd9-4d05-b161-f3bc02c6790b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:15:14.695871 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1221/2477] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:15:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:15:14.951500 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56713a3-9bcb-4c45-81ff-ad8583137a5f service nova] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:15:14.961918 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56713a3-9bcb-4c45-81ff-ad8583137a5f service nova] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:15:14.965561 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231248f-b593-45b2-87ac-e86f199d6fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:15:14.966182 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231248f-b593-45b2-87ac-e86f199d6fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:15:14.966458 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231248f-b593-45b2-87ac-e86f199d6fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:15:14.966789 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231248f-b593-45b2-87ac-e86f199d6fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:15:14.968690 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-6231248f-b593-45b2-87ac-e86f199d6fb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:15:14.978370 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231248f-b593-45b2-87ac-e86f199d6fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:15:14.979826 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231248f-b593-45b2-87ac-e86f199d6fb7 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:15:14.987721 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1257/2478] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:15:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:15:20.073320 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536d52a-3f17-4b22-8615-69b20480ce78 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:15:20.073845 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536d52a-3f17-4b22-8615-69b20480ce78 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:15:20.073942 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536d52a-3f17-4b22-8615-69b20480ce78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:15:20.092113 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-e536d52a-3f17-4b22-8615-69b20480ce78 None None] MFA Rules not processed for user `9fe56e2f96394a7b93e9fb5295554bba`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:15:20.093560 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e536d52a-3f17-4b22-8615-69b20480ce78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:15:20.149193 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1222/2479] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:15:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:15:30.077153 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231248f-b593-45b2-87ac-e86f199d6fb7 service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:15:30.090820 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231248f-b593-45b2-87ac-e86f199d6fb7 service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:15:30.096442 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8668a-adcb-4bf2-8660-cb88bc449042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:15:30.097121 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8668a-adcb-4bf2-8660-cb88bc449042 service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:15:30.097408 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8668a-adcb-4bf2-8660-cb88bc449042 service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:15:30.097686 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8668a-adcb-4bf2-8660-cb88bc449042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:15:30.099590 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-54d8668a-adcb-4bf2-8660-cb88bc449042 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:15:30.139714 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536d52a-3f17-4b22-8615-69b20480ce78 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:15:30.153849 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536d52a-3f17-4b22-8615-69b20480ce78 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:15:30.160133 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddc1f8-bacb-4ed2-9345-f2350f2c705b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:15:30.161055 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddc1f8-bacb-4ed2-9345-f2350f2c705b service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:15:30.161411 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddc1f8-bacb-4ed2-9345-f2350f2c705b service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:15:30.161757 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddc1f8-bacb-4ed2-9345-f2350f2c705b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:15:30.163308 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8668a-adcb-4bf2-8660-cb88bc449042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:15:30.163995 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-4cddc1f8-bacb-4ed2-9345-f2350f2c705b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:15:30.166481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8668a-adcb-4bf2-8660-cb88bc449042 service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:15:30.178824 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1258/2480] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:15:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:15:30.189642 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddc1f8-bacb-4ed2-9345-f2350f2c705b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:15:30.191194 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddc1f8-bacb-4ed2-9345-f2350f2c705b service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:15:30.203290 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1223/2481] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:15:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:15:35.937740 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28c50f-c111-4af5-999c-4d2282558e33 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:15:35.938249 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28c50f-c111-4af5-999c-4d2282558e33 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:15:35.938362 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28c50f-c111-4af5-999c-4d2282558e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:15:35.955822 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-8b28c50f-c111-4af5-999c-4d2282558e33 None None] MFA Rules not processed for user `053c4165e22d472d857d9502bc5c21ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:15:35.956995 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8b28c50f-c111-4af5-999c-4d2282558e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:15:35.964565 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1259/2482] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:15:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:15:36.221750 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddc1f8-bacb-4ed2-9345-f2350f2c705b service nova] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:15:36.232281 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddc1f8-bacb-4ed2-9345-f2350f2c705b service nova] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:15:36.236170 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7baa7-0d97-401c-92ec-1b22c2c085f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:15:36.236808 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7baa7-0d97-401c-92ec-1b22c2c085f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:15:36.237242 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7baa7-0d97-401c-92ec-1b22c2c085f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:15:36.237722 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7baa7-0d97-401c-92ec-1b22c2c085f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:15:36.239543 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e8f7baa7-0d97-401c-92ec-1b22c2c085f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:15:36.254137 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7baa7-0d97-401c-92ec-1b22c2c085f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:15:36.255604 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7baa7-0d97-401c-92ec-1b22c2c085f1 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:15:36.265182 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1224/2483] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:15:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:15:46.756375 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4f8f1-31fc-4ed4-a339-6e468bd8ca08 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:15:46.756839 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4f8f1-31fc-4ed4-a339-6e468bd8ca08 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:15:46.756935 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4f8f1-31fc-4ed4-a339-6e468bd8ca08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:15:46.796151 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-49c4f8f1-31fc-4ed4-a339-6e468bd8ca08 None None] MFA Rules not processed for user `b5ea1801f0674e8297e2cd8a964333d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:15:46.797534 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-49c4f8f1-31fc-4ed4-a339-6e468bd8ca08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:15:46.919758 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1260/2484] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:15:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:16:12.435464 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f6773-38c6-4726-acb1-c1ea71298521 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:16:12.436091 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f6773-38c6-4726-acb1-c1ea71298521 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:16:12.436091 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f6773-38c6-4726-acb1-c1ea71298521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:16:12.454682 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-5d8f6773-38c6-4726-acb1-c1ea71298521 None None] MFA Rules not processed for user `053c4165e22d472d857d9502bc5c21ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:16:12.455812 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-5d8f6773-38c6-4726-acb1-c1ea71298521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:16:12.462686 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1225/2485] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:16:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:16:19.675920 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4f8f1-31fc-4ed4-a339-6e468bd8ca08 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:16:19.689015 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4f8f1-31fc-4ed4-a339-6e468bd8ca08 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:16:19.694481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a942f32-a7df-4a75-974a-8829ed141eb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:16:19.695160 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a942f32-a7df-4a75-974a-8829ed141eb3 service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:16:19.695446 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a942f32-a7df-4a75-974a-8829ed141eb3 service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:16:19.695706 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a942f32-a7df-4a75-974a-8829ed141eb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:16:19.697468 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0a942f32-a7df-4a75-974a-8829ed141eb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:16:19.709999 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a942f32-a7df-4a75-974a-8829ed141eb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:16:19.711590 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a942f32-a7df-4a75-974a-8829ed141eb3 service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:16:19.723181 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1261/2486] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:16:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:16:47.897092 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f6773-38c6-4726-acb1-c1ea71298521 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:16:47.898558 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-5d8f6773-38c6-4726-acb1-c1ea71298521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:16:47.912419 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f6773-38c6-4726-acb1-c1ea71298521 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:16:47.918413 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1471d8-8657-4d67-84c2-80c3e232ea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:16:47.919444 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1471d8-8657-4d67-84c2-80c3e232ea55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:16:47.919840 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1471d8-8657-4d67-84c2-80c3e232ea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:16:47.920170 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1471d8-8657-4d67-84c2-80c3e232ea55 admin admin] PATH_INFO: `/v3/users/9fe56e2f96394a7b93e9fb5295554bba` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:16:47.921355 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1471d8-8657-4d67-84c2-80c3e232ea55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe56e2f96394a7b93e9fb5295554bba)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:16:47.923322 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1471d8-8657-4d67-84c2-80c3e232ea55 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:16:48.119219 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0f1471d8-8657-4d67-84c2-80c3e232ea55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe56e2f96394a7b93e9fb5295554bba'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:16:48.120052 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0f1471d8-8657-4d67-84c2-80c3e232ea55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe56e2f96394a7b93e9fb5295554bba'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:16:48.131314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0f1471d8-8657-4d67-84c2-80c3e232ea55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe56e2f96394a7b93e9fb5295554bba'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:16:48.137830 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0f1471d8-8657-4d67-84c2-80c3e232ea55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe56e2f96394a7b93e9fb5295554bba'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:16:48.214688 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0f1471d8-8657-4d67-84c2-80c3e232ea55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe56e2f96394a7b93e9fb5295554bba'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:16:48.220795 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1226/2487] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:16:47 2022] DELETE /identity/v3/users/9fe56e2f96394a7b93e9fb5295554bba => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:16:48.492179 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a942f32-a7df-4a75-974a-8829ed141eb3 service nova] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:16:48.502876 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a942f32-a7df-4a75-974a-8829ed141eb3 service nova] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:16:48.567055 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1844b48-e608-4912-9a8d-c387db453966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:16:48.567977 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1844b48-e608-4912-9a8d-c387db453966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:16:48.568252 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1844b48-e608-4912-9a8d-c387db453966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:16:48.568556 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1844b48-e608-4912-9a8d-c387db453966 admin admin] PATH_INFO: `/v3/projects/a588bdeff54343ac983aa1ccdd3e4480` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:16:48.569766 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1844b48-e608-4912-9a8d-c387db453966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a588bdeff54343ac983aa1ccdd3e4480)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:16:48.571735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1844b48-e608-4912-9a8d-c387db453966 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:16:48.666578 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e1844b48-e608-4912-9a8d-c387db453966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a588bdeff54343ac983aa1ccdd3e4480', 'request_id': 'req-e1844b48-e608-4912-9a8d-c387db453966'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:16:48.741397 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e1844b48-e608-4912-9a8d-c387db453966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a588bdeff54343ac983aa1ccdd3e4480', 'request_id': 'req-e1844b48-e608-4912-9a8d-c387db453966'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:16:48.747775 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e1844b48-e608-4912-9a8d-c387db453966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a588bdeff54343ac983aa1ccdd3e4480', 'request_id': 'req-e1844b48-e608-4912-9a8d-c387db453966'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:16:48.759711 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e1844b48-e608-4912-9a8d-c387db453966 admin admin] The token cache is being invalidate because project a588bdeff54343ac983aa1ccdd3e4480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:16:48.759997 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e1844b48-e608-4912-9a8d-c387db453966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:16:48.760651 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e1844b48-e608-4912-9a8d-c387db453966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:16:48.762284 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1262/2488] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:16:48 2022] DELETE /identity/v3/projects/a588bdeff54343ac983aa1ccdd3e4480 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:16:58.706251 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9777d-f73f-474b-bea8-d047bf1864bd None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:16:58.706787 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9777d-f73f-474b-bea8-d047bf1864bd None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:16:58.706903 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9777d-f73f-474b-bea8-d047bf1864bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:16:58.724920 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-04d9777d-f73f-474b-bea8-d047bf1864bd None None] MFA Rules not processed for user `dd1b4007dbea4e46835dcf36bdb8b727`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:16:58.726163 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-04d9777d-f73f-474b-bea8-d047bf1864bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:16:58.780806 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1227/2489] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:16:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:17:15.111686 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1844b48-e608-4912-9a8d-c387db453966 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:15.117893 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e1844b48-e608-4912-9a8d-c387db453966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:15.184522 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1844b48-e608-4912-9a8d-c387db453966 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:15.189077 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d129a-18ae-43ff-a59d-c99963af703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:15.189945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d129a-18ae-43ff-a59d-c99963af703f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:15.190219 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d129a-18ae-43ff-a59d-c99963af703f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:15.190485 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d129a-18ae-43ff-a59d-c99963af703f admin admin] PATH_INFO: `/v3/users/053c4165e22d472d857d9502bc5c21ff` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:15.191797 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d129a-18ae-43ff-a59d-c99963af703f admin admin] RBAC: Authorizing `identity:delete_user(user_id=053c4165e22d472d857d9502bc5c21ff)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:15.193687 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d129a-18ae-43ff-a59d-c99963af703f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:15.343029 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1d2d129a-18ae-43ff-a59d-c99963af703f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '053c4165e22d472d857d9502bc5c21ff'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:15.343919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1d2d129a-18ae-43ff-a59d-c99963af703f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '053c4165e22d472d857d9502bc5c21ff'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:15.356547 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1d2d129a-18ae-43ff-a59d-c99963af703f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '053c4165e22d472d857d9502bc5c21ff'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:15.363140 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1d2d129a-18ae-43ff-a59d-c99963af703f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '053c4165e22d472d857d9502bc5c21ff'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:15.364155 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1d2d129a-18ae-43ff-a59d-c99963af703f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '053c4165e22d472d857d9502bc5c21ff'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:15.427592 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1263/2490] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:17:15 2022] DELETE /identity/v3/users/053c4165e22d472d857d9502bc5c21ff => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:17:15.680853 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9777d-f73f-474b-bea8-d047bf1864bd None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:15.697372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9777d-f73f-474b-bea8-d047bf1864bd None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:15.761446 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eec635-4f1c-4966-bbe2-fd2283e04655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:15.762283 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eec635-4f1c-4966-bbe2-fd2283e04655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:15.762555 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eec635-4f1c-4966-bbe2-fd2283e04655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:15.763056 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eec635-4f1c-4966-bbe2-fd2283e04655 admin admin] PATH_INFO: `/v3/projects/e034cb05e3e644c88bcb85104b91730c` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:15.764222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eec635-4f1c-4966-bbe2-fd2283e04655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e034cb05e3e644c88bcb85104b91730c)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:15.766080 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eec635-4f1c-4966-bbe2-fd2283e04655 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:15.906252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a2eec635-4f1c-4966-bbe2-fd2283e04655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e034cb05e3e644c88bcb85104b91730c', 'request_id': 'req-a2eec635-4f1c-4966-bbe2-fd2283e04655'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:15.986480 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a2eec635-4f1c-4966-bbe2-fd2283e04655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e034cb05e3e644c88bcb85104b91730c', 'request_id': 'req-a2eec635-4f1c-4966-bbe2-fd2283e04655'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:15.993373 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a2eec635-4f1c-4966-bbe2-fd2283e04655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e034cb05e3e644c88bcb85104b91730c', 'request_id': 'req-a2eec635-4f1c-4966-bbe2-fd2283e04655'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:16.005996 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a2eec635-4f1c-4966-bbe2-fd2283e04655 admin admin] The token cache is being invalidate because project e034cb05e3e644c88bcb85104b91730c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:17:16.006276 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a2eec635-4f1c-4966-bbe2-fd2283e04655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:16.006973 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a2eec635-4f1c-4966-bbe2-fd2283e04655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:16.008531 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1228/2491] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:17:15 2022] DELETE /identity/v3/projects/e034cb05e3e644c88bcb85104b91730c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:17:16.015376 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13309e-7482-4647-b32a-ae39a5906f93 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:16.015850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13309e-7482-4647-b32a-ae39a5906f93 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:16.016308 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13309e-7482-4647-b32a-ae39a5906f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:16.038836 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-0d13309e-7482-4647-b32a-ae39a5906f93 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:17:16.040049 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0d13309e-7482-4647-b32a-ae39a5906f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:16.105100 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1264/2492] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:17:16.114167 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53aa1b-209f-47d6-8a1a-628cd7561d8a None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:16.114449 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53aa1b-209f-47d6-8a1a-628cd7561d8a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:16.114755 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53aa1b-209f-47d6-8a1a-628cd7561d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:16.133947 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-6f53aa1b-209f-47d6-8a1a-628cd7561d8a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:17:16.135171 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6f53aa1b-209f-47d6-8a1a-628cd7561d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:16.143369 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1229/2493] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:17:16.147915 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13309e-7482-4647-b32a-ae39a5906f93 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:16.158398 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13309e-7482-4647-b32a-ae39a5906f93 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:16.163845 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2e5a8-5562-4c98-9c73-b0d61ef2271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:16.164535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2e5a8-5562-4c98-9c73-b0d61ef2271e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:16.164815 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2e5a8-5562-4c98-9c73-b0d61ef2271e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:16.165092 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2e5a8-5562-4c98-9c73-b0d61ef2271e admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:16.165812 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2e5a8-5562-4c98-9c73-b0d61ef2271e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:17:16.166120 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2e5a8-5562-4c98-9c73-b0d61ef2271e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:16.167764 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2e5a8-5562-4c98-9c73-b0d61ef2271e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:16.181178 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1265/2494] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:17:16.185487 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53aa1b-209f-47d6-8a1a-628cd7561d8a None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:16.195190 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53aa1b-209f-47d6-8a1a-628cd7561d8a None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:16.200017 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982652e-a03c-4122-a3fe-6027f7ebb01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:16.200669 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982652e-a03c-4122-a3fe-6027f7ebb01e admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:16.200946 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982652e-a03c-4122-a3fe-6027f7ebb01e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:16.201223 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982652e-a03c-4122-a3fe-6027f7ebb01e admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:16.202106 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982652e-a03c-4122-a3fe-6027f7ebb01e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:16.205452 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982652e-a03c-4122-a3fe-6027f7ebb01e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:16.295250 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1230/2495] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:17:16 2022] POST /identity/v3/projects => generated 405 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:17:16.299950 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2e5a8-5562-4c98-9c73-b0d61ef2271e admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:16.310850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2e5a8-5562-4c98-9c73-b0d61ef2271e admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:16.372079 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bab6ae-c16c-4122-8ffd-80c48c610b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:16.372771 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bab6ae-c16c-4122-8ffd-80c48c610b36 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:16.373097 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bab6ae-c16c-4122-8ffd-80c48c610b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:16.373313 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bab6ae-c16c-4122-8ffd-80c48c610b36 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:16.373998 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bab6ae-c16c-4122-8ffd-80c48c610b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:16.376053 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bab6ae-c16c-4122-8ffd-80c48c610b36 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:16.454914 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1266/2496] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:17:16 2022] POST /identity/v3/users => generated 303 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:17:16.459799 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982652e-a03c-4122-a3fe-6027f7ebb01e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:16.474592 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982652e-a03c-4122-a3fe-6027f7ebb01e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:16.479728 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ebfcf-c505-43be-a96d-ebe5bd4695a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:16.480382 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ebfcf-c505-43be-a96d-ebe5bd4695a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:16.480664 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ebfcf-c505-43be-a96d-ebe5bd4695a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:16.480939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ebfcf-c505-43be-a96d-ebe5bd4695a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:16.481668 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ebfcf-c505-43be-a96d-ebe5bd4695a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:16.483347 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ebfcf-c505-43be-a96d-ebe5bd4695a5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:16.493891 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1231/2497] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:17:16.498781 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bab6ae-c16c-4122-8ffd-80c48c610b36 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:16.508964 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bab6ae-c16c-4122-8ffd-80c48c610b36 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:16.514111 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5a6ff-e6ab-4a8d-890d-ca779d69c14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:16.514799 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5a6ff-e6ab-4a8d-890d-ca779d69c14f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:16.515078 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5a6ff-e6ab-4a8d-890d-ca779d69c14f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:16.515372 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5a6ff-e6ab-4a8d-890d-ca779d69c14f admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:16.516109 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5a6ff-e6ab-4a8d-890d-ca779d69c14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:16.517869 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5a6ff-e6ab-4a8d-890d-ca779d69c14f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:16.529340 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1267/2498] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:17:16.533875 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ebfcf-c505-43be-a96d-ebe5bd4695a5 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:16.546627 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ebfcf-c505-43be-a96d-ebe5bd4695a5 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:16.551381 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3d340-10dc-4168-9962-04cad9f750cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:16.552245 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3d340-10dc-4168-9962-04cad9f750cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:16.552523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3d340-10dc-4168-9962-04cad9f750cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:16.552796 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3d340-10dc-4168-9962-04cad9f750cd admin admin] PATH_INFO: `/v3/projects/ffa5001888cd405da5e28eb5526ea01f/users/82631c262e93462cab2d8eeaed79125c/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:16.567214 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3d340-10dc-4168-9962-04cad9f750cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa5001888cd405da5e28eb5526ea01f, user_id=82631c262e93462cab2d8eeaed79125c, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:16.569815 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3d340-10dc-4168-9962-04cad9f750cd admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:16.666989 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1232/2499] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:17:16 2022] PUT /identity/v3/projects/ffa5001888cd405da5e28eb5526ea01f/users/82631c262e93462cab2d8eeaed79125c/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:17:16.677647 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d339c-ae95-4a94-997b-aca51c5e436e None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:16.677939 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d339c-ae95-4a94-997b-aca51c5e436e None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:16.678297 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d339c-ae95-4a94-997b-aca51c5e436e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:16.704693 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-409d339c-ae95-4a94-997b-aca51c5e436e None None] MFA Rules not processed for user `82631c262e93462cab2d8eeaed79125c`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:17:16.705947 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-409d339c-ae95-4a94-997b-aca51c5e436e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:16.768593 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1268/2500] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:17:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:17:16.773825 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3d340-10dc-4168-9962-04cad9f750cd admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:16.832657 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3d340-10dc-4168-9962-04cad9f750cd admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:16.837222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4cd64-3c45-4c01-ace2-a821863e6360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:16.837901 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4cd64-3c45-4c01-ace2-a821863e6360 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:16.838169 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4cd64-3c45-4c01-ace2-a821863e6360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:16.838438 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4cd64-3c45-4c01-ace2-a821863e6360 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:16.839162 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4cd64-3c45-4c01-ace2-a821863e6360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:16.841025 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4cd64-3c45-4c01-ace2-a821863e6360 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:16.924266 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1233/2501] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:17:16 2022] POST /identity/v3/projects => generated 403 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:17:16.929262 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d339c-ae95-4a94-997b-aca51c5e436e None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:16.939831 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d339c-ae95-4a94-997b-aca51c5e436e None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:17.001670 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d981de7-c201-4468-b096-0a32f81829d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:17.002260 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d981de7-c201-4468-b096-0a32f81829d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:17.002538 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d981de7-c201-4468-b096-0a32f81829d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:17.002841 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d981de7-c201-4468-b096-0a32f81829d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:17.003536 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d981de7-c201-4468-b096-0a32f81829d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:17.005962 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d981de7-c201-4468-b096-0a32f81829d4 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:17.105857 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1269/2502] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:17:16 2022] POST /identity/v3/users => generated 308 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:17:17.109998 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4cd64-3c45-4c01-ace2-a821863e6360 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:17.120708 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4cd64-3c45-4c01-ace2-a821863e6360 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:17.125269 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e465768-3a86-4ae8-a5f1-553d4209d932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:17.125911 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e465768-3a86-4ae8-a5f1-553d4209d932 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:17.126188 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e465768-3a86-4ae8-a5f1-553d4209d932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:17.126458 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e465768-3a86-4ae8-a5f1-553d4209d932 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:17.127203 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e465768-3a86-4ae8-a5f1-553d4209d932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:17.128913 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e465768-3a86-4ae8-a5f1-553d4209d932 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:17.139420 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1234/2503] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:17:17.143498 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d981de7-c201-4468-b096-0a32f81829d4 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:17.153811 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d981de7-c201-4468-b096-0a32f81829d4 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:17.158330 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44935bb-a39c-4751-bf66-47561cbe7797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:17.159246 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44935bb-a39c-4751-bf66-47561cbe7797 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:17.159517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44935bb-a39c-4751-bf66-47561cbe7797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:17.159786 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44935bb-a39c-4751-bf66-47561cbe7797 admin admin] PATH_INFO: `/v3/projects/2e77d7d140d54afe87c0e0bfb0e31bd9/users/254bf608bb4e47b0a7a353bef0944807/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:17.174426 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44935bb-a39c-4751-bf66-47561cbe7797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e77d7d140d54afe87c0e0bfb0e31bd9, user_id=254bf608bb4e47b0a7a353bef0944807, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:17.177141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44935bb-a39c-4751-bf66-47561cbe7797 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:17.243714 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1270/2504] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:17:17 2022] PUT /identity/v3/projects/2e77d7d140d54afe87c0e0bfb0e31bd9/users/254bf608bb4e47b0a7a353bef0944807/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:17:17.247644 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e465768-3a86-4ae8-a5f1-553d4209d932 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:17.258142 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e465768-3a86-4ae8-a5f1-553d4209d932 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:17.312994 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166df1d-ef25-4df3-b685-4aa795763b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:17.313645 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166df1d-ef25-4df3-b685-4aa795763b32 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:17.313925 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166df1d-ef25-4df3-b685-4aa795763b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:17.314227 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166df1d-ef25-4df3-b685-4aa795763b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:17.314971 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166df1d-ef25-4df3-b685-4aa795763b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:17.316825 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166df1d-ef25-4df3-b685-4aa795763b32 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:17.326183 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1235/2505] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:17:17.330290 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44935bb-a39c-4751-bf66-47561cbe7797 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:17.341225 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44935bb-a39c-4751-bf66-47561cbe7797 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:17.345813 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdab1a8-1297-4b9c-8935-7c8e104b6908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:17.346743 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdab1a8-1297-4b9c-8935-7c8e104b6908 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:17.347027 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdab1a8-1297-4b9c-8935-7c8e104b6908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:17.350150 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdab1a8-1297-4b9c-8935-7c8e104b6908 admin admin] PATH_INFO: `/v3/projects/2e77d7d140d54afe87c0e0bfb0e31bd9/users/254bf608bb4e47b0a7a353bef0944807/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:17.350150 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdab1a8-1297-4b9c-8935-7c8e104b6908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e77d7d140d54afe87c0e0bfb0e31bd9, user_id=254bf608bb4e47b0a7a353bef0944807, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:17.352735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdab1a8-1297-4b9c-8935-7c8e104b6908 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:17.362877 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1271/2506] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:17:17 2022] PUT /identity/v3/projects/2e77d7d140d54afe87c0e0bfb0e31bd9/users/254bf608bb4e47b0a7a353bef0944807/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:17:17.374712 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb734ec7-7ad3-4081-be7d-64be33b21ed8 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:17.379459 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb734ec7-7ad3-4081-be7d-64be33b21ed8 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:17.379459 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb734ec7-7ad3-4081-be7d-64be33b21ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:17.402572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-cb734ec7-7ad3-4081-be7d-64be33b21ed8 None None] MFA Rules not processed for user `254bf608bb4e47b0a7a353bef0944807`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:17:17.403801 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-cb734ec7-7ad3-4081-be7d-64be33b21ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:17.469853 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1236/2507] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:17:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:17:17.480004 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdab1a8-1297-4b9c-8935-7c8e104b6908 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:17.481716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-bcdab1a8-1297-4b9c-8935-7c8e104b6908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:17.538773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdab1a8-1297-4b9c-8935-7c8e104b6908 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:17.542395 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3af1d-e3d0-40aa-8821-9d65cbefac26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:17.543069 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3af1d-e3d0-40aa-8821-9d65cbefac26 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:17.543347 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3af1d-e3d0-40aa-8821-9d65cbefac26 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:17.543622 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3af1d-e3d0-40aa-8821-9d65cbefac26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:17.552740 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3af1d-e3d0-40aa-8821-9d65cbefac26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:17.554153 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3af1d-e3d0-40aa-8821-9d65cbefac26 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:17.563308 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1272/2508] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:17:17 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:17:17.689464 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb734ec7-7ad3-4081-be7d-64be33b21ed8 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:17.751202 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb734ec7-7ad3-4081-be7d-64be33b21ed8 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:17.756482 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06814445-3b9e-46d1-abbf-cb4caea59bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:17.757376 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06814445-3b9e-46d1-abbf-cb4caea59bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:17.757656 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06814445-3b9e-46d1-abbf-cb4caea59bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:17.757932 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06814445-3b9e-46d1-abbf-cb4caea59bdf admin admin] PATH_INFO: `/v3/users/82631c262e93462cab2d8eeaed79125c` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:17.759148 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06814445-3b9e-46d1-abbf-cb4caea59bdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=82631c262e93462cab2d8eeaed79125c)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:17.761045 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06814445-3b9e-46d1-abbf-cb4caea59bdf admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:17.942377 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-06814445-3b9e-46d1-abbf-cb4caea59bdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82631c262e93462cab2d8eeaed79125c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:17.943107 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-06814445-3b9e-46d1-abbf-cb4caea59bdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82631c262e93462cab2d8eeaed79125c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:17.954341 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-06814445-3b9e-46d1-abbf-cb4caea59bdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82631c262e93462cab2d8eeaed79125c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:17.960917 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-06814445-3b9e-46d1-abbf-cb4caea59bdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82631c262e93462cab2d8eeaed79125c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:18.048773 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-06814445-3b9e-46d1-abbf-cb4caea59bdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82631c262e93462cab2d8eeaed79125c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:18.055611 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1237/2509] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:17:17 2022] DELETE /identity/v3/users/82631c262e93462cab2d8eeaed79125c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:17:18.060165 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377e3c3-a4a6-47a0-9a5c-0db741f0d155 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:18.060542 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377e3c3-a4a6-47a0-9a5c-0db741f0d155 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:18.060809 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377e3c3-a4a6-47a0-9a5c-0db741f0d155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:18.078720 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-f377e3c3-a4a6-47a0-9a5c-0db741f0d155 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:17:18.079903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f377e3c3-a4a6-47a0-9a5c-0db741f0d155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:18.136924 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1273/2510] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:17:18.146919 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06814445-3b9e-46d1-abbf-cb4caea59bdf admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:18.148288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-06814445-3b9e-46d1-abbf-cb4caea59bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:18.203425 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06814445-3b9e-46d1-abbf-cb4caea59bdf admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:18.207196 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede2579-55de-4fb2-9e05-49244ed702c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:18.207926 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede2579-55de-4fb2-9e05-49244ed702c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:18.208205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede2579-55de-4fb2-9e05-49244ed702c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:18.208476 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede2579-55de-4fb2-9e05-49244ed702c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:18.217390 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede2579-55de-4fb2-9e05-49244ed702c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:18.218818 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede2579-55de-4fb2-9e05-49244ed702c6 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:18.228589 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1238/2511] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:17:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:17:18.639275 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377e3c3-a4a6-47a0-9a5c-0db741f0d155 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:18.640736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f377e3c3-a4a6-47a0-9a5c-0db741f0d155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:18.653296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377e3c3-a4a6-47a0-9a5c-0db741f0d155 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:18.658217 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f43c4d-b03b-4dca-9f36-c049f145a395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:18.659218 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f43c4d-b03b-4dca-9f36-c049f145a395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:18.659504 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f43c4d-b03b-4dca-9f36-c049f145a395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:18.660592 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f43c4d-b03b-4dca-9f36-c049f145a395 admin admin] PATH_INFO: `/v3/projects/ffa5001888cd405da5e28eb5526ea01f` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:18.661855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f43c4d-b03b-4dca-9f36-c049f145a395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffa5001888cd405da5e28eb5526ea01f)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:18.663815 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f43c4d-b03b-4dca-9f36-c049f145a395 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:18.775644 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f5f43c4d-b03b-4dca-9f36-c049f145a395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffa5001888cd405da5e28eb5526ea01f', 'request_id': 'req-f5f43c4d-b03b-4dca-9f36-c049f145a395'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:18.865295 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f5f43c4d-b03b-4dca-9f36-c049f145a395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffa5001888cd405da5e28eb5526ea01f', 'request_id': 'req-f5f43c4d-b03b-4dca-9f36-c049f145a395'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:18.871497 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f5f43c4d-b03b-4dca-9f36-c049f145a395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffa5001888cd405da5e28eb5526ea01f', 'request_id': 'req-f5f43c4d-b03b-4dca-9f36-c049f145a395'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:18.882745 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f5f43c4d-b03b-4dca-9f36-c049f145a395 admin admin] The token cache is being invalidate because project ffa5001888cd405da5e28eb5526ea01f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:17:18.883035 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f5f43c4d-b03b-4dca-9f36-c049f145a395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:18.883674 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f5f43c4d-b03b-4dca-9f36-c049f145a395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:18.885306 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1274/2512] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:17:18 2022] DELETE /identity/v3/projects/ffa5001888cd405da5e28eb5526ea01f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:17:18.889361 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede2579-55de-4fb2-9e05-49244ed702c6 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:18.899358 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede2579-55de-4fb2-9e05-49244ed702c6 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:18.954004 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125fdc6-39c8-43bf-87ba-7b04c1442ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:18.954890 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125fdc6-39c8-43bf-87ba-7b04c1442ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:18.955167 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125fdc6-39c8-43bf-87ba-7b04c1442ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:18.955436 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125fdc6-39c8-43bf-87ba-7b04c1442ff7 admin admin] PATH_INFO: `/v3/users/254bf608bb4e47b0a7a353bef0944807` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:18.957128 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125fdc6-39c8-43bf-87ba-7b04c1442ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=254bf608bb4e47b0a7a353bef0944807)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:18.959037 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125fdc6-39c8-43bf-87ba-7b04c1442ff7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:19.124791 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0125fdc6-39c8-43bf-87ba-7b04c1442ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254bf608bb4e47b0a7a353bef0944807'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:19.125368 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0125fdc6-39c8-43bf-87ba-7b04c1442ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254bf608bb4e47b0a7a353bef0944807'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:19.137420 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0125fdc6-39c8-43bf-87ba-7b04c1442ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254bf608bb4e47b0a7a353bef0944807'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:19.144036 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0125fdc6-39c8-43bf-87ba-7b04c1442ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254bf608bb4e47b0a7a353bef0944807'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:19.214435 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0125fdc6-39c8-43bf-87ba-7b04c1442ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254bf608bb4e47b0a7a353bef0944807'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:19.220572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1239/2513] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:17:18 2022] DELETE /identity/v3/users/254bf608bb4e47b0a7a353bef0944807 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:17:19.656310 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f43c4d-b03b-4dca-9f36-c049f145a395 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:19.657821 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f5f43c4d-b03b-4dca-9f36-c049f145a395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:19.671831 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f43c4d-b03b-4dca-9f36-c049f145a395 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:19.728843 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3962c-4f14-476b-a04e-08952abcbaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:19.729686 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3962c-4f14-476b-a04e-08952abcbaa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:19.729961 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3962c-4f14-476b-a04e-08952abcbaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:19.730219 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3962c-4f14-476b-a04e-08952abcbaa2 admin admin] PATH_INFO: `/v3/projects/2e77d7d140d54afe87c0e0bfb0e31bd9` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:19.731452 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3962c-4f14-476b-a04e-08952abcbaa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e77d7d140d54afe87c0e0bfb0e31bd9)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:19.733291 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3962c-4f14-476b-a04e-08952abcbaa2 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:19.842684 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-17a3962c-4f14-476b-a04e-08952abcbaa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e77d7d140d54afe87c0e0bfb0e31bd9', 'request_id': 'req-17a3962c-4f14-476b-a04e-08952abcbaa2'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:19.940470 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-17a3962c-4f14-476b-a04e-08952abcbaa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e77d7d140d54afe87c0e0bfb0e31bd9', 'request_id': 'req-17a3962c-4f14-476b-a04e-08952abcbaa2'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:19.946770 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-17a3962c-4f14-476b-a04e-08952abcbaa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e77d7d140d54afe87c0e0bfb0e31bd9', 'request_id': 'req-17a3962c-4f14-476b-a04e-08952abcbaa2'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:19.958543 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-17a3962c-4f14-476b-a04e-08952abcbaa2 admin admin] The token cache is being invalidate because project 2e77d7d140d54afe87c0e0bfb0e31bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:17:19.958942 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-17a3962c-4f14-476b-a04e-08952abcbaa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:19.959619 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-17a3962c-4f14-476b-a04e-08952abcbaa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:19.961150 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1275/2514] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:17:19 2022] DELETE /identity/v3/projects/2e77d7d140d54afe87c0e0bfb0e31bd9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:17:19.966203 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0fb56-6924-4edf-a14b-8224322e457c None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:19.966793 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0fb56-6924-4edf-a14b-8224322e457c None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:19.966793 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0fb56-6924-4edf-a14b-8224322e457c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:19.990158 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-c6d0fb56-6924-4edf-a14b-8224322e457c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:17:19.991598 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-c6d0fb56-6924-4edf-a14b-8224322e457c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:20.052871 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1240/2515] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:17:20.062625 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746b197-734e-4afb-9ba0-cfa82c1f02f8 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:20.062966 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746b197-734e-4afb-9ba0-cfa82c1f02f8 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:20.063238 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746b197-734e-4afb-9ba0-cfa82c1f02f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:20.083409 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-3746b197-734e-4afb-9ba0-cfa82c1f02f8 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:17:20.084629 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-3746b197-734e-4afb-9ba0-cfa82c1f02f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:20.093125 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1276/2516] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:17:20.097513 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0fb56-6924-4edf-a14b-8224322e457c None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:20.107352 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0fb56-6924-4edf-a14b-8224322e457c None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:20.112052 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd3e80-1df5-4583-ae72-efdcfdb99e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:20.112570 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd3e80-1df5-4583-ae72-efdcfdb99e18 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:20.113414 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd3e80-1df5-4583-ae72-efdcfdb99e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:20.113812 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd3e80-1df5-4583-ae72-efdcfdb99e18 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:20.114602 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd3e80-1df5-4583-ae72-efdcfdb99e18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:17:20.114948 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd3e80-1df5-4583-ae72-efdcfdb99e18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:20.116517 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd3e80-1df5-4583-ae72-efdcfdb99e18 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:20.128138 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1241/2517] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:17:20.133348 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746b197-734e-4afb-9ba0-cfa82c1f02f8 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:20.142343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746b197-734e-4afb-9ba0-cfa82c1f02f8 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:20.147447 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3032bc3-e327-4961-a739-3290059afbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:20.148082 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3032bc3-e327-4961-a739-3290059afbcc admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:20.148362 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3032bc3-e327-4961-a739-3290059afbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:20.148642 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3032bc3-e327-4961-a739-3290059afbcc admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:20.149329 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3032bc3-e327-4961-a739-3290059afbcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:20.151314 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3032bc3-e327-4961-a739-3290059afbcc admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:20.239543 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1277/2518] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:17:20 2022] POST /identity/v3/projects => generated 369 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:17:20.243671 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd3e80-1df5-4583-ae72-efdcfdb99e18 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:20.254554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd3e80-1df5-4583-ae72-efdcfdb99e18 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:20.310393 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea602f16-cba9-4ee0-ab57-c98f4e640df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:20.311107 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea602f16-cba9-4ee0-ab57-c98f4e640df2 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:20.311452 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea602f16-cba9-4ee0-ab57-c98f4e640df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:20.312057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea602f16-cba9-4ee0-ab57-c98f4e640df2 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:20.312755 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea602f16-cba9-4ee0-ab57-c98f4e640df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:20.314667 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea602f16-cba9-4ee0-ab57-c98f4e640df2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:20.420852 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1242/2519] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:17:20 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:17:20.424958 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3032bc3-e327-4961-a739-3290059afbcc admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:20.436267 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3032bc3-e327-4961-a739-3290059afbcc admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:20.441873 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a99bd2-c4d0-4695-b2df-6e1e11573de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:20.442576 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a99bd2-c4d0-4695-b2df-6e1e11573de4 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:20.442897 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a99bd2-c4d0-4695-b2df-6e1e11573de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:20.443173 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a99bd2-c4d0-4695-b2df-6e1e11573de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:20.443884 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a99bd2-c4d0-4695-b2df-6e1e11573de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:20.448199 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a99bd2-c4d0-4695-b2df-6e1e11573de4 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:20.456208 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1278/2520] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:17:20.460107 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea602f16-cba9-4ee0-ab57-c98f4e640df2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:20.470285 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea602f16-cba9-4ee0-ab57-c98f4e640df2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:20.476252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f3505-fa20-42fe-a18a-345f1d502961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:20.476909 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f3505-fa20-42fe-a18a-345f1d502961 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:20.477184 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f3505-fa20-42fe-a18a-345f1d502961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:20.477451 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f3505-fa20-42fe-a18a-345f1d502961 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:20.478215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f3505-fa20-42fe-a18a-345f1d502961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:20.479821 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f3505-fa20-42fe-a18a-345f1d502961 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:20.490703 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1243/2521] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:17:20.495179 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a99bd2-c4d0-4695-b2df-6e1e11573de4 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:20.505042 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a99bd2-c4d0-4695-b2df-6e1e11573de4 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:20.509682 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cc1aa-8606-4e94-b9d6-9c5bac69ad7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:20.510555 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cc1aa-8606-4e94-b9d6-9c5bac69ad7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:20.510857 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cc1aa-8606-4e94-b9d6-9c5bac69ad7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:20.511125 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cc1aa-8606-4e94-b9d6-9c5bac69ad7f admin admin] PATH_INFO: `/v3/projects/cfa534878738435388abe37d957a888f/users/1f0ebbf061fa4bc5b2f892201e62ece3/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:20.525979 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cc1aa-8606-4e94-b9d6-9c5bac69ad7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa534878738435388abe37d957a888f, user_id=1f0ebbf061fa4bc5b2f892201e62ece3, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:20.528630 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cc1aa-8606-4e94-b9d6-9c5bac69ad7f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:20.598779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1279/2522] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:17:20 2022] PUT /identity/v3/projects/cfa534878738435388abe37d957a888f/users/1f0ebbf061fa4bc5b2f892201e62ece3/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:17:20.608962 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad7844-9c43-470c-bfc2-f6e393282f8a None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:20.609250 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad7844-9c43-470c-bfc2-f6e393282f8a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:20.609553 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad7844-9c43-470c-bfc2-f6e393282f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:20.636312 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-bdad7844-9c43-470c-bfc2-f6e393282f8a None None] MFA Rules not processed for user `1f0ebbf061fa4bc5b2f892201e62ece3`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:17:20.637561 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-bdad7844-9c43-470c-bfc2-f6e393282f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:20.699967 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1244/2523] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:17:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:17:20.704418 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cc1aa-8606-4e94-b9d6-9c5bac69ad7f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:20.764596 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cc1aa-8606-4e94-b9d6-9c5bac69ad7f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:20.769402 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6202b4-220b-4dd1-adab-d642aaf35383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:20.770092 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6202b4-220b-4dd1-adab-d642aaf35383 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:20.770376 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6202b4-220b-4dd1-adab-d642aaf35383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:20.770672 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6202b4-220b-4dd1-adab-d642aaf35383 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:20.771370 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6202b4-220b-4dd1-adab-d642aaf35383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:20.773265 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6202b4-220b-4dd1-adab-d642aaf35383 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:20.860751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1280/2524] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:17:20 2022] POST /identity/v3/projects => generated 369 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:17:20.865052 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad7844-9c43-470c-bfc2-f6e393282f8a None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:20.875829 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad7844-9c43-470c-bfc2-f6e393282f8a None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:20.930198 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49a605-1ec5-46bd-87c0-afad2c3fdd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:20.930886 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49a605-1ec5-46bd-87c0-afad2c3fdd35 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:20.931172 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49a605-1ec5-46bd-87c0-afad2c3fdd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:20.931445 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49a605-1ec5-46bd-87c0-afad2c3fdd35 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:20.932119 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49a605-1ec5-46bd-87c0-afad2c3fdd35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:20.934004 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49a605-1ec5-46bd-87c0-afad2c3fdd35 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:21.009177 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1245/2525] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:17:20 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:17:21.013086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6202b4-220b-4dd1-adab-d642aaf35383 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:21.023906 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6202b4-220b-4dd1-adab-d642aaf35383 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:21.028500 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515bd61-7655-4c41-a9b2-88847b9fe236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:21.029208 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515bd61-7655-4c41-a9b2-88847b9fe236 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:21.029418 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515bd61-7655-4c41-a9b2-88847b9fe236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:21.029694 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515bd61-7655-4c41-a9b2-88847b9fe236 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:21.030405 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515bd61-7655-4c41-a9b2-88847b9fe236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:21.032032 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515bd61-7655-4c41-a9b2-88847b9fe236 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:21.043068 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1281/2526] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:17:21.049341 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49a605-1ec5-46bd-87c0-afad2c3fdd35 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:21.059609 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49a605-1ec5-46bd-87c0-afad2c3fdd35 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:21.064266 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef14c3-26b7-4dce-87e4-ab0d901d1fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:21.065196 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef14c3-26b7-4dce-87e4-ab0d901d1fac admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:21.065477 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef14c3-26b7-4dce-87e4-ab0d901d1fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:21.065753 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef14c3-26b7-4dce-87e4-ab0d901d1fac admin admin] PATH_INFO: `/v3/projects/7f459661a3ce4e4ab959fa0d13221f97/users/4673856e68b54aff85816ee0746c388b/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:21.079904 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef14c3-26b7-4dce-87e4-ab0d901d1fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f459661a3ce4e4ab959fa0d13221f97, user_id=4673856e68b54aff85816ee0746c388b, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:21.083199 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef14c3-26b7-4dce-87e4-ab0d901d1fac admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:21.151715 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1246/2527] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:17:21 2022] PUT /identity/v3/projects/7f459661a3ce4e4ab959fa0d13221f97/users/4673856e68b54aff85816ee0746c388b/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:17:21.155724 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515bd61-7655-4c41-a9b2-88847b9fe236 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:21.166401 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515bd61-7655-4c41-a9b2-88847b9fe236 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:21.220152 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ca4f1-8b3c-4136-9b11-4fc13026f4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:21.220808 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ca4f1-8b3c-4136-9b11-4fc13026f4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:21.221116 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ca4f1-8b3c-4136-9b11-4fc13026f4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:21.221389 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ca4f1-8b3c-4136-9b11-4fc13026f4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:21.222102 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ca4f1-8b3c-4136-9b11-4fc13026f4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:21.224284 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ca4f1-8b3c-4136-9b11-4fc13026f4f1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:21.233741 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1282/2528] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:17:21.238011 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef14c3-26b7-4dce-87e4-ab0d901d1fac admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:21.248971 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef14c3-26b7-4dce-87e4-ab0d901d1fac admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:21.254113 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933be54-050c-4b4d-bc6e-3e136654df2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:21.255028 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933be54-050c-4b4d-bc6e-3e136654df2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:21.255307 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933be54-050c-4b4d-bc6e-3e136654df2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:21.255581 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933be54-050c-4b4d-bc6e-3e136654df2c admin admin] PATH_INFO: `/v3/projects/7f459661a3ce4e4ab959fa0d13221f97/users/4673856e68b54aff85816ee0746c388b/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:21.257568 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933be54-050c-4b4d-bc6e-3e136654df2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f459661a3ce4e4ab959fa0d13221f97, user_id=4673856e68b54aff85816ee0746c388b, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:21.260292 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933be54-050c-4b4d-bc6e-3e136654df2c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:21.271287 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1247/2529] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:17:21 2022] PUT /identity/v3/projects/7f459661a3ce4e4ab959fa0d13221f97/users/4673856e68b54aff85816ee0746c388b/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:17:21.282803 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e8243-2da3-42ad-ae56-9092c1aadc46 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:21.283016 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e8243-2da3-42ad-ae56-9092c1aadc46 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:21.283292 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e8243-2da3-42ad-ae56-9092c1aadc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:21.311768 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-208e8243-2da3-42ad-ae56-9092c1aadc46 None None] MFA Rules not processed for user `4673856e68b54aff85816ee0746c388b`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:17:21.312961 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-208e8243-2da3-42ad-ae56-9092c1aadc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:21.381274 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1283/2530] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:17:21 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:17:21.392085 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933be54-050c-4b4d-bc6e-3e136654df2c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:21.393804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-4933be54-050c-4b4d-bc6e-3e136654df2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:21.453966 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933be54-050c-4b4d-bc6e-3e136654df2c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:21.457892 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2960aaf-20a4-43c1-a606-a81be0161453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:21.458525 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2960aaf-20a4-43c1-a606-a81be0161453 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:21.458843 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2960aaf-20a4-43c1-a606-a81be0161453 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:21.459119 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2960aaf-20a4-43c1-a606-a81be0161453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:21.467874 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2960aaf-20a4-43c1-a606-a81be0161453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:21.469324 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2960aaf-20a4-43c1-a606-a81be0161453 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:21.479246 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1248/2531] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:17:21 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:17:21.590422 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e8243-2da3-42ad-ae56-9092c1aadc46 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:21.591989 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-208e8243-2da3-42ad-ae56-9092c1aadc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:21.604526 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e8243-2da3-42ad-ae56-9092c1aadc46 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:21.608160 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abcb37-5af8-4096-a382-67cb1a47c4f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:21.608796 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abcb37-5af8-4096-a382-67cb1a47c4f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:21.609081 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abcb37-5af8-4096-a382-67cb1a47c4f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:21.609358 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abcb37-5af8-4096-a382-67cb1a47c4f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:21.666170 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abcb37-5af8-4096-a382-67cb1a47c4f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:21.667612 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abcb37-5af8-4096-a382-67cb1a47c4f3 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:21.676674 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1284/2532] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:17:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:17:26.594084 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2960aaf-20a4-43c1-a606-a81be0161453 service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:26.658158 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2960aaf-20a4-43c1-a606-a81be0161453 service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:26.663082 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df13d9b-7f91-4065-8617-aa418bf33915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:26.664000 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df13d9b-7f91-4065-8617-aa418bf33915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:26.664352 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df13d9b-7f91-4065-8617-aa418bf33915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:26.664630 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df13d9b-7f91-4065-8617-aa418bf33915 admin admin] PATH_INFO: `/v3/users/1f0ebbf061fa4bc5b2f892201e62ece3` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:26.665887 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df13d9b-7f91-4065-8617-aa418bf33915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f0ebbf061fa4bc5b2f892201e62ece3)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:26.668058 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df13d9b-7f91-4065-8617-aa418bf33915 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:26.898771 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6df13d9b-7f91-4065-8617-aa418bf33915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f0ebbf061fa4bc5b2f892201e62ece3'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:26.899579 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6df13d9b-7f91-4065-8617-aa418bf33915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f0ebbf061fa4bc5b2f892201e62ece3'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:26.912469 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6df13d9b-7f91-4065-8617-aa418bf33915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f0ebbf061fa4bc5b2f892201e62ece3'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:26.919075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6df13d9b-7f91-4065-8617-aa418bf33915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f0ebbf061fa4bc5b2f892201e62ece3'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:26.986278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6df13d9b-7f91-4065-8617-aa418bf33915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f0ebbf061fa4bc5b2f892201e62ece3'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:26.993290 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1249/2533] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:17:26 2022] DELETE /identity/v3/users/1f0ebbf061fa4bc5b2f892201e62ece3 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:17:26.998159 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c69e7d-0a72-4b19-8800-44753803615e None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:26.998660 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c69e7d-0a72-4b19-8800-44753803615e None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:26.998893 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c69e7d-0a72-4b19-8800-44753803615e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:27.016881 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-e3c69e7d-0a72-4b19-8800-44753803615e None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:17:27.018125 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e3c69e7d-0a72-4b19-8800-44753803615e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:27.075978 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1285/2534] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:17:27.086249 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df13d9b-7f91-4065-8617-aa418bf33915 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:27.087899 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6df13d9b-7f91-4065-8617-aa418bf33915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:27.146392 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df13d9b-7f91-4065-8617-aa418bf33915 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:27.149987 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73069837-cd6f-469d-ae9d-f18de68f14d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:27.150691 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73069837-cd6f-469d-ae9d-f18de68f14d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:27.151002 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73069837-cd6f-469d-ae9d-f18de68f14d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:27.151344 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73069837-cd6f-469d-ae9d-f18de68f14d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:27.160950 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73069837-cd6f-469d-ae9d-f18de68f14d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:27.162582 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73069837-cd6f-469d-ae9d-f18de68f14d9 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:27.173767 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1250/2535] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:17:27.252412 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c002a-56bb-4599-9231-1043455dc747 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:27.252700 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c002a-56bb-4599-9231-1043455dc747 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:27.252973 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c002a-56bb-4599-9231-1043455dc747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:27.271356 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-ab1c002a-56bb-4599-9231-1043455dc747 None None] MFA Rules not processed for user `db53f0b9c80640dc9e93349861182d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:17:27.272643 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-ab1c002a-56bb-4599-9231-1043455dc747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:27.327414 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1286/2536] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:17:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:17:27.564784 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73069837-cd6f-469d-ae9d-f18de68f14d9 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:27.566379 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-73069837-cd6f-469d-ae9d-f18de68f14d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:27.589216 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73069837-cd6f-469d-ae9d-f18de68f14d9 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:27.595533 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155a55e-040a-4278-8ebd-1bd429e88bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:27.596598 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155a55e-040a-4278-8ebd-1bd429e88bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:27.596922 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155a55e-040a-4278-8ebd-1bd429e88bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:27.598144 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155a55e-040a-4278-8ebd-1bd429e88bf9 admin admin] PATH_INFO: `/v3/projects/cfa534878738435388abe37d957a888f` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:27.599528 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155a55e-040a-4278-8ebd-1bd429e88bf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa534878738435388abe37d957a888f)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:27.601556 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155a55e-040a-4278-8ebd-1bd429e88bf9 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:27.700968 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-1155a55e-040a-4278-8ebd-1bd429e88bf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa534878738435388abe37d957a888f', 'request_id': 'req-1155a55e-040a-4278-8ebd-1bd429e88bf9'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:27.791475 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-1155a55e-040a-4278-8ebd-1bd429e88bf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa534878738435388abe37d957a888f', 'request_id': 'req-1155a55e-040a-4278-8ebd-1bd429e88bf9'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:27.797515 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-1155a55e-040a-4278-8ebd-1bd429e88bf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa534878738435388abe37d957a888f', 'request_id': 'req-1155a55e-040a-4278-8ebd-1bd429e88bf9'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:27.809406 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-1155a55e-040a-4278-8ebd-1bd429e88bf9 admin admin] The token cache is being invalidate because project cfa534878738435388abe37d957a888f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:17:27.809690 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-1155a55e-040a-4278-8ebd-1bd429e88bf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:27.810334 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-1155a55e-040a-4278-8ebd-1bd429e88bf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:27.811908 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1251/2537] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:17:27 2022] DELETE /identity/v3/projects/cfa534878738435388abe37d957a888f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:17:27.816308 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c002a-56bb-4599-9231-1043455dc747 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:27.826451 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c002a-56bb-4599-9231-1043455dc747 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:27.886551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70582f1a-04d8-4118-9b41-6495db5eaf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:27.887447 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70582f1a-04d8-4118-9b41-6495db5eaf54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:27.887727 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70582f1a-04d8-4118-9b41-6495db5eaf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:27.888005 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70582f1a-04d8-4118-9b41-6495db5eaf54 admin admin] PATH_INFO: `/v3/users/4673856e68b54aff85816ee0746c388b` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:27.889185 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70582f1a-04d8-4118-9b41-6495db5eaf54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4673856e68b54aff85816ee0746c388b)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:27.891101 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70582f1a-04d8-4118-9b41-6495db5eaf54 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:28.056667 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-70582f1a-04d8-4118-9b41-6495db5eaf54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4673856e68b54aff85816ee0746c388b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:28.067202 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-70582f1a-04d8-4118-9b41-6495db5eaf54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4673856e68b54aff85816ee0746c388b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:28.079218 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-70582f1a-04d8-4118-9b41-6495db5eaf54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4673856e68b54aff85816ee0746c388b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:28.087648 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-70582f1a-04d8-4118-9b41-6495db5eaf54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4673856e68b54aff85816ee0746c388b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:28.088379 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-70582f1a-04d8-4118-9b41-6495db5eaf54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4673856e68b54aff85816ee0746c388b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:28.147142 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1287/2538] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:17:27 2022] DELETE /identity/v3/users/4673856e68b54aff85816ee0746c388b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:17:28.564397 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155a55e-040a-4278-8ebd-1bd429e88bf9 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:28.566511 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-1155a55e-040a-4278-8ebd-1bd429e88bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:28.579485 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155a55e-040a-4278-8ebd-1bd429e88bf9 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:28.637940 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9437ae-6ce2-4f9e-84af-040b347cb61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:28.638823 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9437ae-6ce2-4f9e-84af-040b347cb61a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:28.639109 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9437ae-6ce2-4f9e-84af-040b347cb61a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:28.639383 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9437ae-6ce2-4f9e-84af-040b347cb61a admin admin] PATH_INFO: `/v3/projects/7f459661a3ce4e4ab959fa0d13221f97` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:28.640593 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9437ae-6ce2-4f9e-84af-040b347cb61a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f459661a3ce4e4ab959fa0d13221f97)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:28.642492 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9437ae-6ce2-4f9e-84af-040b347cb61a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:28.762924 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-aa9437ae-6ce2-4f9e-84af-040b347cb61a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f459661a3ce4e4ab959fa0d13221f97', 'request_id': 'req-aa9437ae-6ce2-4f9e-84af-040b347cb61a'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:28.860503 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-aa9437ae-6ce2-4f9e-84af-040b347cb61a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f459661a3ce4e4ab959fa0d13221f97', 'request_id': 'req-aa9437ae-6ce2-4f9e-84af-040b347cb61a'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:28.867271 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-aa9437ae-6ce2-4f9e-84af-040b347cb61a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f459661a3ce4e4ab959fa0d13221f97', 'request_id': 'req-aa9437ae-6ce2-4f9e-84af-040b347cb61a'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:28.878413 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-aa9437ae-6ce2-4f9e-84af-040b347cb61a admin admin] The token cache is being invalidate because project 7f459661a3ce4e4ab959fa0d13221f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:17:28.878836 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-aa9437ae-6ce2-4f9e-84af-040b347cb61a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:28.879478 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-aa9437ae-6ce2-4f9e-84af-040b347cb61a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:28.880988 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1252/2539] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:17:28 2022] DELETE /identity/v3/projects/7f459661a3ce4e4ab959fa0d13221f97 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:17:28.885917 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77797e-2787-4364-b0e8-b2cd6196502c None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:28.886213 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77797e-2787-4364-b0e8-b2cd6196502c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:28.886493 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77797e-2787-4364-b0e8-b2cd6196502c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:28.903911 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-ef77797e-2787-4364-b0e8-b2cd6196502c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:17:28.905224 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-ef77797e-2787-4364-b0e8-b2cd6196502c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:28.963214 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1288/2540] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:17:28.971245 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f3c87-c950-4244-b326-c4aa130e6fda None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:28.971531 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f3c87-c950-4244-b326-c4aa130e6fda None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:28.972324 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f3c87-c950-4244-b326-c4aa130e6fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:28.991928 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-e98f3c87-c950-4244-b326-c4aa130e6fda None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:17:28.993202 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e98f3c87-c950-4244-b326-c4aa130e6fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:29.001525 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1253/2541] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:17:29.005631 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77797e-2787-4364-b0e8-b2cd6196502c None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:29.017858 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77797e-2787-4364-b0e8-b2cd6196502c None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:29.020340 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92bbc9-2b0e-4224-a5da-de8843a4e9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:29.020987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92bbc9-2b0e-4224-a5da-de8843a4e9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:29.021268 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92bbc9-2b0e-4224-a5da-de8843a4e9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:29.021542 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92bbc9-2b0e-4224-a5da-de8843a4e9a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:29.022253 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92bbc9-2b0e-4224-a5da-de8843a4e9a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:17:29.022558 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92bbc9-2b0e-4224-a5da-de8843a4e9a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:29.024176 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92bbc9-2b0e-4224-a5da-de8843a4e9a7 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:29.036313 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1289/2542] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:17:29.040645 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f3c87-c950-4244-b326-c4aa130e6fda None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:29.049524 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f3c87-c950-4244-b326-c4aa130e6fda None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:29.054734 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b8d7c-7103-42d2-99bb-54aa4bb948d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:29.055361 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b8d7c-7103-42d2-99bb-54aa4bb948d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:29.055636 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b8d7c-7103-42d2-99bb-54aa4bb948d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:29.055907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b8d7c-7103-42d2-99bb-54aa4bb948d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:29.056585 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b8d7c-7103-42d2-99bb-54aa4bb948d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:29.058433 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b8d7c-7103-42d2-99bb-54aa4bb948d2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:29.177032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1254/2543] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:17:29 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:17:29.181481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92bbc9-2b0e-4224-a5da-de8843a4e9a7 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:29.191567 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92bbc9-2b0e-4224-a5da-de8843a4e9a7 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:29.247081 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e17cf5-5860-4fe0-a290-338cc7510923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:29.247743 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e17cf5-5860-4fe0-a290-338cc7510923 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:29.248026 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e17cf5-5860-4fe0-a290-338cc7510923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:29.248296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e17cf5-5860-4fe0-a290-338cc7510923 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:29.249086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e17cf5-5860-4fe0-a290-338cc7510923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:29.251058 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e17cf5-5860-4fe0-a290-338cc7510923 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:29.340881 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1290/2544] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:17:29 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:17:29.344946 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b8d7c-7103-42d2-99bb-54aa4bb948d2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:29.356060 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b8d7c-7103-42d2-99bb-54aa4bb948d2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:29.360999 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0db0c-75d7-4ed3-97f6-34e2652b9733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:29.361710 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0db0c-75d7-4ed3-97f6-34e2652b9733 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:29.361987 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0db0c-75d7-4ed3-97f6-34e2652b9733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:29.362256 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0db0c-75d7-4ed3-97f6-34e2652b9733 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:29.363177 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0db0c-75d7-4ed3-97f6-34e2652b9733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:29.364733 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0db0c-75d7-4ed3-97f6-34e2652b9733 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:29.375760 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1255/2545] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:17:29.379862 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e17cf5-5860-4fe0-a290-338cc7510923 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:29.390047 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e17cf5-5860-4fe0-a290-338cc7510923 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:29.395577 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55df47-0e93-4a0c-8623-1c4bcb065bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:29.396231 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55df47-0e93-4a0c-8623-1c4bcb065bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:29.396512 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55df47-0e93-4a0c-8623-1c4bcb065bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:29.396788 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55df47-0e93-4a0c-8623-1c4bcb065bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:29.397499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55df47-0e93-4a0c-8623-1c4bcb065bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:29.399123 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55df47-0e93-4a0c-8623-1c4bcb065bd5 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:29.408901 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1291/2546] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:17:29.413688 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0db0c-75d7-4ed3-97f6-34e2652b9733 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:29.423262 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0db0c-75d7-4ed3-97f6-34e2652b9733 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:29.427853 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bbb00-2af6-491a-9604-80687b6c0087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:29.428706 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bbb00-2af6-491a-9604-80687b6c0087 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:29.428977 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bbb00-2af6-491a-9604-80687b6c0087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:29.429245 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bbb00-2af6-491a-9604-80687b6c0087 admin admin] PATH_INFO: `/v3/projects/0e58780e5569404dbe0ba3b27dcd3be0/users/e8154d8986fd4d1eba558d21e239c565/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:29.449045 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bbb00-2af6-491a-9604-80687b6c0087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e58780e5569404dbe0ba3b27dcd3be0, user_id=e8154d8986fd4d1eba558d21e239c565, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:29.451710 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bbb00-2af6-491a-9604-80687b6c0087 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:29.575285 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1256/2547] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:17:29 2022] PUT /identity/v3/projects/0e58780e5569404dbe0ba3b27dcd3be0/users/e8154d8986fd4d1eba558d21e239c565/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:17:29.585518 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ef4b0-c0d5-4882-833a-61f32b462fcc None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:29.585805 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ef4b0-c0d5-4882-833a-61f32b462fcc None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:29.586229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ef4b0-c0d5-4882-833a-61f32b462fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:29.614977 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-8f0ef4b0-c0d5-4882-833a-61f32b462fcc None None] MFA Rules not processed for user `e8154d8986fd4d1eba558d21e239c565`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:17:29.616194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8f0ef4b0-c0d5-4882-833a-61f32b462fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:29.679283 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1292/2548] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:17:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:17:29.690296 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bbb00-2af6-491a-9604-80687b6c0087 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:29.692247 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-8d4bbb00-2af6-491a-9604-80687b6c0087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:29.747516 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bbb00-2af6-491a-9604-80687b6c0087 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:29.751194 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da0973-3ac6-4fb2-94ef-8bd6327473fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b2c52a60aa499e82129ef29f8907ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:29.751825 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da0973-3ac6-4fb2-94ef-8bd6327473fe service glance] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:29.752104 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da0973-3ac6-4fb2-94ef-8bd6327473fe service glance] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:29.752377 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da0973-3ac6-4fb2-94ef-8bd6327473fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:29.760889 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da0973-3ac6-4fb2-94ef-8bd6327473fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:29.762295 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da0973-3ac6-4fb2-94ef-8bd6327473fe service glance] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:29.771072 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1257/2549] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:17:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:17:45.998536 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ef4b0-c0d5-4882-833a-61f32b462fcc None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:46.000079 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8f0ef4b0-c0d5-4882-833a-61f32b462fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:46.067065 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ef4b0-c0d5-4882-833a-61f32b462fcc None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:46.072036 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b272a77-4d62-45ed-915e-9c7c07809ea8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae711b94b32a431ab880aa8f6068ff25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:46.072671 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b272a77-4d62-45ed-915e-9c7c07809ea8 service placement] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:46.072950 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b272a77-4d62-45ed-915e-9c7c07809ea8 service placement] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:46.073221 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b272a77-4d62-45ed-915e-9c7c07809ea8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:46.074980 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-7b272a77-4d62-45ed-915e-9c7c07809ea8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:46.086787 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b272a77-4d62-45ed-915e-9c7c07809ea8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:46.088435 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b272a77-4d62-45ed-915e-9c7c07809ea8 service placement] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:46.098135 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1293/2550] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:17:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:17:55.375886 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da0973-3ac6-4fb2-94ef-8bd6327473fe service glance] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:55.435016 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da0973-3ac6-4fb2-94ef-8bd6327473fe service glance] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:55.439412 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b7bda-186f-47fb-b7b8-e9ece49f9a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:55.440252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b7bda-186f-47fb-b7b8-e9ece49f9a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:55.440533 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b7bda-186f-47fb-b7b8-e9ece49f9a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:55.440804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b7bda-186f-47fb-b7b8-e9ece49f9a2c admin admin] PATH_INFO: `/v3/users/e8154d8986fd4d1eba558d21e239c565` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:55.441984 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b7bda-186f-47fb-b7b8-e9ece49f9a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8154d8986fd4d1eba558d21e239c565)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:55.443882 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b7bda-186f-47fb-b7b8-e9ece49f9a2c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:55.639422 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-483b7bda-186f-47fb-b7b8-e9ece49f9a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8154d8986fd4d1eba558d21e239c565'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:55.640083 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-483b7bda-186f-47fb-b7b8-e9ece49f9a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8154d8986fd4d1eba558d21e239c565'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:55.652388 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-483b7bda-186f-47fb-b7b8-e9ece49f9a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8154d8986fd4d1eba558d21e239c565'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:55.659082 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-483b7bda-186f-47fb-b7b8-e9ece49f9a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8154d8986fd4d1eba558d21e239c565'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:55.774148 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-483b7bda-186f-47fb-b7b8-e9ece49f9a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8154d8986fd4d1eba558d21e239c565'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:55.782577 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1258/2551] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:17:55 2022] DELETE /identity/v3/users/e8154d8986fd4d1eba558d21e239c565 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:17:55.784933 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd619b-cb1c-40c1-a6a1-6e5581682d20 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:55.785415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd619b-cb1c-40c1-a6a1-6e5581682d20 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:55.785580 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd619b-cb1c-40c1-a6a1-6e5581682d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:55.803036 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-bfcd619b-cb1c-40c1-a6a1-6e5581682d20 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:17:55.804237 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-bfcd619b-cb1c-40c1-a6a1-6e5581682d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:55.863603 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1294/2552] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:17:55.874380 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b7bda-186f-47fb-b7b8-e9ece49f9a2c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:55.875994 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-483b7bda-186f-47fb-b7b8-e9ece49f9a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:55.936699 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b7bda-186f-47fb-b7b8-e9ece49f9a2c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:55.940536 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f24eca-0f6b-4cbf-8fe5-4bc84f83f3dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:55.941178 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f24eca-0f6b-4cbf-8fe5-4bc84f83f3dd service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:55.941456 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f24eca-0f6b-4cbf-8fe5-4bc84f83f3dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:55.942316 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f24eca-0f6b-4cbf-8fe5-4bc84f83f3dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:55.951734 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f24eca-0f6b-4cbf-8fe5-4bc84f83f3dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:55.953149 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f24eca-0f6b-4cbf-8fe5-4bc84f83f3dd service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:55.964191 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1259/2553] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:17:56.383751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd619b-cb1c-40c1-a6a1-6e5581682d20 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:56.385166 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-bfcd619b-cb1c-40c1-a6a1-6e5581682d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:56.399425 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd619b-cb1c-40c1-a6a1-6e5581682d20 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:56.405417 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe0b44-bb24-4c10-b55d-58e94a0f8e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:56.406502 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe0b44-bb24-4c10-b55d-58e94a0f8e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:56.407272 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe0b44-bb24-4c10-b55d-58e94a0f8e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:56.407272 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe0b44-bb24-4c10-b55d-58e94a0f8e87 admin admin] PATH_INFO: `/v3/projects/0e58780e5569404dbe0ba3b27dcd3be0` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:56.412741 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe0b44-bb24-4c10-b55d-58e94a0f8e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e58780e5569404dbe0ba3b27dcd3be0)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:56.412741 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe0b44-bb24-4c10-b55d-58e94a0f8e87 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:56.569529 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-6afe0b44-bb24-4c10-b55d-58e94a0f8e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e58780e5569404dbe0ba3b27dcd3be0', 'request_id': 'req-6afe0b44-bb24-4c10-b55d-58e94a0f8e87'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:56.671081 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-6afe0b44-bb24-4c10-b55d-58e94a0f8e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e58780e5569404dbe0ba3b27dcd3be0', 'request_id': 'req-6afe0b44-bb24-4c10-b55d-58e94a0f8e87'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:56.680819 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-6afe0b44-bb24-4c10-b55d-58e94a0f8e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e58780e5569404dbe0ba3b27dcd3be0', 'request_id': 'req-6afe0b44-bb24-4c10-b55d-58e94a0f8e87'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:56.689656 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-6afe0b44-bb24-4c10-b55d-58e94a0f8e87 admin admin] The token cache is being invalidate because project 0e58780e5569404dbe0ba3b27dcd3be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:17:56.689963 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-6afe0b44-bb24-4c10-b55d-58e94a0f8e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:56.690616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-6afe0b44-bb24-4c10-b55d-58e94a0f8e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:17:56.692621 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1295/2554] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:17:56 2022] DELETE /identity/v3/projects/0e58780e5569404dbe0ba3b27dcd3be0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:17:56.697545 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca4036-94fb-4b50-b94e-925875955bbe None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:56.698219 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca4036-94fb-4b50-b94e-925875955bbe None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:56.698219 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca4036-94fb-4b50-b94e-925875955bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:56.716599 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-0dca4036-94fb-4b50-b94e-925875955bbe None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:17:56.721057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-0dca4036-94fb-4b50-b94e-925875955bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:56.776316 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1260/2555] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:17:56.785230 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f532a7b-902e-4119-9b35-f12ebd900f8c None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:56.786959 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f532a7b-902e-4119-9b35-f12ebd900f8c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:56.786959 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f532a7b-902e-4119-9b35-f12ebd900f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:56.806209 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-2f532a7b-902e-4119-9b35-f12ebd900f8c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:17:56.807518 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2f532a7b-902e-4119-9b35-f12ebd900f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:56.815343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1296/2556] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:17:56.819660 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca4036-94fb-4b50-b94e-925875955bbe None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:56.829497 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca4036-94fb-4b50-b94e-925875955bbe None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:56.841616 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc4d9d-cd29-4ca1-b524-293d7653e75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:56.841616 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc4d9d-cd29-4ca1-b524-293d7653e75e admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:56.841616 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc4d9d-cd29-4ca1-b524-293d7653e75e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:56.841616 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc4d9d-cd29-4ca1-b524-293d7653e75e admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:56.841999 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc4d9d-cd29-4ca1-b524-293d7653e75e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:17:56.841999 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc4d9d-cd29-4ca1-b524-293d7653e75e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:56.841999 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc4d9d-cd29-4ca1-b524-293d7653e75e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:56.851748 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1261/2557] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:17:56.856057 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f532a7b-902e-4119-9b35-f12ebd900f8c None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:56.865286 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f532a7b-902e-4119-9b35-f12ebd900f8c None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:56.870243 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cf1ce-d1d1-480b-8a29-ff1337d95006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:56.870927 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cf1ce-d1d1-480b-8a29-ff1337d95006 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:56.871204 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cf1ce-d1d1-480b-8a29-ff1337d95006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:56.871471 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cf1ce-d1d1-480b-8a29-ff1337d95006 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:56.872156 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5cf1ce-d1d1-480b-8a29-ff1337d95006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:56.874021 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5cf1ce-d1d1-480b-8a29-ff1337d95006 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:56.976458 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1297/2558] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:17:56 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:17:56.980721 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc4d9d-cd29-4ca1-b524-293d7653e75e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:56.991240 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc4d9d-cd29-4ca1-b524-293d7653e75e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:57.046990 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e48dd-7770-41be-8cca-9a69f6405ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:57.047648 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e48dd-7770-41be-8cca-9a69f6405ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:57.047928 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e48dd-7770-41be-8cca-9a69f6405ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:57.048204 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e48dd-7770-41be-8cca-9a69f6405ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:57.048885 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e48dd-7770-41be-8cca-9a69f6405ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:57.050788 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e48dd-7770-41be-8cca-9a69f6405ad4 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:57.128485 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1262/2559] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:17:56 2022] POST /identity/v3/users => generated 285 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:17:57.132711 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cf1ce-d1d1-480b-8a29-ff1337d95006 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:57.142975 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cf1ce-d1d1-480b-8a29-ff1337d95006 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:57.148473 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f4d50-b8a8-4ffd-b2aa-10cee5442ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:57.149118 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f4d50-b8a8-4ffd-b2aa-10cee5442ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:57.149404 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f4d50-b8a8-4ffd-b2aa-10cee5442ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:57.149705 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f4d50-b8a8-4ffd-b2aa-10cee5442ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:57.150456 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f4d50-b8a8-4ffd-b2aa-10cee5442ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:57.152147 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f4d50-b8a8-4ffd-b2aa-10cee5442ce9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:57.163552 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1298/2560] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:17:57.170620 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e48dd-7770-41be-8cca-9a69f6405ad4 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:57.180586 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e48dd-7770-41be-8cca-9a69f6405ad4 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:57.185253 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd5b1b-839d-420d-9919-d530b0d074fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:57.185889 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd5b1b-839d-420d-9919-d530b0d074fa admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:57.186166 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd5b1b-839d-420d-9919-d530b0d074fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:57.186441 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd5b1b-839d-420d-9919-d530b0d074fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:57.187197 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd5b1b-839d-420d-9919-d530b0d074fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:57.188748 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd5b1b-839d-420d-9919-d530b0d074fa admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:57.199131 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1263/2561] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:17:57.203308 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f4d50-b8a8-4ffd-b2aa-10cee5442ce9 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:57.213729 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f4d50-b8a8-4ffd-b2aa-10cee5442ce9 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:57.218412 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba088e3f-72c6-4712-9ccb-922e8ba6808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:57.219313 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba088e3f-72c6-4712-9ccb-922e8ba6808f admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:57.219596 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba088e3f-72c6-4712-9ccb-922e8ba6808f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:57.219874 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba088e3f-72c6-4712-9ccb-922e8ba6808f admin admin] PATH_INFO: `/v3/projects/b6e0e5f0f4004af684573fc2ed5f4f25/users/f281e9c6b18743b9a5ff265fab27c13c/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:57.235453 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba088e3f-72c6-4712-9ccb-922e8ba6808f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e0e5f0f4004af684573fc2ed5f4f25, user_id=f281e9c6b18743b9a5ff265fab27c13c, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:57.238078 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba088e3f-72c6-4712-9ccb-922e8ba6808f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:57.374888 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1299/2562] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:17:57 2022] PUT /identity/v3/projects/b6e0e5f0f4004af684573fc2ed5f4f25/users/f281e9c6b18743b9a5ff265fab27c13c/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:17:57.385683 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83179dd3-f59f-4385-b79a-50c5d562d69a None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:57.388828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83179dd3-f59f-4385-b79a-50c5d562d69a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:57.388828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83179dd3-f59f-4385-b79a-50c5d562d69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:57.413247 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-83179dd3-f59f-4385-b79a-50c5d562d69a None None] MFA Rules not processed for user `f281e9c6b18743b9a5ff265fab27c13c`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:17:57.417485 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-83179dd3-f59f-4385-b79a-50c5d562d69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:57.475934 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1264/2563] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:17:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:17:57.487375 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba088e3f-72c6-4712-9ccb-922e8ba6808f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:17:57.489068 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-ba088e3f-72c6-4712-9ccb-922e8ba6808f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:17:57.546162 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba088e3f-72c6-4712-9ccb-922e8ba6808f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:17:57.549927 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d60c9-22e5-43d9-9887-753cebfeb9fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b2c52a60aa499e82129ef29f8907ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:17:57.550565 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d60c9-22e5-43d9-9887-753cebfeb9fe service glance] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:17:57.550904 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d60c9-22e5-43d9-9887-753cebfeb9fe service glance] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:17:57.551855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d60c9-22e5-43d9-9887-753cebfeb9fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:17:57.560274 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d60c9-22e5-43d9-9887-753cebfeb9fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:17:57.561665 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d60c9-22e5-43d9-9887-753cebfeb9fe service glance] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:17:57.571131 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1300/2564] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:17:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:18:28.409031 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83179dd3-f59f-4385-b79a-50c5d562d69a None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:18:28.410448 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-83179dd3-f59f-4385-b79a-50c5d562d69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:18:28.465754 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83179dd3-f59f-4385-b79a-50c5d562d69a None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:18:28.469350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618148c2-6cac-4a0b-adaa-efbafaf059d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:18:28.469983 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618148c2-6cac-4a0b-adaa-efbafaf059d0 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:18:28.470261 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618148c2-6cac-4a0b-adaa-efbafaf059d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:18:28.470537 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618148c2-6cac-4a0b-adaa-efbafaf059d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:18:28.472331 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-618148c2-6cac-4a0b-adaa-efbafaf059d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:18:28.529620 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618148c2-6cac-4a0b-adaa-efbafaf059d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:18:28.531234 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618148c2-6cac-4a0b-adaa-efbafaf059d0 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:18:28.540395 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1265/2565] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:18:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:18:43.088654 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67db64-9183-421b-bc70-1f09abe42acd None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:18:43.089459 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67db64-9183-421b-bc70-1f09abe42acd None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:18:43.089641 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67db64-9183-421b-bc70-1f09abe42acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:18:43.107875 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-3d67db64-9183-421b-bc70-1f09abe42acd None None] MFA Rules not processed for user `b5ea1801f0674e8297e2cd8a964333d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:18:43.109064 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-3d67db64-9183-421b-bc70-1f09abe42acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:18:43.115911 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1301/2566] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:18:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:18:44.612948 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618148c2-6cac-4a0b-adaa-efbafaf059d0 service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:18:44.674882 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618148c2-6cac-4a0b-adaa-efbafaf059d0 service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:18:44.679481 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d25682-6cd0-4e74-ac58-9d44881e78c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:18:44.680325 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d25682-6cd0-4e74-ac58-9d44881e78c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:18:44.680675 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d25682-6cd0-4e74-ac58-9d44881e78c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:18:44.680956 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d25682-6cd0-4e74-ac58-9d44881e78c8 admin admin] PATH_INFO: `/v3/users/f281e9c6b18743b9a5ff265fab27c13c` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:18:44.682155 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d25682-6cd0-4e74-ac58-9d44881e78c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f281e9c6b18743b9a5ff265fab27c13c)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:18:44.684219 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d25682-6cd0-4e74-ac58-9d44881e78c8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:18:44.833378 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-71d25682-6cd0-4e74-ac58-9d44881e78c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f281e9c6b18743b9a5ff265fab27c13c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:18:44.834037 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-71d25682-6cd0-4e74-ac58-9d44881e78c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f281e9c6b18743b9a5ff265fab27c13c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:18:44.846002 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-71d25682-6cd0-4e74-ac58-9d44881e78c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f281e9c6b18743b9a5ff265fab27c13c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:18:44.852626 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-71d25682-6cd0-4e74-ac58-9d44881e78c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f281e9c6b18743b9a5ff265fab27c13c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:18:44.922497 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-71d25682-6cd0-4e74-ac58-9d44881e78c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f281e9c6b18743b9a5ff265fab27c13c'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:18:44.929309 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1266/2567] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:18:44 2022] DELETE /identity/v3/users/f281e9c6b18743b9a5ff265fab27c13c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:18:44.934254 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6577cf-1a32-48b5-830b-355f4af6439b None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:18:44.934806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6577cf-1a32-48b5-830b-355f4af6439b None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:18:44.934806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6577cf-1a32-48b5-830b-355f4af6439b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:18:44.953097 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-aa6577cf-1a32-48b5-830b-355f4af6439b None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:18:44.954308 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-aa6577cf-1a32-48b5-830b-355f4af6439b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:18:45.014204 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1302/2568] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:18:45.025315 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d25682-6cd0-4e74-ac58-9d44881e78c8 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:18:45.025696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-71d25682-6cd0-4e74-ac58-9d44881e78c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:18:45.084860 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d25682-6cd0-4e74-ac58-9d44881e78c8 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:18:45.088578 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a39720-cf37-4692-b14c-0ed0079d5a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:18:45.089213 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a39720-cf37-4692-b14c-0ed0079d5a01 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:18:45.089490 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a39720-cf37-4692-b14c-0ed0079d5a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:18:45.089892 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a39720-cf37-4692-b14c-0ed0079d5a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:18:45.099161 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a39720-cf37-4692-b14c-0ed0079d5a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:18:45.100783 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a39720-cf37-4692-b14c-0ed0079d5a01 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:18:45.110426 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1267/2569] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:18:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:18:45.523956 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6577cf-1a32-48b5-830b-355f4af6439b None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:18:45.525768 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-aa6577cf-1a32-48b5-830b-355f4af6439b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:18:45.540288 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6577cf-1a32-48b5-830b-355f4af6439b None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:18:45.546076 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3ee06-28b3-4f69-bfdd-de1fed5cc3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:18:45.546999 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3ee06-28b3-4f69-bfdd-de1fed5cc3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:18:45.547278 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3ee06-28b3-4f69-bfdd-de1fed5cc3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:18:45.547604 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3ee06-28b3-4f69-bfdd-de1fed5cc3f6 admin admin] PATH_INFO: `/v3/projects/b6e0e5f0f4004af684573fc2ed5f4f25` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:18:45.548885 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3ee06-28b3-4f69-bfdd-de1fed5cc3f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e0e5f0f4004af684573fc2ed5f4f25)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:18:45.555933 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3ee06-28b3-4f69-bfdd-de1fed5cc3f6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:18:45.688134 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4ad3ee06-28b3-4f69-bfdd-de1fed5cc3f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e0e5f0f4004af684573fc2ed5f4f25', 'request_id': 'req-4ad3ee06-28b3-4f69-bfdd-de1fed5cc3f6'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:18:45.756140 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4ad3ee06-28b3-4f69-bfdd-de1fed5cc3f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e0e5f0f4004af684573fc2ed5f4f25', 'request_id': 'req-4ad3ee06-28b3-4f69-bfdd-de1fed5cc3f6'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:18:45.761890 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4ad3ee06-28b3-4f69-bfdd-de1fed5cc3f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e0e5f0f4004af684573fc2ed5f4f25', 'request_id': 'req-4ad3ee06-28b3-4f69-bfdd-de1fed5cc3f6'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:18:45.774793 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4ad3ee06-28b3-4f69-bfdd-de1fed5cc3f6 admin admin] The token cache is being invalidate because project b6e0e5f0f4004af684573fc2ed5f4f25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:18:45.774793 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4ad3ee06-28b3-4f69-bfdd-de1fed5cc3f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:18:45.774793 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4ad3ee06-28b3-4f69-bfdd-de1fed5cc3f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:18:45.775773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1303/2570] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:18:45 2022] DELETE /identity/v3/projects/b6e0e5f0f4004af684573fc2ed5f4f25 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:18:45.781697 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4b00d-927b-460d-b67b-7dddc4d897fd None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:18:45.782176 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4b00d-927b-460d-b67b-7dddc4d897fd None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:18:45.782281 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4b00d-927b-460d-b67b-7dddc4d897fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:18:45.800652 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-e7e4b00d-927b-460d-b67b-7dddc4d897fd None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:18:45.801866 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e7e4b00d-927b-460d-b67b-7dddc4d897fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:18:45.861826 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1268/2571] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:18:45.919713 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20246a-8adf-45e1-85eb-9ec7310fc586 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:18:45.919999 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20246a-8adf-45e1-85eb-9ec7310fc586 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:18:45.920274 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20246a-8adf-45e1-85eb-9ec7310fc586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:18:45.938943 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-cb20246a-8adf-45e1-85eb-9ec7310fc586 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:18:45.940157 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-cb20246a-8adf-45e1-85eb-9ec7310fc586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:18:45.948766 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1304/2572] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:18:45.952990 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4b00d-927b-460d-b67b-7dddc4d897fd None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:18:45.962450 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4b00d-927b-460d-b67b-7dddc4d897fd None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:18:45.967835 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bea1d3-5b95-4b71-8824-202ef1687768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:18:45.968477 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bea1d3-5b95-4b71-8824-202ef1687768 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:18:45.968755 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bea1d3-5b95-4b71-8824-202ef1687768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:18:45.969027 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bea1d3-5b95-4b71-8824-202ef1687768 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:18:45.969858 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bea1d3-5b95-4b71-8824-202ef1687768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:18:45.970162 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bea1d3-5b95-4b71-8824-202ef1687768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:18:45.971762 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bea1d3-5b95-4b71-8824-202ef1687768 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:18:45.984834 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1269/2573] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:18:45.989115 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20246a-8adf-45e1-85eb-9ec7310fc586 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:18:45.998698 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20246a-8adf-45e1-85eb-9ec7310fc586 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:18:46.003371 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143938c1-2e92-47b1-9c64-4e134e52310a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:18:46.004193 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143938c1-2e92-47b1-9c64-4e134e52310a admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:18:46.004359 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143938c1-2e92-47b1-9c64-4e134e52310a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:18:46.004616 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143938c1-2e92-47b1-9c64-4e134e52310a admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:18:46.005335 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143938c1-2e92-47b1-9c64-4e134e52310a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:18:46.007438 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143938c1-2e92-47b1-9c64-4e134e52310a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:18:46.084440 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1305/2574] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:18:45 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:18:46.088417 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bea1d3-5b95-4b71-8824-202ef1687768 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:18:46.099802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bea1d3-5b95-4b71-8824-202ef1687768 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:18:46.161216 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fd357-3daf-475d-8514-7e993f51875c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:18:46.162067 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fd357-3daf-475d-8514-7e993f51875c admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:18:46.162191 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fd357-3daf-475d-8514-7e993f51875c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:18:46.162417 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fd357-3daf-475d-8514-7e993f51875c admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:18:46.163145 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fd357-3daf-475d-8514-7e993f51875c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:18:46.165080 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fd357-3daf-475d-8514-7e993f51875c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:18:46.288118 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1270/2575] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:18:46 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:18:46.291875 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143938c1-2e92-47b1-9c64-4e134e52310a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:18:46.302843 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143938c1-2e92-47b1-9c64-4e134e52310a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:18:46.308888 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e58677-8e6b-4844-b7e3-f6c3b195a5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:18:46.309846 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e58677-8e6b-4844-b7e3-f6c3b195a5be admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:18:46.310193 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e58677-8e6b-4844-b7e3-f6c3b195a5be admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:18:46.310544 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e58677-8e6b-4844-b7e3-f6c3b195a5be admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:18:46.311391 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e58677-8e6b-4844-b7e3-f6c3b195a5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:18:46.313023 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e58677-8e6b-4844-b7e3-f6c3b195a5be admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:18:46.325400 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1306/2576] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:18:46.328654 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fd357-3daf-475d-8514-7e993f51875c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:18:46.345404 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fd357-3daf-475d-8514-7e993f51875c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:18:46.346088 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef927302-0e93-4626-9d11-364426bb92f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:18:46.346902 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef927302-0e93-4626-9d11-364426bb92f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:18:46.347185 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef927302-0e93-4626-9d11-364426bb92f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:18:46.347456 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef927302-0e93-4626-9d11-364426bb92f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:18:46.348176 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef927302-0e93-4626-9d11-364426bb92f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:18:46.349880 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef927302-0e93-4626-9d11-364426bb92f3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:18:46.360536 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1271/2577] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:18:46.364765 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e58677-8e6b-4844-b7e3-f6c3b195a5be admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:18:46.375937 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e58677-8e6b-4844-b7e3-f6c3b195a5be admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:18:46.390392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ae629-6d79-4180-b83e-6b41233e925f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:18:46.390392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ae629-6d79-4180-b83e-6b41233e925f admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:18:46.390392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ae629-6d79-4180-b83e-6b41233e925f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:18:46.390392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ae629-6d79-4180-b83e-6b41233e925f admin admin] PATH_INFO: `/v3/projects/deb33a8053a14e0ea865ccf02b176607/users/fa81474200f540aeb4ae5a269292c888/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:18:46.397427 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ae629-6d79-4180-b83e-6b41233e925f admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb33a8053a14e0ea865ccf02b176607, user_id=fa81474200f540aeb4ae5a269292c888, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:18:46.400245 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ae629-6d79-4180-b83e-6b41233e925f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:18:46.459413 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1307/2578] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:18:46 2022] PUT /identity/v3/projects/deb33a8053a14e0ea865ccf02b176607/users/fa81474200f540aeb4ae5a269292c888/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:18:46.476720 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee720c64-69b8-49a8-a605-ecaa499d5c9d None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:18:46.476956 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee720c64-69b8-49a8-a605-ecaa499d5c9d None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:18:46.477186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee720c64-69b8-49a8-a605-ecaa499d5c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:18:46.505360 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-ee720c64-69b8-49a8-a605-ecaa499d5c9d None None] MFA Rules not processed for user `fa81474200f540aeb4ae5a269292c888`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:18:46.506558 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-ee720c64-69b8-49a8-a605-ecaa499d5c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:18:46.580865 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1272/2579] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:18:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:18:46.590123 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ae629-6d79-4180-b83e-6b41233e925f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:18:46.591872 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-545ae629-6d79-4180-b83e-6b41233e925f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:18:46.651291 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ae629-6d79-4180-b83e-6b41233e925f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:18:46.655201 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778e9f7-1d2e-476b-b201-c6eca088206a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:18:46.655896 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778e9f7-1d2e-476b-b201-c6eca088206a service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:18:46.656176 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778e9f7-1d2e-476b-b201-c6eca088206a service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:18:46.656444 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778e9f7-1d2e-476b-b201-c6eca088206a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:18:46.665278 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778e9f7-1d2e-476b-b201-c6eca088206a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:18:46.666760 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778e9f7-1d2e-476b-b201-c6eca088206a service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:18:46.676408 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1308/2580] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:18:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:18:49.486186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bb999-8015-4f66-b422-00a106243f5b None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:18:49.486717 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bb999-8015-4f66-b422-00a106243f5b None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:18:49.487104 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bb999-8015-4f66-b422-00a106243f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:18:49.506003 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-640bb999-8015-4f66-b422-00a106243f5b None None] MFA Rules not processed for user `fa81474200f540aeb4ae5a269292c888`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:18:49.507192 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-640bb999-8015-4f66-b422-00a106243f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:18:49.514471 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1273/2581] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:18:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:19:07.218592 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb982b-4e97-4328-8be4-e49ff0768e72 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:07.219121 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb982b-4e97-4328-8be4-e49ff0768e72 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:07.219121 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb982b-4e97-4328-8be4-e49ff0768e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:07.236406 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-54bb982b-4e97-4328-8be4-e49ff0768e72 None None] MFA Rules not processed for user `fa9ea7738c634318a532ebca2e564745`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:19:07.237579 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-54bb982b-4e97-4328-8be4-e49ff0768e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:07.290869 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1309/2582] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Feb 16 17:19:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:19:07.424998 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bb999-8015-4f66-b422-00a106243f5b None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:07.428515 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-640bb999-8015-4f66-b422-00a106243f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:07.495969 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bb999-8015-4f66-b422-00a106243f5b None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:07.501147 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629544cf-f386-48ae-a6e0-3ac3ebbe9923 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc59cb98783b4353a405b8b9a3a9d592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:07.501863 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629544cf-f386-48ae-a6e0-3ac3ebbe9923 service swift] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:07.502217 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629544cf-f386-48ae-a6e0-3ac3ebbe9923 service swift] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:07.502560 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629544cf-f386-48ae-a6e0-3ac3ebbe9923 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:07.511108 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629544cf-f386-48ae-a6e0-3ac3ebbe9923 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:07.512978 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629544cf-f386-48ae-a6e0-3ac3ebbe9923 service swift] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:07.520961 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1274/2583] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Feb 16 17:19:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 17:19:08.301513 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177bc04-e230-4e56-bb87-938f6a70bd61 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:08.301988 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177bc04-e230-4e56-bb87-938f6a70bd61 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:08.302110 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177bc04-e230-4e56-bb87-938f6a70bd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:08.320131 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-2177bc04-e230-4e56-bb87-938f6a70bd61 None None] MFA Rules not processed for user `fa9ea7738c634318a532ebca2e564745`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:19:08.321317 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2177bc04-e230-4e56-bb87-938f6a70bd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:08.329258 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1310/2584] 10.222.0.42 () {58 vars in 967 bytes} [Wed Feb 16 17:19:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:19:08.341441 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629544cf-f386-48ae-a6e0-3ac3ebbe9923 service swift] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:08.351909 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629544cf-f386-48ae-a6e0-3ac3ebbe9923 service swift] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:08.357625 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c58e6-e55d-426e-bef3-59129b052c84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc59cb98783b4353a405b8b9a3a9d592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:08.358255 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c58e6-e55d-426e-bef3-59129b052c84 service swift] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:08.358535 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c58e6-e55d-426e-bef3-59129b052c84 service swift] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:08.358848 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c58e6-e55d-426e-bef3-59129b052c84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:08.367030 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c58e6-e55d-426e-bef3-59129b052c84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:08.368568 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c58e6-e55d-426e-bef3-59129b052c84 service swift] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:08.378005 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1275/2585] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Feb 16 17:19:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 17:19:08.956100 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9164a-3bc1-4c2f-9c17-26382125afd5 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:08.956386 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9164a-3bc1-4c2f-9c17-26382125afd5 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:08.956658 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9164a-3bc1-4c2f-9c17-26382125afd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:08.975332 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-4ff9164a-3bc1-4c2f-9c17-26382125afd5 None None] MFA Rules not processed for user `fa9ea7738c634318a532ebca2e564745`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:19:08.976512 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-4ff9164a-3bc1-4c2f-9c17-26382125afd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:08.984684 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1311/2586] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Feb 16 17:19:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:19:08.996758 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c58e6-e55d-426e-bef3-59129b052c84 service swift] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:09.007000 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c58e6-e55d-426e-bef3-59129b052c84 service swift] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:09.011863 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b9e2d-bff7-4dc9-ad76-7c8dd61b5f6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc59cb98783b4353a405b8b9a3a9d592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:09.012565 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b9e2d-bff7-4dc9-ad76-7c8dd61b5f6f service swift] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:09.012840 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b9e2d-bff7-4dc9-ad76-7c8dd61b5f6f service swift] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:09.013110 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b9e2d-bff7-4dc9-ad76-7c8dd61b5f6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:09.021097 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b9e2d-bff7-4dc9-ad76-7c8dd61b5f6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:09.022623 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b9e2d-bff7-4dc9-ad76-7c8dd61b5f6f service swift] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:09.031306 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1276/2587] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Feb 16 17:19:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 17:19:09.630039 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1bb9f-6ea3-401b-ba6c-96ebd9a52628 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:09.630508 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1bb9f-6ea3-401b-ba6c-96ebd9a52628 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:09.630610 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1bb9f-6ea3-401b-ba6c-96ebd9a52628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:09.649261 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-17f1bb9f-6ea3-401b-ba6c-96ebd9a52628 None None] MFA Rules not processed for user `fa9ea7738c634318a532ebca2e564745`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:19:09.650423 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-17f1bb9f-6ea3-401b-ba6c-96ebd9a52628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:09.658178 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1312/2588] 10.222.0.42 () {58 vars in 967 bytes} [Wed Feb 16 17:19:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:19:09.670138 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b9e2d-bff7-4dc9-ad76-7c8dd61b5f6f service swift] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:09.680338 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b9e2d-bff7-4dc9-ad76-7c8dd61b5f6f service swift] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:09.685660 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed31bb-e8e9-4c69-b98f-3d0e0f9ecc61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc59cb98783b4353a405b8b9a3a9d592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:09.686284 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed31bb-e8e9-4c69-b98f-3d0e0f9ecc61 service swift] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:09.686560 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed31bb-e8e9-4c69-b98f-3d0e0f9ecc61 service swift] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:09.686939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed31bb-e8e9-4c69-b98f-3d0e0f9ecc61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:09.694707 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed31bb-e8e9-4c69-b98f-3d0e0f9ecc61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:09.696255 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed31bb-e8e9-4c69-b98f-3d0e0f9ecc61 service swift] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:09.705418 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1277/2589] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Feb 16 17:19:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 17:19:12.253560 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1bb9f-6ea3-401b-ba6c-96ebd9a52628 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:12.314179 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1bb9f-6ea3-401b-ba6c-96ebd9a52628 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:12.318670 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f9dd8-3c5e-4afe-99ae-f8c1a5baff6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:12.319531 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f9dd8-3c5e-4afe-99ae-f8c1a5baff6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:12.319808 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f9dd8-3c5e-4afe-99ae-f8c1a5baff6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:12.320080 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f9dd8-3c5e-4afe-99ae-f8c1a5baff6a admin admin] PATH_INFO: `/v3/users/fa81474200f540aeb4ae5a269292c888` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:12.321288 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f9dd8-3c5e-4afe-99ae-f8c1a5baff6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa81474200f540aeb4ae5a269292c888)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:12.323198 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f9dd8-3c5e-4afe-99ae-f8c1a5baff6a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:12.473506 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2e9f9dd8-3c5e-4afe-99ae-f8c1a5baff6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa81474200f540aeb4ae5a269292c888'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:12.474162 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2e9f9dd8-3c5e-4afe-99ae-f8c1a5baff6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa81474200f540aeb4ae5a269292c888'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:12.486694 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2e9f9dd8-3c5e-4afe-99ae-f8c1a5baff6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa81474200f540aeb4ae5a269292c888'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:12.493316 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2e9f9dd8-3c5e-4afe-99ae-f8c1a5baff6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa81474200f540aeb4ae5a269292c888'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:12.493968 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2e9f9dd8-3c5e-4afe-99ae-f8c1a5baff6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa81474200f540aeb4ae5a269292c888'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:12.544222 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1313/2590] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:19:12 2022] DELETE /identity/v3/users/fa81474200f540aeb4ae5a269292c888 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:19:12.549242 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de58941-41ad-417e-9b3c-0968f867f871 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:12.549700 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de58941-41ad-417e-9b3c-0968f867f871 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:12.549855 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de58941-41ad-417e-9b3c-0968f867f871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:12.567956 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-3de58941-41ad-417e-9b3c-0968f867f871 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:19:12.569083 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-3de58941-41ad-417e-9b3c-0968f867f871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:12.626796 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1278/2591] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:19:12.636362 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f9dd8-3c5e-4afe-99ae-f8c1a5baff6a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:12.637759 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2e9f9dd8-3c5e-4afe-99ae-f8c1a5baff6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:12.694190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f9dd8-3c5e-4afe-99ae-f8c1a5baff6a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:12.698326 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb261efb-e86c-4a58-b792-c94038ea0806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:12.699005 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb261efb-e86c-4a58-b792-c94038ea0806 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:12.699288 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb261efb-e86c-4a58-b792-c94038ea0806 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:12.699562 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb261efb-e86c-4a58-b792-c94038ea0806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:12.710070 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb261efb-e86c-4a58-b792-c94038ea0806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:12.711536 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb261efb-e86c-4a58-b792-c94038ea0806 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:12.721390 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1314/2592] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:19:12.969897 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de58941-41ad-417e-9b3c-0968f867f871 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:12.971392 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-3de58941-41ad-417e-9b3c-0968f867f871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:12.987786 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de58941-41ad-417e-9b3c-0968f867f871 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:12.993179 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b6f98-73dd-47da-acbc-66d3c5b7c7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:12.994063 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b6f98-73dd-47da-acbc-66d3c5b7c7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:12.994354 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b6f98-73dd-47da-acbc-66d3c5b7c7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:12.994586 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b6f98-73dd-47da-acbc-66d3c5b7c7f7 admin admin] PATH_INFO: `/v3/projects/deb33a8053a14e0ea865ccf02b176607` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:12.996068 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b6f98-73dd-47da-acbc-66d3c5b7c7f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb33a8053a14e0ea865ccf02b176607)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:12.997962 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b6f98-73dd-47da-acbc-66d3c5b7c7f7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:13.132486 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0b4b6f98-73dd-47da-acbc-66d3c5b7c7f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb33a8053a14e0ea865ccf02b176607', 'request_id': 'req-0b4b6f98-73dd-47da-acbc-66d3c5b7c7f7'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:13.224847 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0b4b6f98-73dd-47da-acbc-66d3c5b7c7f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb33a8053a14e0ea865ccf02b176607', 'request_id': 'req-0b4b6f98-73dd-47da-acbc-66d3c5b7c7f7'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:13.231596 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0b4b6f98-73dd-47da-acbc-66d3c5b7c7f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb33a8053a14e0ea865ccf02b176607', 'request_id': 'req-0b4b6f98-73dd-47da-acbc-66d3c5b7c7f7'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:13.244489 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0b4b6f98-73dd-47da-acbc-66d3c5b7c7f7 admin admin] The token cache is being invalidate because project deb33a8053a14e0ea865ccf02b176607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:19:13.244656 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0b4b6f98-73dd-47da-acbc-66d3c5b7c7f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:13.245311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0b4b6f98-73dd-47da-acbc-66d3c5b7c7f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:13.247350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1279/2593] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:19:12 2022] DELETE /identity/v3/projects/deb33a8053a14e0ea865ccf02b176607 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:19:17.965944 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86433d4b-5853-4730-bb58-f19163f71966 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:17.966550 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86433d4b-5853-4730-bb58-f19163f71966 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:17.966924 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86433d4b-5853-4730-bb58-f19163f71966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:17.985730 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-86433d4b-5853-4730-bb58-f19163f71966 None None] MFA Rules not processed for user `fa9ea7738c634318a532ebca2e564745`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:19:17.986966 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-86433d4b-5853-4730-bb58-f19163f71966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:18.049943 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1315/2594] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Feb 16 17:19:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:19:18.062697 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b6f98-73dd-47da-acbc-66d3c5b7c7f7 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:18.064118 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-0b4b6f98-73dd-47da-acbc-66d3c5b7c7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:18.136817 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b6f98-73dd-47da-acbc-66d3c5b7c7f7 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:18.145501 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae86c93-cba5-4347-bcd1-d59d55bca7db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc59cb98783b4353a405b8b9a3a9d592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:18.146161 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae86c93-cba5-4347-bcd1-d59d55bca7db service swift] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:18.146429 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae86c93-cba5-4347-bcd1-d59d55bca7db service swift] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:18.146739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae86c93-cba5-4347-bcd1-d59d55bca7db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:18.157767 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae86c93-cba5-4347-bcd1-d59d55bca7db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:18.159467 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae86c93-cba5-4347-bcd1-d59d55bca7db service swift] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:18.172045 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1280/2595] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Feb 16 17:19:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 17:19:22.177951 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86433d4b-5853-4730-bb58-f19163f71966 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:22.179334 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-86433d4b-5853-4730-bb58-f19163f71966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:22.248172 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86433d4b-5853-4730-bb58-f19163f71966 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:22.252185 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac313e6-cedb-417f-beb1-974696be4cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:22.252825 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac313e6-cedb-417f-beb1-974696be4cdd service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:22.253099 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac313e6-cedb-417f-beb1-974696be4cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:22.253367 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac313e6-cedb-417f-beb1-974696be4cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:22.255216 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-fac313e6-cedb-417f-beb1-974696be4cdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:22.340094 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac313e6-cedb-417f-beb1-974696be4cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:22.341629 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac313e6-cedb-417f-beb1-974696be4cdd service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:22.353461 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1316/2596] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:19:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:19:35.437029 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe75a37-a107-424d-9164-6d5c9fbafd8e None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:35.437616 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe75a37-a107-424d-9164-6d5c9fbafd8e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:35.437616 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe75a37-a107-424d-9164-6d5c9fbafd8e None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:35.439387 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1281/2597] 10.222.0.42 () {54 vars in 921 bytes} [Wed Feb 16 17:19:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:19:35.445883 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502df2a5-d0bc-4e0a-8d1c-c032514dba87 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:35.446454 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502df2a5-d0bc-4e0a-8d1c-c032514dba87 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:35.446601 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502df2a5-d0bc-4e0a-8d1c-c032514dba87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:35.464618 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-502df2a5-d0bc-4e0a-8d1c-c032514dba87 None None] MFA Rules not processed for user `9a30603a236e4681a7702eec7029e9db`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:19:35.465940 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-502df2a5-d0bc-4e0a-8d1c-c032514dba87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:35.549207 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1317/2598] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Feb 16 17:19:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:19:35.564881 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe75a37-a107-424d-9164-6d5c9fbafd8e None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:35.564881 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-efe75a37-a107-424d-9164-6d5c9fbafd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:35.621790 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe75a37-a107-424d-9164-6d5c9fbafd8e None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:35.625593 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574641d2-cd78-4a94-818c-ec3024b31b21 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b2c52a60aa499e82129ef29f8907ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:35.626217 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574641d2-cd78-4a94-818c-ec3024b31b21 service glance] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:35.626493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574641d2-cd78-4a94-818c-ec3024b31b21 service glance] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:35.626804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574641d2-cd78-4a94-818c-ec3024b31b21 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:35.636578 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574641d2-cd78-4a94-818c-ec3024b31b21 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:35.637982 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574641d2-cd78-4a94-818c-ec3024b31b21 service glance] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:35.650452 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1282/2599] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:19:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:19:35.900446 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d303b-0186-41b5-8d38-3f3e54ff0014 None None] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:35.900732 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d303b-0186-41b5-8d38-3f3e54ff0014 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:35.901006 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d303b-0186-41b5-8d38-3f3e54ff0014 None None] PATH_INFO: `/` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:35.902812 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1318/2600] 10.222.0.42 () {54 vars in 921 bytes} [Wed Feb 16 17:19:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:19:35.908141 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b07c2-ad20-415e-929f-0f260426b6f9 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:35.908430 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b07c2-ad20-415e-929f-0f260426b6f9 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:35.908712 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b07c2-ad20-415e-929f-0f260426b6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:35.928558 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-217b07c2-ad20-415e-929f-0f260426b6f9 None None] MFA Rules not processed for user `f6db9534cc094e8281b0aa34e2cb4b46`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:19:35.929791 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-217b07c2-ad20-415e-929f-0f260426b6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:35.937886 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1283/2601] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Feb 16 17:19:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:19:35.949751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d303b-0186-41b5-8d38-3f3e54ff0014 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:35.952249 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-458d303b-0186-41b5-8d38-3f3e54ff0014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:35.965413 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d303b-0186-41b5-8d38-3f3e54ff0014 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:35.968985 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d02b7-8706-4d78-9fdf-042c277dfd8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:35.969724 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d02b7-8706-4d78-9fdf-042c277dfd8f service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:35.970012 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d02b7-8706-4d78-9fdf-042c277dfd8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:35.970285 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d02b7-8706-4d78-9fdf-042c277dfd8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:35.977469 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d02b7-8706-4d78-9fdf-042c277dfd8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:35.978926 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d02b7-8706-4d78-9fdf-042c277dfd8f service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:35.987148 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1319/2602] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:19:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:19:36.082502 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f74a30-46c8-48d2-bce4-46e224e953d4 None None] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:36.082825 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f74a30-46c8-48d2-bce4-46e224e953d4 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:36.083102 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f74a30-46c8-48d2-bce4-46e224e953d4 None None] PATH_INFO: `/` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:36.085124 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1284/2603] 10.222.0.42 () {54 vars in 921 bytes} [Wed Feb 16 17:19:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 17:19:36.093145 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75734114-70c2-4836-907f-c14445a24987 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:36.093434 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75734114-70c2-4836-907f-c14445a24987 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:36.093828 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75734114-70c2-4836-907f-c14445a24987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:36.113782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-75734114-70c2-4836-907f-c14445a24987 None None] MFA Rules not processed for user `9a30603a236e4681a7702eec7029e9db`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:19:36.115062 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-75734114-70c2-4836-907f-c14445a24987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:36.125909 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1320/2604] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Feb 16 17:19:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:19:36.137808 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f74a30-46c8-48d2-bce4-46e224e953d4 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:36.150283 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f74a30-46c8-48d2-bce4-46e224e953d4 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:36.154843 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89cb9f-979f-4dc7-b486-2f1296ce7e76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:36.155585 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89cb9f-979f-4dc7-b486-2f1296ce7e76 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:36.155862 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89cb9f-979f-4dc7-b486-2f1296ce7e76 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:36.156178 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89cb9f-979f-4dc7-b486-2f1296ce7e76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:36.168036 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89cb9f-979f-4dc7-b486-2f1296ce7e76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:36.170822 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89cb9f-979f-4dc7-b486-2f1296ce7e76 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:36.187026 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1285/2605] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:19:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:19:37.838829 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75734114-70c2-4836-907f-c14445a24987 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:37.848532 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75734114-70c2-4836-907f-c14445a24987 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:37.852146 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa61c7d-0b41-4e23-bcf3-5d2a49de0e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:37.852784 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa61c7d-0b41-4e23-bcf3-5d2a49de0e1e service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:37.853060 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa61c7d-0b41-4e23-bcf3-5d2a49de0e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:37.853333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa61c7d-0b41-4e23-bcf3-5d2a49de0e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:37.855137 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0aa61c7d-0b41-4e23-bcf3-5d2a49de0e1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:37.869007 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa61c7d-0b41-4e23-bcf3-5d2a49de0e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:37.870420 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa61c7d-0b41-4e23-bcf3-5d2a49de0e1e service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:37.882142 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1321/2606] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:19:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:19:38.523057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca3c25-51a9-4d28-ac28-291cfbb86ce9 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:38.523550 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca3c25-51a9-4d28-ac28-291cfbb86ce9 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:38.523659 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca3c25-51a9-4d28-ac28-291cfbb86ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:38.543106 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-f8ca3c25-51a9-4d28-ac28-291cfbb86ce9 None None] MFA Rules not processed for user `fa9ea7738c634318a532ebca2e564745`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:19:38.544307 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f8ca3c25-51a9-4d28-ac28-291cfbb86ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:38.553053 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1286/2607] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Feb 16 17:19:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:19:38.566143 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa61c7d-0b41-4e23-bcf3-5d2a49de0e1e service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:38.577801 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa61c7d-0b41-4e23-bcf3-5d2a49de0e1e service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:38.582904 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed919097-2684-4a0b-b39c-c421903cabb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc59cb98783b4353a405b8b9a3a9d592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:38.583554 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed919097-2684-4a0b-b39c-c421903cabb1 service swift] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:38.583837 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed919097-2684-4a0b-b39c-c421903cabb1 service swift] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:38.584111 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed919097-2684-4a0b-b39c-c421903cabb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:38.592851 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed919097-2684-4a0b-b39c-c421903cabb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:38.594433 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed919097-2684-4a0b-b39c-c421903cabb1 service swift] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:38.602740 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1322/2608] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Feb 16 17:19:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 17:19:40.365133 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca3c25-51a9-4d28-ac28-291cfbb86ce9 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:40.375611 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca3c25-51a9-4d28-ac28-291cfbb86ce9 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:40.379530 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bed2d-9b7d-4912-91a2-0919dcaf90cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:40.380168 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bed2d-9b7d-4912-91a2-0919dcaf90cf service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:40.380475 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bed2d-9b7d-4912-91a2-0919dcaf90cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:40.380843 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bed2d-9b7d-4912-91a2-0919dcaf90cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:40.382745 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-489bed2d-9b7d-4912-91a2-0919dcaf90cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:40.397613 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bed2d-9b7d-4912-91a2-0919dcaf90cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:40.399101 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bed2d-9b7d-4912-91a2-0919dcaf90cf service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:40.412999 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1287/2609] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:19:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:19:43.623429 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed919097-2684-4a0b-b39c-c421903cabb1 service swift] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:43.635798 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed919097-2684-4a0b-b39c-c421903cabb1 service swift] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:43.640825 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e9d99-de17-4a73-9925-ef19620cb640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:43.642001 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e9d99-de17-4a73-9925-ef19620cb640 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:43.642326 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e9d99-de17-4a73-9925-ef19620cb640 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:43.642716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e9d99-de17-4a73-9925-ef19620cb640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:43.644703 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-704e9d99-de17-4a73-9925-ef19620cb640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:43.715721 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e9d99-de17-4a73-9925-ef19620cb640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:43.718068 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e9d99-de17-4a73-9925-ef19620cb640 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:43.728753 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1323/2610] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:19:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:19:45.172362 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bed2d-9b7d-4912-91a2-0919dcaf90cf service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:45.174808 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-489bed2d-9b7d-4912-91a2-0919dcaf90cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:45.192917 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bed2d-9b7d-4912-91a2-0919dcaf90cf service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:45.203009 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2ca13-6d68-40d9-b56e-c69ba0795f70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:45.203696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2ca13-6d68-40d9-b56e-c69ba0795f70 service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:45.203985 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2ca13-6d68-40d9-b56e-c69ba0795f70 service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:45.204259 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2ca13-6d68-40d9-b56e-c69ba0795f70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:45.206263 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-37c2ca13-6d68-40d9-b56e-c69ba0795f70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:45.326907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2ca13-6d68-40d9-b56e-c69ba0795f70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:45.328501 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2ca13-6d68-40d9-b56e-c69ba0795f70 service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:45.370259 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1288/2611] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:19:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:19:48.904991 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e9d99-de17-4a73-9925-ef19620cb640 service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:48.906701 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-704e9d99-de17-4a73-9925-ef19620cb640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:48.918917 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e9d99-de17-4a73-9925-ef19620cb640 service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:48.924107 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dbecf-0553-436f-b5c9-c43eb2163e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:48.924976 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dbecf-0553-436f-b5c9-c43eb2163e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:48.925255 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dbecf-0553-436f-b5c9-c43eb2163e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:48.925580 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dbecf-0553-436f-b5c9-c43eb2163e72 admin admin] PATH_INFO: `/v3/users/db53f0b9c80640dc9e93349861182d6f` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:48.939049 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dbecf-0553-436f-b5c9-c43eb2163e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db53f0b9c80640dc9e93349861182d6f)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:48.940908 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dbecf-0553-436f-b5c9-c43eb2163e72 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:49.116779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-965dbecf-0553-436f-b5c9-c43eb2163e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db53f0b9c80640dc9e93349861182d6f'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:49.117427 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-965dbecf-0553-436f-b5c9-c43eb2163e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db53f0b9c80640dc9e93349861182d6f'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:49.129550 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-965dbecf-0553-436f-b5c9-c43eb2163e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db53f0b9c80640dc9e93349861182d6f'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:49.136339 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-965dbecf-0553-436f-b5c9-c43eb2163e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db53f0b9c80640dc9e93349861182d6f'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:49.137043 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-965dbecf-0553-436f-b5c9-c43eb2163e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db53f0b9c80640dc9e93349861182d6f'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:49.209778 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1324/2612] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:19:48 2022] DELETE /identity/v3/users/db53f0b9c80640dc9e93349861182d6f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:19:49.511363 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2ca13-6d68-40d9-b56e-c69ba0795f70 service nova] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:49.523337 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2ca13-6d68-40d9-b56e-c69ba0795f70 service nova] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:49.581150 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698a105-8e78-4f3f-9711-e6afd7e54568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:49.582184 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698a105-8e78-4f3f-9711-e6afd7e54568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:49.582461 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698a105-8e78-4f3f-9711-e6afd7e54568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:49.582764 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698a105-8e78-4f3f-9711-e6afd7e54568 admin admin] PATH_INFO: `/v3/projects/fe5f405ce059489f92848cf0223ed677` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:49.594471 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698a105-8e78-4f3f-9711-e6afd7e54568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe5f405ce059489f92848cf0223ed677)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:49.596407 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698a105-8e78-4f3f-9711-e6afd7e54568 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:49.702605 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-4698a105-8e78-4f3f-9711-e6afd7e54568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe5f405ce059489f92848cf0223ed677', 'request_id': 'req-4698a105-8e78-4f3f-9711-e6afd7e54568'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:49.778493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-4698a105-8e78-4f3f-9711-e6afd7e54568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe5f405ce059489f92848cf0223ed677', 'request_id': 'req-4698a105-8e78-4f3f-9711-e6afd7e54568'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:49.784920 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-4698a105-8e78-4f3f-9711-e6afd7e54568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe5f405ce059489f92848cf0223ed677', 'request_id': 'req-4698a105-8e78-4f3f-9711-e6afd7e54568'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:49.796252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-4698a105-8e78-4f3f-9711-e6afd7e54568 admin admin] The token cache is being invalidate because project fe5f405ce059489f92848cf0223ed677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:19:49.796534 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-4698a105-8e78-4f3f-9711-e6afd7e54568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:49.797176 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-4698a105-8e78-4f3f-9711-e6afd7e54568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:19:49.798744 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1289/2613] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:19:49 2022] DELETE /identity/v3/projects/fe5f405ce059489f92848cf0223ed677 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:19:49.803982 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d8abc-afd3-462d-b46f-736a7147582d None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:49.804272 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d8abc-afd3-462d-b46f-736a7147582d None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:49.804552 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d8abc-afd3-462d-b46f-736a7147582d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:49.828477 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-d00d8abc-afd3-462d-b46f-736a7147582d None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:19:49.829684 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d00d8abc-afd3-462d-b46f-736a7147582d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:49.887357 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1325/2614] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:19:49.896484 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed28633-8dae-4c2e-abe6-845a5f858d9f None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:49.896767 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed28633-8dae-4c2e-abe6-845a5f858d9f None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:49.897065 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed28633-8dae-4c2e-abe6-845a5f858d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:49.916255 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-4ed28633-8dae-4c2e-abe6-845a5f858d9f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:19:49.917490 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-4ed28633-8dae-4c2e-abe6-845a5f858d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:49.925433 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1290/2615] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:19:49.929671 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d8abc-afd3-462d-b46f-736a7147582d None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:49.939207 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d8abc-afd3-462d-b46f-736a7147582d None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:49.943720 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52322f-eab1-4476-8595-6e82ee303a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:49.944353 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52322f-eab1-4476-8595-6e82ee303a29 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:49.944628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52322f-eab1-4476-8595-6e82ee303a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:49.944894 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52322f-eab1-4476-8595-6e82ee303a29 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:49.945593 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52322f-eab1-4476-8595-6e82ee303a29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:19:49.945891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52322f-eab1-4476-8595-6e82ee303a29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:49.947494 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52322f-eab1-4476-8595-6e82ee303a29 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:49.959220 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1326/2616] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:19:49.963414 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed28633-8dae-4c2e-abe6-845a5f858d9f None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:49.973222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed28633-8dae-4c2e-abe6-845a5f858d9f None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:49.978073 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb64b07-8f60-487b-98ba-7c3405b70dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:49.978772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb64b07-8f60-487b-98ba-7c3405b70dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:49.979051 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb64b07-8f60-487b-98ba-7c3405b70dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:49.979323 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb64b07-8f60-487b-98ba-7c3405b70dd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:49.980013 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb64b07-8f60-487b-98ba-7c3405b70dd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:49.982547 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb64b07-8f60-487b-98ba-7c3405b70dd7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:50.111621 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1291/2617] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:19:49 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:19:50.115755 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52322f-eab1-4476-8595-6e82ee303a29 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:50.127230 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52322f-eab1-4476-8595-6e82ee303a29 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:50.180469 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa4e5b-d85a-4d09-855e-0de2a24df6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:50.181118 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa4e5b-d85a-4d09-855e-0de2a24df6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:50.181397 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa4e5b-d85a-4d09-855e-0de2a24df6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:50.181669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa4e5b-d85a-4d09-855e-0de2a24df6a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:50.182351 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa4e5b-d85a-4d09-855e-0de2a24df6a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:50.184276 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa4e5b-d85a-4d09-855e-0de2a24df6a6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:50.270804 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1327/2618] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:19:50 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:19:50.274878 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb64b07-8f60-487b-98ba-7c3405b70dd7 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:50.286559 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb64b07-8f60-487b-98ba-7c3405b70dd7 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:50.291296 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1eb14-8b94-45e5-bd4e-215fa303fb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:50.291934 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1eb14-8b94-45e5-bd4e-215fa303fb5f admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:50.292215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1eb14-8b94-45e5-bd4e-215fa303fb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:50.292493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1eb14-8b94-45e5-bd4e-215fa303fb5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:50.293244 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1eb14-8b94-45e5-bd4e-215fa303fb5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:50.295531 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1eb14-8b94-45e5-bd4e-215fa303fb5f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:50.305691 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1292/2619] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:19:50.309549 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa4e5b-d85a-4d09-855e-0de2a24df6a6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:50.319523 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa4e5b-d85a-4d09-855e-0de2a24df6a6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:50.324169 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe281ea2-42bf-4da8-9842-cf7263a4363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:50.324816 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe281ea2-42bf-4da8-9842-cf7263a4363c admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:50.325098 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe281ea2-42bf-4da8-9842-cf7263a4363c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:50.325377 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe281ea2-42bf-4da8-9842-cf7263a4363c admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:50.326119 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe281ea2-42bf-4da8-9842-cf7263a4363c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:50.327746 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe281ea2-42bf-4da8-9842-cf7263a4363c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:50.342088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1328/2620] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:19:50.343344 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1eb14-8b94-45e5-bd4e-215fa303fb5f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:50.353276 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1eb14-8b94-45e5-bd4e-215fa303fb5f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:50.359446 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898d11b-d7ec-47c7-b564-81008bd887c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:50.359886 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898d11b-d7ec-47c7-b564-81008bd887c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:50.360167 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898d11b-d7ec-47c7-b564-81008bd887c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:50.360440 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898d11b-d7ec-47c7-b564-81008bd887c5 admin admin] PATH_INFO: `/v3/projects/c4495f3a51b74cfa9f648a6d6969d80d/users/e8f72eec89074f38bb39fe2d90649bee/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:50.375913 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898d11b-d7ec-47c7-b564-81008bd887c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4495f3a51b74cfa9f648a6d6969d80d, user_id=e8f72eec89074f38bb39fe2d90649bee, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:50.378532 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898d11b-d7ec-47c7-b564-81008bd887c5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:50.453512 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1293/2621] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:19:50 2022] PUT /identity/v3/projects/c4495f3a51b74cfa9f648a6d6969d80d/users/e8f72eec89074f38bb39fe2d90649bee/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:19:50.463693 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bb9ee-e014-454d-894e-472c305fa6f3 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:50.463986 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bb9ee-e014-454d-894e-472c305fa6f3 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:50.464265 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bb9ee-e014-454d-894e-472c305fa6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:50.497054 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-d73bb9ee-e014-454d-894e-472c305fa6f3 None None] MFA Rules not processed for user `e8f72eec89074f38bb39fe2d90649bee`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:19:50.498442 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d73bb9ee-e014-454d-894e-472c305fa6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:50.559821 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1329/2622] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:19:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:19:50.564483 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898d11b-d7ec-47c7-b564-81008bd887c5 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:50.628314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898d11b-d7ec-47c7-b564-81008bd887c5 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:50.633343 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165edfd-e125-49c6-b323-073d5683d288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:50.634095 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165edfd-e125-49c6-b323-073d5683d288 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:50.634385 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165edfd-e125-49c6-b323-073d5683d288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:50.634687 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165edfd-e125-49c6-b323-073d5683d288 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:50.635415 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165edfd-e125-49c6-b323-073d5683d288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:50.637429 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165edfd-e125-49c6-b323-073d5683d288 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:50.719738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1294/2623] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:19:50 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:19:50.724017 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bb9ee-e014-454d-894e-472c305fa6f3 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:50.735975 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bb9ee-e014-454d-894e-472c305fa6f3 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:50.793189 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8378f3a-ede7-4181-94ca-dcd69c592b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:50.793885 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8378f3a-ede7-4181-94ca-dcd69c592b27 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:50.794260 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8378f3a-ede7-4181-94ca-dcd69c592b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:50.794536 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8378f3a-ede7-4181-94ca-dcd69c592b27 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:50.795265 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8378f3a-ede7-4181-94ca-dcd69c592b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:50.797202 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8378f3a-ede7-4181-94ca-dcd69c592b27 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:50.858226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1330/2624] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:19:50 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:19:50.862460 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165edfd-e125-49c6-b323-073d5683d288 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:50.873822 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165edfd-e125-49c6-b323-073d5683d288 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:50.878559 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3352a-4c9c-4c73-b7d2-29d81fbf5f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:50.879226 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3352a-4c9c-4c73-b7d2-29d81fbf5f88 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:50.879510 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3352a-4c9c-4c73-b7d2-29d81fbf5f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:50.879785 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3352a-4c9c-4c73-b7d2-29d81fbf5f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:50.880506 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3352a-4c9c-4c73-b7d2-29d81fbf5f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:50.882146 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3352a-4c9c-4c73-b7d2-29d81fbf5f88 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:50.893461 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1295/2625] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:19:50.897806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8378f3a-ede7-4181-94ca-dcd69c592b27 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:50.908067 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8378f3a-ede7-4181-94ca-dcd69c592b27 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:50.912959 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0286e42-2879-45ae-87d9-a12ada80d307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:50.913840 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0286e42-2879-45ae-87d9-a12ada80d307 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:50.914150 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0286e42-2879-45ae-87d9-a12ada80d307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:50.914444 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0286e42-2879-45ae-87d9-a12ada80d307 admin admin] PATH_INFO: `/v3/projects/ded708b388d544938068c95013ed662e/users/85dc123856924221b5d1d31407095a35/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:50.929232 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0286e42-2879-45ae-87d9-a12ada80d307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded708b388d544938068c95013ed662e, user_id=85dc123856924221b5d1d31407095a35, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:50.932050 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0286e42-2879-45ae-87d9-a12ada80d307 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:50.977966 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1331/2626] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:19:50 2022] PUT /identity/v3/projects/ded708b388d544938068c95013ed662e/users/85dc123856924221b5d1d31407095a35/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:19:50.981994 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3352a-4c9c-4c73-b7d2-29d81fbf5f88 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:50.992078 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3352a-4c9c-4c73-b7d2-29d81fbf5f88 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:51.046739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d58cd-81d9-4fc2-8a7e-432a72901ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:51.047387 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d58cd-81d9-4fc2-8a7e-432a72901ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:51.047661 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d58cd-81d9-4fc2-8a7e-432a72901ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:51.047930 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d58cd-81d9-4fc2-8a7e-432a72901ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:51.048641 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d58cd-81d9-4fc2-8a7e-432a72901ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:51.050291 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d58cd-81d9-4fc2-8a7e-432a72901ce3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:51.059603 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1296/2627] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:19:51.064278 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0286e42-2879-45ae-87d9-a12ada80d307 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:51.074505 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0286e42-2879-45ae-87d9-a12ada80d307 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:51.079832 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfb59b-08cf-4df1-97ca-cfd65b04c931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:51.080698 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfb59b-08cf-4df1-97ca-cfd65b04c931 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:51.080974 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfb59b-08cf-4df1-97ca-cfd65b04c931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:51.081246 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfb59b-08cf-4df1-97ca-cfd65b04c931 admin admin] PATH_INFO: `/v3/projects/ded708b388d544938068c95013ed662e/users/85dc123856924221b5d1d31407095a35/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:51.083235 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfb59b-08cf-4df1-97ca-cfd65b04c931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded708b388d544938068c95013ed662e, user_id=85dc123856924221b5d1d31407095a35, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:51.085859 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfb59b-08cf-4df1-97ca-cfd65b04c931 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:51.096003 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1332/2628] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:19:51 2022] PUT /identity/v3/projects/ded708b388d544938068c95013ed662e/users/85dc123856924221b5d1d31407095a35/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:19:51.105834 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75048f72-5545-480e-a426-7eff8841faa8 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:51.106123 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75048f72-5545-480e-a426-7eff8841faa8 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:51.106400 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75048f72-5545-480e-a426-7eff8841faa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:51.137758 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-75048f72-5545-480e-a426-7eff8841faa8 None None] MFA Rules not processed for user `85dc123856924221b5d1d31407095a35`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:19:51.137758 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-75048f72-5545-480e-a426-7eff8841faa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:51.197738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1297/2629] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:19:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:19:51.208438 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfb59b-08cf-4df1-97ca-cfd65b04c931 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:51.210138 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0adfb59b-08cf-4df1-97ca-cfd65b04c931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:19:51.265685 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfb59b-08cf-4df1-97ca-cfd65b04c931 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:51.269468 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd2b1c-9d0a-47fc-b6d0-625469d7b0c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:51.270103 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2b1c-9d0a-47fc-b6d0-625469d7b0c5 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:51.270430 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2b1c-9d0a-47fc-b6d0-625469d7b0c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:51.270762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2b1c-9d0a-47fc-b6d0-625469d7b0c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:51.279720 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd2b1c-9d0a-47fc-b6d0-625469d7b0c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:51.281130 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd2b1c-9d0a-47fc-b6d0-625469d7b0c5 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:51.291079 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1333/2630] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:19:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:19:51.474594 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75048f72-5545-480e-a426-7eff8841faa8 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:19:51.484834 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75048f72-5545-480e-a426-7eff8841faa8 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:19:51.488405 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5161a69-a124-4102-adf2-f6027401fa80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:19:51.489023 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5161a69-a124-4102-adf2-f6027401fa80 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:19:51.489298 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5161a69-a124-4102-adf2-f6027401fa80 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:19:51.489564 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5161a69-a124-4102-adf2-f6027401fa80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:19:51.555972 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5161a69-a124-4102-adf2-f6027401fa80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:19:51.557373 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5161a69-a124-4102-adf2-f6027401fa80 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:19:51.567294 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1298/2631] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:19:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:20:02.857849 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd2b1c-9d0a-47fc-b6d0-625469d7b0c5 service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:02.859372 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-85dd2b1c-9d0a-47fc-b6d0-625469d7b0c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:02.915995 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd2b1c-9d0a-47fc-b6d0-625469d7b0c5 service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:02.919835 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d101c6-80db-4393-8927-66f35b5acb5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:02.920471 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d101c6-80db-4393-8927-66f35b5acb5f service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:02.920780 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d101c6-80db-4393-8927-66f35b5acb5f service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:02.921058 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d101c6-80db-4393-8927-66f35b5acb5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:02.923596 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-92d101c6-80db-4393-8927-66f35b5acb5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:02.934003 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d101c6-80db-4393-8927-66f35b5acb5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:02.935601 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d101c6-80db-4393-8927-66f35b5acb5f service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:02.944349 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1334/2632] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:20:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:20:03.953227 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5161a69-a124-4102-adf2-f6027401fa80 service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:04.017233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5161a69-a124-4102-adf2-f6027401fa80 service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:04.021745 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e0576-159b-4155-a820-a5ac63d0ade5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:04.022589 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e0576-159b-4155-a820-a5ac63d0ade5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:04.022899 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e0576-159b-4155-a820-a5ac63d0ade5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:04.023161 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e0576-159b-4155-a820-a5ac63d0ade5 admin admin] PATH_INFO: `/v3/users/e8f72eec89074f38bb39fe2d90649bee` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:04.024320 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e0576-159b-4155-a820-a5ac63d0ade5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8f72eec89074f38bb39fe2d90649bee)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:04.026205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e0576-159b-4155-a820-a5ac63d0ade5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:04.166314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f54e0576-159b-4155-a820-a5ac63d0ade5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8f72eec89074f38bb39fe2d90649bee'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:04.167032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f54e0576-159b-4155-a820-a5ac63d0ade5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8f72eec89074f38bb39fe2d90649bee'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:04.179350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f54e0576-159b-4155-a820-a5ac63d0ade5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8f72eec89074f38bb39fe2d90649bee'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:04.185845 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f54e0576-159b-4155-a820-a5ac63d0ade5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8f72eec89074f38bb39fe2d90649bee'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:04.252623 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f54e0576-159b-4155-a820-a5ac63d0ade5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8f72eec89074f38bb39fe2d90649bee'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:04.267094 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1299/2633] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:20:03 2022] DELETE /identity/v3/users/e8f72eec89074f38bb39fe2d90649bee => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:20:04.271608 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122371c-1001-42ed-a8df-559402ca5ec0 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:04.272092 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122371c-1001-42ed-a8df-559402ca5ec0 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:04.272188 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122371c-1001-42ed-a8df-559402ca5ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:04.290313 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-a122371c-1001-42ed-a8df-559402ca5ec0 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:20:04.292147 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a122371c-1001-42ed-a8df-559402ca5ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:04.349248 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1335/2634] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:20:04.358837 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e0576-159b-4155-a820-a5ac63d0ade5 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:04.360241 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f54e0576-159b-4155-a820-a5ac63d0ade5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:04.418866 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e0576-159b-4155-a820-a5ac63d0ade5 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:04.422519 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da384b-7f8f-4885-8d03-9fd277ae4e26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:04.423210 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da384b-7f8f-4885-8d03-9fd277ae4e26 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:04.427218 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da384b-7f8f-4885-8d03-9fd277ae4e26 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:04.427218 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da384b-7f8f-4885-8d03-9fd277ae4e26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:04.433666 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da384b-7f8f-4885-8d03-9fd277ae4e26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:04.435120 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da384b-7f8f-4885-8d03-9fd277ae4e26 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:04.444905 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1300/2635] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:20:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:20:04.475460 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302992d6-e393-4946-87d6-6db4bb270783 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:04.475752 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302992d6-e393-4946-87d6-6db4bb270783 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:04.476058 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302992d6-e393-4946-87d6-6db4bb270783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:04.495667 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-302992d6-e393-4946-87d6-6db4bb270783 None None] MFA Rules not processed for user `fa9ea7738c634318a532ebca2e564745`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:20:04.497192 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-302992d6-e393-4946-87d6-6db4bb270783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:04.560338 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1336/2636] 10.222.0.42 () {58 vars in 967 bytes} [Wed Feb 16 17:20:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:20:04.573463 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da384b-7f8f-4885-8d03-9fd277ae4e26 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:04.575379 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-49da384b-7f8f-4885-8d03-9fd277ae4e26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:04.647612 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da384b-7f8f-4885-8d03-9fd277ae4e26 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:04.652897 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc611254-2be9-4b7d-8874-b3be8e866932 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc59cb98783b4353a405b8b9a3a9d592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:04.653538 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc611254-2be9-4b7d-8874-b3be8e866932 service swift] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:04.653821 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc611254-2be9-4b7d-8874-b3be8e866932 service swift] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:04.654096 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc611254-2be9-4b7d-8874-b3be8e866932 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:04.662845 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc611254-2be9-4b7d-8874-b3be8e866932 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:04.664415 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc611254-2be9-4b7d-8874-b3be8e866932 service swift] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:04.672492 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1301/2637] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Feb 16 17:20:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 17:20:04.991645 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302992d6-e393-4946-87d6-6db4bb270783 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:04.993269 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-302992d6-e393-4946-87d6-6db4bb270783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:05.008481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302992d6-e393-4946-87d6-6db4bb270783 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:05.017575 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cf74d-e666-41e7-a1a0-5fb806c8a1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:05.018998 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cf74d-e666-41e7-a1a0-5fb806c8a1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:05.019343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cf74d-e666-41e7-a1a0-5fb806c8a1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:05.019717 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cf74d-e666-41e7-a1a0-5fb806c8a1f0 admin admin] PATH_INFO: `/v3/projects/c4495f3a51b74cfa9f648a6d6969d80d` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:05.024494 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cf74d-e666-41e7-a1a0-5fb806c8a1f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4495f3a51b74cfa9f648a6d6969d80d)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:05.026538 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cf74d-e666-41e7-a1a0-5fb806c8a1f0 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:05.138611 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5f1cf74d-e666-41e7-a1a0-5fb806c8a1f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4495f3a51b74cfa9f648a6d6969d80d', 'request_id': 'req-5f1cf74d-e666-41e7-a1a0-5fb806c8a1f0'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:05.206109 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5f1cf74d-e666-41e7-a1a0-5fb806c8a1f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4495f3a51b74cfa9f648a6d6969d80d', 'request_id': 'req-5f1cf74d-e666-41e7-a1a0-5fb806c8a1f0'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:05.212082 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5f1cf74d-e666-41e7-a1a0-5fb806c8a1f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4495f3a51b74cfa9f648a6d6969d80d', 'request_id': 'req-5f1cf74d-e666-41e7-a1a0-5fb806c8a1f0'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:05.223408 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5f1cf74d-e666-41e7-a1a0-5fb806c8a1f0 admin admin] The token cache is being invalidate because project c4495f3a51b74cfa9f648a6d6969d80d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:20:05.223692 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5f1cf74d-e666-41e7-a1a0-5fb806c8a1f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:05.224323 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-5f1cf74d-e666-41e7-a1a0-5fb806c8a1f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:05.225845 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1337/2638] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:20:04 2022] DELETE /identity/v3/projects/c4495f3a51b74cfa9f648a6d6969d80d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:20:05.229831 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc611254-2be9-4b7d-8874-b3be8e866932 service swift] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:05.240144 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc611254-2be9-4b7d-8874-b3be8e866932 service swift] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:05.296609 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9a50a-1a45-48dc-96a7-66086c87ecfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:05.297472 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9a50a-1a45-48dc-96a7-66086c87ecfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:05.297755 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9a50a-1a45-48dc-96a7-66086c87ecfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:05.298025 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9a50a-1a45-48dc-96a7-66086c87ecfc admin admin] PATH_INFO: `/v3/users/85dc123856924221b5d1d31407095a35` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:05.299347 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9a50a-1a45-48dc-96a7-66086c87ecfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=85dc123856924221b5d1d31407095a35)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:05.301296 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9a50a-1a45-48dc-96a7-66086c87ecfc admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:05.552781 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-19a9a50a-1a45-48dc-96a7-66086c87ecfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85dc123856924221b5d1d31407095a35'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:05.553411 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-19a9a50a-1a45-48dc-96a7-66086c87ecfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85dc123856924221b5d1d31407095a35'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:05.565825 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-19a9a50a-1a45-48dc-96a7-66086c87ecfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85dc123856924221b5d1d31407095a35'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:05.575994 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-19a9a50a-1a45-48dc-96a7-66086c87ecfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85dc123856924221b5d1d31407095a35'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:05.669377 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-19a9a50a-1a45-48dc-96a7-66086c87ecfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85dc123856924221b5d1d31407095a35'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:05.676777 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1302/2639] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:20:05 2022] DELETE /identity/v3/users/85dc123856924221b5d1d31407095a35 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:20:06.088079 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cf74d-e666-41e7-a1a0-5fb806c8a1f0 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:06.089760 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5f1cf74d-e666-41e7-a1a0-5fb806c8a1f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:06.105058 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cf74d-e666-41e7-a1a0-5fb806c8a1f0 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:06.163665 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157aaca0-7a61-408b-a7df-a7c3c6b990f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:06.164514 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157aaca0-7a61-408b-a7df-a7c3c6b990f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:06.164892 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157aaca0-7a61-408b-a7df-a7c3c6b990f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:06.165150 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157aaca0-7a61-408b-a7df-a7c3c6b990f4 admin admin] PATH_INFO: `/v3/projects/ded708b388d544938068c95013ed662e` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:06.166324 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157aaca0-7a61-408b-a7df-a7c3c6b990f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ded708b388d544938068c95013ed662e)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:06.168313 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157aaca0-7a61-408b-a7df-a7c3c6b990f4 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:06.268154 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-157aaca0-7a61-408b-a7df-a7c3c6b990f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ded708b388d544938068c95013ed662e', 'request_id': 'req-157aaca0-7a61-408b-a7df-a7c3c6b990f4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:06.325236 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-157aaca0-7a61-408b-a7df-a7c3c6b990f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ded708b388d544938068c95013ed662e', 'request_id': 'req-157aaca0-7a61-408b-a7df-a7c3c6b990f4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:06.331376 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-157aaca0-7a61-408b-a7df-a7c3c6b990f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ded708b388d544938068c95013ed662e', 'request_id': 'req-157aaca0-7a61-408b-a7df-a7c3c6b990f4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:06.341975 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-157aaca0-7a61-408b-a7df-a7c3c6b990f4 admin admin] The token cache is being invalidate because project ded708b388d544938068c95013ed662e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:20:06.342259 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-157aaca0-7a61-408b-a7df-a7c3c6b990f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:06.342911 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-157aaca0-7a61-408b-a7df-a7c3c6b990f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:06.344428 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1338/2640] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:20:06 2022] DELETE /identity/v3/projects/ded708b388d544938068c95013ed662e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:20:06.350582 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7394f1-3a41-48fe-b3dc-e774dc0e9a4c None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:06.351086 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7394f1-3a41-48fe-b3dc-e774dc0e9a4c None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:06.351200 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7394f1-3a41-48fe-b3dc-e774dc0e9a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:06.369279 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-be7394f1-3a41-48fe-b3dc-e774dc0e9a4c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:20:06.370504 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-be7394f1-3a41-48fe-b3dc-e774dc0e9a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:06.429752 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1303/2641] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:20:06.438924 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a34991-aea1-4ffe-bb4a-9df780915834 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:06.439277 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a34991-aea1-4ffe-bb4a-9df780915834 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:06.439557 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a34991-aea1-4ffe-bb4a-9df780915834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:06.458991 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-64a34991-aea1-4ffe-bb4a-9df780915834 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:20:06.460173 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-64a34991-aea1-4ffe-bb4a-9df780915834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:06.468088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1339/2642] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:20:06.472524 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7394f1-3a41-48fe-b3dc-e774dc0e9a4c None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:06.482031 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7394f1-3a41-48fe-b3dc-e774dc0e9a4c None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:06.487083 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89483a98-b143-4bc5-bc19-2ed13732ba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:06.487711 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89483a98-b143-4bc5-bc19-2ed13732ba79 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:06.487987 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89483a98-b143-4bc5-bc19-2ed13732ba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:06.488256 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89483a98-b143-4bc5-bc19-2ed13732ba79 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:06.488964 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89483a98-b143-4bc5-bc19-2ed13732ba79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:20:06.489268 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89483a98-b143-4bc5-bc19-2ed13732ba79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:06.490861 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89483a98-b143-4bc5-bc19-2ed13732ba79 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:06.502905 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1304/2643] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 17:20:06.507218 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a34991-aea1-4ffe-bb4a-9df780915834 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:06.516300 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a34991-aea1-4ffe-bb4a-9df780915834 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:06.521634 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5531db9-6d33-45cf-8f45-d10b3aa38882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:06.522302 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5531db9-6d33-45cf-8f45-d10b3aa38882 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:06.522573 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5531db9-6d33-45cf-8f45-d10b3aa38882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:06.522882 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5531db9-6d33-45cf-8f45-d10b3aa38882 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:06.523571 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5531db9-6d33-45cf-8f45-d10b3aa38882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:06.525447 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5531db9-6d33-45cf-8f45-d10b3aa38882 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:06.614392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1340/2644] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:20:06 2022] POST /identity/v3/projects => generated 407 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:20:06.619402 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89483a98-b143-4bc5-bc19-2ed13732ba79 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:06.629446 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89483a98-b143-4bc5-bc19-2ed13732ba79 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:06.682597 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687c1fe-e2a2-4281-8b41-d9ee3d0288de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:06.683278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687c1fe-e2a2-4281-8b41-d9ee3d0288de admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:06.683554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687c1fe-e2a2-4281-8b41-d9ee3d0288de admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:06.683824 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687c1fe-e2a2-4281-8b41-d9ee3d0288de admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:06.684506 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687c1fe-e2a2-4281-8b41-d9ee3d0288de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:06.686380 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687c1fe-e2a2-4281-8b41-d9ee3d0288de admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:06.772940 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1305/2645] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:20:06 2022] POST /identity/v3/users => generated 304 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:20:06.777388 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5531db9-6d33-45cf-8f45-d10b3aa38882 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:06.788029 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5531db9-6d33-45cf-8f45-d10b3aa38882 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:06.792689 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e219dad-a029-4e46-8093-3a25c1b3242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:06.793339 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e219dad-a029-4e46-8093-3a25c1b3242f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:06.793620 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e219dad-a029-4e46-8093-3a25c1b3242f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:06.793894 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e219dad-a029-4e46-8093-3a25c1b3242f admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:06.794604 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e219dad-a029-4e46-8093-3a25c1b3242f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:06.796211 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e219dad-a029-4e46-8093-3a25c1b3242f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:06.806689 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1341/2646] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:20:06.810504 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687c1fe-e2a2-4281-8b41-d9ee3d0288de admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:06.821298 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687c1fe-e2a2-4281-8b41-d9ee3d0288de admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:06.826223 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936d1ec-e475-4758-9ce2-d5d93cc69a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:06.826907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936d1ec-e475-4758-9ce2-d5d93cc69a8a admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:06.827332 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936d1ec-e475-4758-9ce2-d5d93cc69a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:06.827450 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936d1ec-e475-4758-9ce2-d5d93cc69a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:06.828202 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936d1ec-e475-4758-9ce2-d5d93cc69a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:06.830436 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936d1ec-e475-4758-9ce2-d5d93cc69a8a admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:06.840257 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1306/2647] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:20:06.844478 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e219dad-a029-4e46-8093-3a25c1b3242f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:06.854498 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e219dad-a029-4e46-8093-3a25c1b3242f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:06.859311 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbf073-070c-4f8d-8012-d198ef199093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:06.860185 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbf073-070c-4f8d-8012-d198ef199093 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:06.860471 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbf073-070c-4f8d-8012-d198ef199093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:06.860756 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbf073-070c-4f8d-8012-d198ef199093 admin admin] PATH_INFO: `/v3/projects/beb0d05aa107446082b34e5d3742e2a9/users/3b35fdc689104846a7d9b61b31e4654f/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:06.875886 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbf073-070c-4f8d-8012-d198ef199093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb0d05aa107446082b34e5d3742e2a9, user_id=3b35fdc689104846a7d9b61b31e4654f, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:06.879067 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbf073-070c-4f8d-8012-d198ef199093 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:06.948412 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1342/2648] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:20:06 2022] PUT /identity/v3/projects/beb0d05aa107446082b34e5d3742e2a9/users/3b35fdc689104846a7d9b61b31e4654f/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:20:06.958793 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4fe16-547a-41fa-9568-5466cace2cac None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:06.959084 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4fe16-547a-41fa-9568-5466cace2cac None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:06.959361 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4fe16-547a-41fa-9568-5466cace2cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:06.988017 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-55f4fe16-547a-41fa-9568-5466cace2cac None None] MFA Rules not processed for user `3b35fdc689104846a7d9b61b31e4654f`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:20:06.989222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-55f4fe16-547a-41fa-9568-5466cace2cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:07.052323 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1307/2649] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:20:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:20:07.056912 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbf073-070c-4f8d-8012-d198ef199093 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:07.116700 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbf073-070c-4f8d-8012-d198ef199093 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:07.121826 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499c5f7-4a03-4881-a1b0-6e9130cec609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:07.122506 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499c5f7-4a03-4881-a1b0-6e9130cec609 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:07.122829 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499c5f7-4a03-4881-a1b0-6e9130cec609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:07.123190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499c5f7-4a03-4881-a1b0-6e9130cec609 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:07.123813 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499c5f7-4a03-4881-a1b0-6e9130cec609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:07.125706 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499c5f7-4a03-4881-a1b0-6e9130cec609 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:07.224902 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1343/2650] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:20:07 2022] POST /identity/v3/projects => generated 409 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:20:07.229148 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4fe16-547a-41fa-9568-5466cace2cac None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:07.240537 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4fe16-547a-41fa-9568-5466cace2cac None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:07.296312 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2185c7-00f2-4247-a9bf-9093e847b0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:07.296968 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2185c7-00f2-4247-a9bf-9093e847b0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:07.297243 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2185c7-00f2-4247-a9bf-9093e847b0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:07.297511 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2185c7-00f2-4247-a9bf-9093e847b0a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:07.298831 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2185c7-00f2-4247-a9bf-9093e847b0a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:07.300769 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2185c7-00f2-4247-a9bf-9093e847b0a2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:07.372669 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1308/2651] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:20:07 2022] POST /identity/v3/users => generated 311 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:20:07.376773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499c5f7-4a03-4881-a1b0-6e9130cec609 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:07.387262 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499c5f7-4a03-4881-a1b0-6e9130cec609 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:07.392149 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fc1c3-7742-46e4-a383-4cc71e260699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:07.392838 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fc1c3-7742-46e4-a383-4cc71e260699 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:07.393208 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fc1c3-7742-46e4-a383-4cc71e260699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:07.393487 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fc1c3-7742-46e4-a383-4cc71e260699 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:07.394250 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fc1c3-7742-46e4-a383-4cc71e260699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:07.395891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fc1c3-7742-46e4-a383-4cc71e260699 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:07.406353 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1344/2652] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:20:07.411119 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2185c7-00f2-4247-a9bf-9093e847b0a2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:07.421756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2185c7-00f2-4247-a9bf-9093e847b0a2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:07.427241 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce63d64-b6c1-4adc-9d83-2e19d052254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:07.428098 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce63d64-b6c1-4adc-9d83-2e19d052254c admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:07.428374 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce63d64-b6c1-4adc-9d83-2e19d052254c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:07.428644 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce63d64-b6c1-4adc-9d83-2e19d052254c admin admin] PATH_INFO: `/v3/projects/235f07c586784d4eab2afadeeef95fa1/users/557cc931fbae47fc866b99018489eb06/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:07.442769 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce63d64-b6c1-4adc-9d83-2e19d052254c admin admin] RBAC: Authorizing `identity:create_grant(project_id=235f07c586784d4eab2afadeeef95fa1, user_id=557cc931fbae47fc866b99018489eb06, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:07.445353 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce63d64-b6c1-4adc-9d83-2e19d052254c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:07.492149 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1309/2653] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:20:07 2022] PUT /identity/v3/projects/235f07c586784d4eab2afadeeef95fa1/users/557cc931fbae47fc866b99018489eb06/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:20:07.496401 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fc1c3-7742-46e4-a383-4cc71e260699 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:07.506418 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fc1c3-7742-46e4-a383-4cc71e260699 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:07.562401 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18166c-d0a2-4541-a654-69b6c5282a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:07.563084 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18166c-d0a2-4541-a654-69b6c5282a2d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:07.563362 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18166c-d0a2-4541-a654-69b6c5282a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:07.563632 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18166c-d0a2-4541-a654-69b6c5282a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:07.564458 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18166c-d0a2-4541-a654-69b6c5282a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:07.566024 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18166c-d0a2-4541-a654-69b6c5282a2d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:07.575746 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1345/2654] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:20:07.579831 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce63d64-b6c1-4adc-9d83-2e19d052254c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:07.589776 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce63d64-b6c1-4adc-9d83-2e19d052254c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:07.594349 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df528cde-5782-4711-a125-746b60cbab9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:07.595747 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df528cde-5782-4711-a125-746b60cbab9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:07.596020 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df528cde-5782-4711-a125-746b60cbab9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:07.596287 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df528cde-5782-4711-a125-746b60cbab9b admin admin] PATH_INFO: `/v3/projects/235f07c586784d4eab2afadeeef95fa1/users/557cc931fbae47fc866b99018489eb06/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:07.598211 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df528cde-5782-4711-a125-746b60cbab9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=235f07c586784d4eab2afadeeef95fa1, user_id=557cc931fbae47fc866b99018489eb06, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:07.600797 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df528cde-5782-4711-a125-746b60cbab9b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:07.610520 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1310/2655] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:20:07 2022] PUT /identity/v3/projects/235f07c586784d4eab2afadeeef95fa1/users/557cc931fbae47fc866b99018489eb06/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:20:07.622397 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2aed52-8d08-4daa-a0ee-010a5dfd88e4 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:07.622710 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2aed52-8d08-4daa-a0ee-010a5dfd88e4 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:07.622987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2aed52-8d08-4daa-a0ee-010a5dfd88e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:07.648898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-3d2aed52-8d08-4daa-a0ee-010a5dfd88e4 None None] MFA Rules not processed for user `557cc931fbae47fc866b99018489eb06`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:20:07.650123 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-3d2aed52-8d08-4daa-a0ee-010a5dfd88e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:07.715642 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1346/2656] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:20:07 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:20:07.726699 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df528cde-5782-4711-a125-746b60cbab9b admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:07.728460 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-df528cde-5782-4711-a125-746b60cbab9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:07.783922 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df528cde-5782-4711-a125-746b60cbab9b admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:07.787560 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6cd0d-bb45-49e2-9276-3bf6e89e16fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:07.788244 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6cd0d-bb45-49e2-9276-3bf6e89e16fb service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:07.788522 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6cd0d-bb45-49e2-9276-3bf6e89e16fb service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:07.788794 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6cd0d-bb45-49e2-9276-3bf6e89e16fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:07.797735 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6cd0d-bb45-49e2-9276-3bf6e89e16fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:07.799217 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6cd0d-bb45-49e2-9276-3bf6e89e16fb service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:07.808417 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1311/2657] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:20:07 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:20:08.155060 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2aed52-8d08-4daa-a0ee-010a5dfd88e4 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:08.164769 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2aed52-8d08-4daa-a0ee-010a5dfd88e4 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:08.168517 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5707109-ca4a-4d52-8048-a7cf50e67830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:08.169141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5707109-ca4a-4d52-8048-a7cf50e67830 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:08.169430 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5707109-ca4a-4d52-8048-a7cf50e67830 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:08.169727 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5707109-ca4a-4d52-8048-a7cf50e67830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:08.224774 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5707109-ca4a-4d52-8048-a7cf50e67830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:08.226204 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5707109-ca4a-4d52-8048-a7cf50e67830 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:08.234798 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1347/2658] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:20:08 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:20:19.091195 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6cd0d-bb45-49e2-9276-3bf6e89e16fb service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:19.153146 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6cd0d-bb45-49e2-9276-3bf6e89e16fb service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:19.157729 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13417c6c-105b-4ef0-9e6d-1205a78fc8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:19.158580 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417c6c-105b-4ef0-9e6d-1205a78fc8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:19.158890 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417c6c-105b-4ef0-9e6d-1205a78fc8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:19.159195 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417c6c-105b-4ef0-9e6d-1205a78fc8c8 admin admin] PATH_INFO: `/v3/users/3b35fdc689104846a7d9b61b31e4654f` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:19.160384 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13417c6c-105b-4ef0-9e6d-1205a78fc8c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b35fdc689104846a7d9b61b31e4654f)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:19.162310 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13417c6c-105b-4ef0-9e6d-1205a78fc8c8 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:19.351188 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-13417c6c-105b-4ef0-9e6d-1205a78fc8c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b35fdc689104846a7d9b61b31e4654f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:19.351954 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-13417c6c-105b-4ef0-9e6d-1205a78fc8c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b35fdc689104846a7d9b61b31e4654f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:19.363837 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-13417c6c-105b-4ef0-9e6d-1205a78fc8c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b35fdc689104846a7d9b61b31e4654f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:19.370330 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-13417c6c-105b-4ef0-9e6d-1205a78fc8c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b35fdc689104846a7d9b61b31e4654f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:19.423490 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-13417c6c-105b-4ef0-9e6d-1205a78fc8c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b35fdc689104846a7d9b61b31e4654f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:19.430484 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1312/2659] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:20:19 2022] DELETE /identity/v3/users/3b35fdc689104846a7d9b61b31e4654f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:20:19.435206 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c709ca-6cfc-4044-9173-87d105b4ea18 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:19.439912 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c709ca-6cfc-4044-9173-87d105b4ea18 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:19.439912 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c709ca-6cfc-4044-9173-87d105b4ea18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:19.453026 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-f0c709ca-6cfc-4044-9173-87d105b4ea18 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:20:19.454226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f0c709ca-6cfc-4044-9173-87d105b4ea18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:19.514676 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1348/2660] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:20:19.525171 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13417c6c-105b-4ef0-9e6d-1205a78fc8c8 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:19.526663 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-13417c6c-105b-4ef0-9e6d-1205a78fc8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:19.583147 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13417c6c-105b-4ef0-9e6d-1205a78fc8c8 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:19.586860 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a7606-4b11-4bd9-877d-fe326dc30951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:19.587438 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a7606-4b11-4bd9-877d-fe326dc30951 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:19.587734 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a7606-4b11-4bd9-877d-fe326dc30951 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:19.588008 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a7606-4b11-4bd9-877d-fe326dc30951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:19.597922 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a7606-4b11-4bd9-877d-fe326dc30951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:19.599456 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a7606-4b11-4bd9-877d-fe326dc30951 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:19.608744 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1313/2661] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:20:19.995377 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c709ca-6cfc-4044-9173-87d105b4ea18 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:19.997181 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f0c709ca-6cfc-4044-9173-87d105b4ea18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:20.010048 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c709ca-6cfc-4044-9173-87d105b4ea18 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:20.014789 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb23991-5e8b-41bf-ad46-5d202e6b5a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:20.015646 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb23991-5e8b-41bf-ad46-5d202e6b5a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:20.015935 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb23991-5e8b-41bf-ad46-5d202e6b5a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:20.016214 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb23991-5e8b-41bf-ad46-5d202e6b5a0a admin admin] PATH_INFO: `/v3/projects/beb0d05aa107446082b34e5d3742e2a9` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:20.018208 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb23991-5e8b-41bf-ad46-5d202e6b5a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb0d05aa107446082b34e5d3742e2a9)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:20.020152 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb23991-5e8b-41bf-ad46-5d202e6b5a0a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:20.178870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-abb23991-5e8b-41bf-ad46-5d202e6b5a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb0d05aa107446082b34e5d3742e2a9', 'request_id': 'req-abb23991-5e8b-41bf-ad46-5d202e6b5a0a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:20.263649 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-abb23991-5e8b-41bf-ad46-5d202e6b5a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb0d05aa107446082b34e5d3742e2a9', 'request_id': 'req-abb23991-5e8b-41bf-ad46-5d202e6b5a0a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:20.271136 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-abb23991-5e8b-41bf-ad46-5d202e6b5a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb0d05aa107446082b34e5d3742e2a9', 'request_id': 'req-abb23991-5e8b-41bf-ad46-5d202e6b5a0a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:20.282674 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-abb23991-5e8b-41bf-ad46-5d202e6b5a0a admin admin] The token cache is being invalidate because project beb0d05aa107446082b34e5d3742e2a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:20:20.282991 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-abb23991-5e8b-41bf-ad46-5d202e6b5a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:20.283691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-abb23991-5e8b-41bf-ad46-5d202e6b5a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:20.285228 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1349/2662] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:20:19 2022] DELETE /identity/v3/projects/beb0d05aa107446082b34e5d3742e2a9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:20:20.289635 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a7606-4b11-4bd9-877d-fe326dc30951 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:20.299599 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a7606-4b11-4bd9-877d-fe326dc30951 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:20.364145 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd94309-90a7-4ea1-8c69-2e45a8477ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:20.365051 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd94309-90a7-4ea1-8c69-2e45a8477ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:20.365334 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd94309-90a7-4ea1-8c69-2e45a8477ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:20.365626 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd94309-90a7-4ea1-8c69-2e45a8477ae6 admin admin] PATH_INFO: `/v3/users/557cc931fbae47fc866b99018489eb06` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:20.366844 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd94309-90a7-4ea1-8c69-2e45a8477ae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=557cc931fbae47fc866b99018489eb06)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:20.368750 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd94309-90a7-4ea1-8c69-2e45a8477ae6 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:20.559038 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-2bd94309-90a7-4ea1-8c69-2e45a8477ae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '557cc931fbae47fc866b99018489eb06'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:20.559731 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-2bd94309-90a7-4ea1-8c69-2e45a8477ae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '557cc931fbae47fc866b99018489eb06'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:20.572131 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-2bd94309-90a7-4ea1-8c69-2e45a8477ae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '557cc931fbae47fc866b99018489eb06'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:20.579039 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-2bd94309-90a7-4ea1-8c69-2e45a8477ae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '557cc931fbae47fc866b99018489eb06'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:20.646212 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-2bd94309-90a7-4ea1-8c69-2e45a8477ae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '557cc931fbae47fc866b99018489eb06'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:20.652811 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1314/2663] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:20:20 2022] DELETE /identity/v3/users/557cc931fbae47fc866b99018489eb06 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:20:21.054157 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb23991-5e8b-41bf-ad46-5d202e6b5a0a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:21.055609 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-abb23991-5e8b-41bf-ad46-5d202e6b5a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:21.069279 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb23991-5e8b-41bf-ad46-5d202e6b5a0a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:21.126287 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ee662-b666-4ff1-972c-7cfff3a41030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:21.127682 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ee662-b666-4ff1-972c-7cfff3a41030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:21.127958 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ee662-b666-4ff1-972c-7cfff3a41030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:21.128229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ee662-b666-4ff1-972c-7cfff3a41030 admin admin] PATH_INFO: `/v3/projects/235f07c586784d4eab2afadeeef95fa1` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:21.129404 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ee662-b666-4ff1-972c-7cfff3a41030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=235f07c586784d4eab2afadeeef95fa1)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:21.131314 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ee662-b666-4ff1-972c-7cfff3a41030 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:21.245575 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4c2ee662-b666-4ff1-972c-7cfff3a41030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '235f07c586784d4eab2afadeeef95fa1', 'request_id': 'req-4c2ee662-b666-4ff1-972c-7cfff3a41030'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:21.331913 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4c2ee662-b666-4ff1-972c-7cfff3a41030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '235f07c586784d4eab2afadeeef95fa1', 'request_id': 'req-4c2ee662-b666-4ff1-972c-7cfff3a41030'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:21.337763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4c2ee662-b666-4ff1-972c-7cfff3a41030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '235f07c586784d4eab2afadeeef95fa1', 'request_id': 'req-4c2ee662-b666-4ff1-972c-7cfff3a41030'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:21.349261 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4c2ee662-b666-4ff1-972c-7cfff3a41030 admin admin] The token cache is being invalidate because project 235f07c586784d4eab2afadeeef95fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:20:21.349864 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4c2ee662-b666-4ff1-972c-7cfff3a41030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:21.350200 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4c2ee662-b666-4ff1-972c-7cfff3a41030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:21.351761 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1350/2664] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:20:21 2022] DELETE /identity/v3/projects/235f07c586784d4eab2afadeeef95fa1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:20:21.356727 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d3288-7943-48b0-be0a-b494a5ee506a None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:21.357201 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d3288-7943-48b0-be0a-b494a5ee506a None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:21.357314 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d3288-7943-48b0-be0a-b494a5ee506a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:21.375657 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-272d3288-7943-48b0-be0a-b494a5ee506a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:20:21.376939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-272d3288-7943-48b0-be0a-b494a5ee506a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:21.433658 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1315/2665] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:20:21.441678 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad81259-5456-490e-9d3c-8455242f73a4 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:21.441964 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad81259-5456-490e-9d3c-8455242f73a4 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:21.442236 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad81259-5456-490e-9d3c-8455242f73a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:21.460327 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-5ad81259-5456-490e-9d3c-8455242f73a4 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:20:21.461498 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5ad81259-5456-490e-9d3c-8455242f73a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:21.469154 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1351/2666] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:20:21.473863 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d3288-7943-48b0-be0a-b494a5ee506a None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:21.483361 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d3288-7943-48b0-be0a-b494a5ee506a None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:21.488532 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc15f0-1cc2-4e56-8c50-c107ff7b60e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:21.489207 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc15f0-1cc2-4e56-8c50-c107ff7b60e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:21.489485 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc15f0-1cc2-4e56-8c50-c107ff7b60e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:21.489756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc15f0-1cc2-4e56-8c50-c107ff7b60e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:21.490469 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc15f0-1cc2-4e56-8c50-c107ff7b60e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:20:21.490809 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc15f0-1cc2-4e56-8c50-c107ff7b60e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:21.492375 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc15f0-1cc2-4e56-8c50-c107ff7b60e3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:21.505361 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1316/2667] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:20:21.509548 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad81259-5456-490e-9d3c-8455242f73a4 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:21.519490 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad81259-5456-490e-9d3c-8455242f73a4 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:21.524237 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e5c43-26d8-44cd-8273-019658f0e32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:21.524882 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e5c43-26d8-44cd-8273-019658f0e32d admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:21.525165 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e5c43-26d8-44cd-8273-019658f0e32d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:21.525441 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e5c43-26d8-44cd-8273-019658f0e32d admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:21.526133 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e5c43-26d8-44cd-8273-019658f0e32d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:21.528049 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e5c43-26d8-44cd-8273-019658f0e32d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:21.613955 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1352/2668] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:20:21 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:20:21.622145 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc15f0-1cc2-4e56-8c50-c107ff7b60e3 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:21.632603 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc15f0-1cc2-4e56-8c50-c107ff7b60e3 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:21.688276 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ab967-465b-4e85-a32a-a0d1bb145c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:21.688926 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ab967-465b-4e85-a32a-a0d1bb145c0c admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:21.689866 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ab967-465b-4e85-a32a-a0d1bb145c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:21.690185 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ab967-465b-4e85-a32a-a0d1bb145c0c admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:21.690914 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ab967-465b-4e85-a32a-a0d1bb145c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:21.692781 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ab967-465b-4e85-a32a-a0d1bb145c0c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:21.777356 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1317/2669] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:20:21 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:20:21.781539 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e5c43-26d8-44cd-8273-019658f0e32d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:21.792558 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e5c43-26d8-44cd-8273-019658f0e32d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:21.797199 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f8a00-3a62-4127-b4e6-22b0ec0143ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:21.797840 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f8a00-3a62-4127-b4e6-22b0ec0143ef admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:21.798125 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f8a00-3a62-4127-b4e6-22b0ec0143ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:21.798403 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f8a00-3a62-4127-b4e6-22b0ec0143ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:21.799443 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f8a00-3a62-4127-b4e6-22b0ec0143ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:21.803461 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f8a00-3a62-4127-b4e6-22b0ec0143ef admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:21.811266 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1353/2670] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:20:21.815933 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ab967-465b-4e85-a32a-a0d1bb145c0c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:21.825804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ab967-465b-4e85-a32a-a0d1bb145c0c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:21.831215 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d34506-adaf-4ecf-8c8b-d1f5e2b6d7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:21.831877 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d34506-adaf-4ecf-8c8b-d1f5e2b6d7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:21.832160 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d34506-adaf-4ecf-8c8b-d1f5e2b6d7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:21.832545 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d34506-adaf-4ecf-8c8b-d1f5e2b6d7d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:21.833271 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d34506-adaf-4ecf-8c8b-d1f5e2b6d7d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:21.834863 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d34506-adaf-4ecf-8c8b-d1f5e2b6d7d4 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:21.844531 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1318/2671] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:20:21.848787 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f8a00-3a62-4127-b4e6-22b0ec0143ef admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:21.858561 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f8a00-3a62-4127-b4e6-22b0ec0143ef admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:21.863917 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ba046-ce22-4bd9-9f7a-92dffe29fca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:21.864826 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ba046-ce22-4bd9-9f7a-92dffe29fca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:21.865047 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ba046-ce22-4bd9-9f7a-92dffe29fca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:21.865318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ba046-ce22-4bd9-9f7a-92dffe29fca1 admin admin] PATH_INFO: `/v3/projects/b556337964ba4fa5bcde2ddacc7cff8a/users/b16411f8d75343e2a5a4a588058b0cf2/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:21.880105 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ba046-ce22-4bd9-9f7a-92dffe29fca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b556337964ba4fa5bcde2ddacc7cff8a, user_id=b16411f8d75343e2a5a4a588058b0cf2, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:21.882812 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ba046-ce22-4bd9-9f7a-92dffe29fca1 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:21.953699 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1354/2672] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:20:21 2022] PUT /identity/v3/projects/b556337964ba4fa5bcde2ddacc7cff8a/users/b16411f8d75343e2a5a4a588058b0cf2/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:20:21.964108 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ee864-1ac8-48a5-89e0-5c9e905189d7 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:21.964395 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ee864-1ac8-48a5-89e0-5c9e905189d7 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:21.964693 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ee864-1ac8-48a5-89e0-5c9e905189d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:21.990718 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-d98ee864-1ac8-48a5-89e0-5c9e905189d7 None None] MFA Rules not processed for user `b16411f8d75343e2a5a4a588058b0cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:20:21.991920 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d98ee864-1ac8-48a5-89e0-5c9e905189d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:22.052837 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1319/2673] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:20:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:20:22.057440 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ba046-ce22-4bd9-9f7a-92dffe29fca1 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:22.116088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ba046-ce22-4bd9-9f7a-92dffe29fca1 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:22.120618 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a93ea-9e9a-4144-9bb9-fbed267d37b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:22.121523 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a93ea-9e9a-4144-9bb9-fbed267d37b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:22.121801 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a93ea-9e9a-4144-9bb9-fbed267d37b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:22.122074 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a93ea-9e9a-4144-9bb9-fbed267d37b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:22.122777 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a93ea-9e9a-4144-9bb9-fbed267d37b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:22.124656 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a93ea-9e9a-4144-9bb9-fbed267d37b6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:22.254900 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1355/2674] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:20:22 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:20:22.259182 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ee864-1ac8-48a5-89e0-5c9e905189d7 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:22.272054 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ee864-1ac8-48a5-89e0-5c9e905189d7 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:22.327331 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7016cbf-d9b2-4633-8d3c-17a6dd55e011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:22.327990 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7016cbf-d9b2-4633-8d3c-17a6dd55e011 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:22.328268 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7016cbf-d9b2-4633-8d3c-17a6dd55e011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:22.328537 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7016cbf-d9b2-4633-8d3c-17a6dd55e011 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:22.329225 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7016cbf-d9b2-4633-8d3c-17a6dd55e011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:22.331271 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7016cbf-d9b2-4633-8d3c-17a6dd55e011 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:22.394928 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1320/2675] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:20:22 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:20:22.398818 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a93ea-9e9a-4144-9bb9-fbed267d37b6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:22.409917 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a93ea-9e9a-4144-9bb9-fbed267d37b6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:22.414712 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500f681-206a-4b50-ae41-3467d265d0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:22.415381 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500f681-206a-4b50-ae41-3467d265d0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:22.415701 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500f681-206a-4b50-ae41-3467d265d0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:22.416027 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500f681-206a-4b50-ae41-3467d265d0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:22.416769 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500f681-206a-4b50-ae41-3467d265d0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:22.418375 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500f681-206a-4b50-ae41-3467d265d0e6 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:22.429704 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1356/2676] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:20:22.435756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7016cbf-d9b2-4633-8d3c-17a6dd55e011 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:22.444316 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7016cbf-d9b2-4633-8d3c-17a6dd55e011 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:22.448960 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45069ea9-1c31-4b10-ba2d-3df2202ba49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:22.449858 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45069ea9-1c31-4b10-ba2d-3df2202ba49e admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:22.450138 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45069ea9-1c31-4b10-ba2d-3df2202ba49e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:22.450446 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45069ea9-1c31-4b10-ba2d-3df2202ba49e admin admin] PATH_INFO: `/v3/projects/9f1225a8ad5849bb84443cc2d26358b1/users/03cf13360f014dfab88f1dadd6651b24/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:22.464934 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45069ea9-1c31-4b10-ba2d-3df2202ba49e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f1225a8ad5849bb84443cc2d26358b1, user_id=03cf13360f014dfab88f1dadd6651b24, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:22.467651 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45069ea9-1c31-4b10-ba2d-3df2202ba49e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:22.549860 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1321/2677] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:20:22 2022] PUT /identity/v3/projects/9f1225a8ad5849bb84443cc2d26358b1/users/03cf13360f014dfab88f1dadd6651b24/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:20:22.553861 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500f681-206a-4b50-ae41-3467d265d0e6 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:22.564191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500f681-206a-4b50-ae41-3467d265d0e6 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:22.619891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80308597-1bee-41d3-817a-f615de379b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:22.620566 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80308597-1bee-41d3-817a-f615de379b0e admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:22.620833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80308597-1bee-41d3-817a-f615de379b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:22.621375 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80308597-1bee-41d3-817a-f615de379b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:22.622083 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80308597-1bee-41d3-817a-f615de379b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:22.623692 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80308597-1bee-41d3-817a-f615de379b0e admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:22.633424 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1357/2678] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:20:22.637699 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45069ea9-1c31-4b10-ba2d-3df2202ba49e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:22.648622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45069ea9-1c31-4b10-ba2d-3df2202ba49e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:22.653167 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa801b4d-03d9-4de5-9826-c25562eda553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:22.654035 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa801b4d-03d9-4de5-9826-c25562eda553 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:22.654315 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa801b4d-03d9-4de5-9826-c25562eda553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:22.654590 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa801b4d-03d9-4de5-9826-c25562eda553 admin admin] PATH_INFO: `/v3/projects/9f1225a8ad5849bb84443cc2d26358b1/users/03cf13360f014dfab88f1dadd6651b24/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:22.656578 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa801b4d-03d9-4de5-9826-c25562eda553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f1225a8ad5849bb84443cc2d26358b1, user_id=03cf13360f014dfab88f1dadd6651b24, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:22.659959 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa801b4d-03d9-4de5-9826-c25562eda553 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:22.669832 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1322/2679] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:20:22 2022] PUT /identity/v3/projects/9f1225a8ad5849bb84443cc2d26358b1/users/03cf13360f014dfab88f1dadd6651b24/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:20:22.681240 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bbb6e-725c-4660-b0b4-6cf1e698d211 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:22.681544 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bbb6e-725c-4660-b0b4-6cf1e698d211 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:22.681821 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bbb6e-725c-4660-b0b4-6cf1e698d211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:22.707311 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-2f1bbb6e-725c-4660-b0b4-6cf1e698d211 None None] MFA Rules not processed for user `03cf13360f014dfab88f1dadd6651b24`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:20:22.708493 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2f1bbb6e-725c-4660-b0b4-6cf1e698d211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:22.772483 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1358/2680] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:20:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:20:22.782464 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa801b4d-03d9-4de5-9826-c25562eda553 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:22.784907 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-fa801b4d-03d9-4de5-9826-c25562eda553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:22.838312 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa801b4d-03d9-4de5-9826-c25562eda553 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:22.842313 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7984d-130d-4a65-ab7f-a519984a11b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:22.842994 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7984d-130d-4a65-ab7f-a519984a11b6 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:22.843274 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7984d-130d-4a65-ab7f-a519984a11b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:22.843550 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7984d-130d-4a65-ab7f-a519984a11b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:22.897495 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7984d-130d-4a65-ab7f-a519984a11b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:22.899107 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7984d-130d-4a65-ab7f-a519984a11b6 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:22.908447 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1323/2681] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:20:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:20:29.113707 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bbb6e-725c-4660-b0b4-6cf1e698d211 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:29.123579 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bbb6e-725c-4660-b0b4-6cf1e698d211 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:29.127155 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11f52e-ace1-4d4f-806d-6c6d32f4c91b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:29.127803 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11f52e-ace1-4d4f-806d-6c6d32f4c91b service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:29.128060 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11f52e-ace1-4d4f-806d-6c6d32f4c91b service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:29.128332 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11f52e-ace1-4d4f-806d-6c6d32f4c91b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:29.137321 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11f52e-ace1-4d4f-806d-6c6d32f4c91b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:29.138810 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11f52e-ace1-4d4f-806d-6c6d32f4c91b service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:29.148315 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1359/2682] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:20:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:20:35.899181 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7984d-130d-4a65-ab7f-a519984a11b6 service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:35.957752 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7984d-130d-4a65-ab7f-a519984a11b6 service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:35.962315 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de564a63-ad1e-4eb6-9d6d-8064fbc5714c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:35.963189 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de564a63-ad1e-4eb6-9d6d-8064fbc5714c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:35.963464 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de564a63-ad1e-4eb6-9d6d-8064fbc5714c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:35.963732 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de564a63-ad1e-4eb6-9d6d-8064fbc5714c admin admin] PATH_INFO: `/v3/users/b16411f8d75343e2a5a4a588058b0cf2` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:35.964900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de564a63-ad1e-4eb6-9d6d-8064fbc5714c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16411f8d75343e2a5a4a588058b0cf2)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:35.966814 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de564a63-ad1e-4eb6-9d6d-8064fbc5714c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:36.143802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-de564a63-ad1e-4eb6-9d6d-8064fbc5714c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16411f8d75343e2a5a4a588058b0cf2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:36.144399 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-de564a63-ad1e-4eb6-9d6d-8064fbc5714c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16411f8d75343e2a5a4a588058b0cf2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:36.156340 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-de564a63-ad1e-4eb6-9d6d-8064fbc5714c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16411f8d75343e2a5a4a588058b0cf2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:36.163489 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-de564a63-ad1e-4eb6-9d6d-8064fbc5714c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16411f8d75343e2a5a4a588058b0cf2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:36.217297 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-de564a63-ad1e-4eb6-9d6d-8064fbc5714c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16411f8d75343e2a5a4a588058b0cf2'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:36.223253 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1324/2683] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:20:35 2022] DELETE /identity/v3/users/b16411f8d75343e2a5a4a588058b0cf2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:20:36.233502 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c73d7-aeb4-488a-ad37-d4afb7a13ad9 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:36.233975 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c73d7-aeb4-488a-ad37-d4afb7a13ad9 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:36.234072 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c73d7-aeb4-488a-ad37-d4afb7a13ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:36.253177 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-8d1c73d7-aeb4-488a-ad37-d4afb7a13ad9 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:20:36.254366 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8d1c73d7-aeb4-488a-ad37-d4afb7a13ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:36.314229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1360/2684] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:20:36.324700 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de564a63-ad1e-4eb6-9d6d-8064fbc5714c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:36.326037 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-de564a63-ad1e-4eb6-9d6d-8064fbc5714c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:36.387725 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de564a63-ad1e-4eb6-9d6d-8064fbc5714c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:36.391438 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccca33-de26-42d6-92e2-42e8d45b103a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:36.392072 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccca33-de26-42d6-92e2-42e8d45b103a service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:36.392353 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccca33-de26-42d6-92e2-42e8d45b103a service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:36.392626 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccca33-de26-42d6-92e2-42e8d45b103a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:36.402379 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccca33-de26-42d6-92e2-42e8d45b103a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:36.403777 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccca33-de26-42d6-92e2-42e8d45b103a service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:36.413937 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1325/2685] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:20:36.800751 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c73d7-aeb4-488a-ad37-d4afb7a13ad9 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:36.802866 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8d1c73d7-aeb4-488a-ad37-d4afb7a13ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:36.815149 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c73d7-aeb4-488a-ad37-d4afb7a13ad9 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:36.821235 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596c83e-ae6c-400c-a6d9-6a2979791893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:36.822089 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596c83e-ae6c-400c-a6d9-6a2979791893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:36.822366 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596c83e-ae6c-400c-a6d9-6a2979791893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:36.822732 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596c83e-ae6c-400c-a6d9-6a2979791893 admin admin] PATH_INFO: `/v3/projects/b556337964ba4fa5bcde2ddacc7cff8a` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:36.823869 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596c83e-ae6c-400c-a6d9-6a2979791893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b556337964ba4fa5bcde2ddacc7cff8a)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:36.825884 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596c83e-ae6c-400c-a6d9-6a2979791893 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:36.949535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b596c83e-ae6c-400c-a6d9-6a2979791893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b556337964ba4fa5bcde2ddacc7cff8a', 'request_id': 'req-b596c83e-ae6c-400c-a6d9-6a2979791893'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:37.028764 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b596c83e-ae6c-400c-a6d9-6a2979791893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b556337964ba4fa5bcde2ddacc7cff8a', 'request_id': 'req-b596c83e-ae6c-400c-a6d9-6a2979791893'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:37.034559 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b596c83e-ae6c-400c-a6d9-6a2979791893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b556337964ba4fa5bcde2ddacc7cff8a', 'request_id': 'req-b596c83e-ae6c-400c-a6d9-6a2979791893'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:37.045480 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b596c83e-ae6c-400c-a6d9-6a2979791893 admin admin] The token cache is being invalidate because project b556337964ba4fa5bcde2ddacc7cff8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:20:37.050673 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b596c83e-ae6c-400c-a6d9-6a2979791893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:37.050673 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b596c83e-ae6c-400c-a6d9-6a2979791893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:37.050673 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1361/2686] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:20:36 2022] DELETE /identity/v3/projects/b556337964ba4fa5bcde2ddacc7cff8a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:20:37.052802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccca33-de26-42d6-92e2-42e8d45b103a service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:37.062510 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccca33-de26-42d6-92e2-42e8d45b103a service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:37.116799 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bdae2-2bb0-45df-ad5a-13664dd274c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:37.117655 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bdae2-2bb0-45df-ad5a-13664dd274c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:37.117934 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bdae2-2bb0-45df-ad5a-13664dd274c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:37.118209 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bdae2-2bb0-45df-ad5a-13664dd274c2 admin admin] PATH_INFO: `/v3/users/03cf13360f014dfab88f1dadd6651b24` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:37.119444 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bdae2-2bb0-45df-ad5a-13664dd274c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03cf13360f014dfab88f1dadd6651b24)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:37.121581 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bdae2-2bb0-45df-ad5a-13664dd274c2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:37.326406 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-880bdae2-2bb0-45df-ad5a-13664dd274c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03cf13360f014dfab88f1dadd6651b24'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:37.327082 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-880bdae2-2bb0-45df-ad5a-13664dd274c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03cf13360f014dfab88f1dadd6651b24'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:37.339109 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-880bdae2-2bb0-45df-ad5a-13664dd274c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03cf13360f014dfab88f1dadd6651b24'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:37.345675 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-880bdae2-2bb0-45df-ad5a-13664dd274c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03cf13360f014dfab88f1dadd6651b24'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:37.433098 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-880bdae2-2bb0-45df-ad5a-13664dd274c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03cf13360f014dfab88f1dadd6651b24'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:37.439341 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1326/2687] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:20:37 2022] DELETE /identity/v3/users/03cf13360f014dfab88f1dadd6651b24 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:20:37.800302 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596c83e-ae6c-400c-a6d9-6a2979791893 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:37.801974 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-b596c83e-ae6c-400c-a6d9-6a2979791893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:37.815377 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596c83e-ae6c-400c-a6d9-6a2979791893 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:37.872571 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ee4ea-0280-488f-a765-b9cf43f10e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:37.873340 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ee4ea-0280-488f-a765-b9cf43f10e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:37.873623 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ee4ea-0280-488f-a765-b9cf43f10e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:37.874015 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ee4ea-0280-488f-a765-b9cf43f10e19 admin admin] PATH_INFO: `/v3/projects/9f1225a8ad5849bb84443cc2d26358b1` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:37.875119 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ee4ea-0280-488f-a765-b9cf43f10e19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f1225a8ad5849bb84443cc2d26358b1)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:37.877027 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ee4ea-0280-488f-a765-b9cf43f10e19 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:37.983188 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-454ee4ea-0280-488f-a765-b9cf43f10e19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f1225a8ad5849bb84443cc2d26358b1', 'request_id': 'req-454ee4ea-0280-488f-a765-b9cf43f10e19'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:38.034281 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-454ee4ea-0280-488f-a765-b9cf43f10e19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f1225a8ad5849bb84443cc2d26358b1', 'request_id': 'req-454ee4ea-0280-488f-a765-b9cf43f10e19'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:38.039798 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-454ee4ea-0280-488f-a765-b9cf43f10e19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f1225a8ad5849bb84443cc2d26358b1', 'request_id': 'req-454ee4ea-0280-488f-a765-b9cf43f10e19'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:38.050405 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-454ee4ea-0280-488f-a765-b9cf43f10e19 admin admin] The token cache is being invalidate because project 9f1225a8ad5849bb84443cc2d26358b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:20:38.050711 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-454ee4ea-0280-488f-a765-b9cf43f10e19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:38.051330 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-454ee4ea-0280-488f-a765-b9cf43f10e19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:38.052995 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1362/2688] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:20:37 2022] DELETE /identity/v3/projects/9f1225a8ad5849bb84443cc2d26358b1 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:20:38.059004 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b60793-0a68-40f5-9451-b7c3e16b017f None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:38.059476 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b60793-0a68-40f5-9451-b7c3e16b017f None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:38.059583 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b60793-0a68-40f5-9451-b7c3e16b017f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:38.079249 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-09b60793-0a68-40f5-9451-b7c3e16b017f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:20:38.080679 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-09b60793-0a68-40f5-9451-b7c3e16b017f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:38.137042 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1327/2689] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:20:38.145418 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798983b-b582-4a48-944c-93d664c95542 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:38.145671 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798983b-b582-4a48-944c-93d664c95542 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:38.145955 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798983b-b582-4a48-944c-93d664c95542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:38.164336 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-b798983b-b582-4a48-944c-93d664c95542 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:20:38.165539 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-b798983b-b582-4a48-944c-93d664c95542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:38.173404 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1363/2690] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:20:38.178729 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b60793-0a68-40f5-9451-b7c3e16b017f None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:38.188114 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b60793-0a68-40f5-9451-b7c3e16b017f None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:38.193206 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070bc77-9f85-4c28-ab05-954b2f797e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:38.193837 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070bc77-9f85-4c28-ab05-954b2f797e72 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:38.194118 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070bc77-9f85-4c28-ab05-954b2f797e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:38.194391 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070bc77-9f85-4c28-ab05-954b2f797e72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:38.195144 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070bc77-9f85-4c28-ab05-954b2f797e72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:20:38.195454 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070bc77-9f85-4c28-ab05-954b2f797e72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:38.197044 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070bc77-9f85-4c28-ab05-954b2f797e72 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:38.208602 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1328/2691] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:20:38.212963 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798983b-b582-4a48-944c-93d664c95542 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:38.221881 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798983b-b582-4a48-944c-93d664c95542 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:38.227298 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624036c4-f77a-4cf3-9ca8-bd6464b8e620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:38.227928 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624036c4-f77a-4cf3-9ca8-bd6464b8e620 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:38.228207 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624036c4-f77a-4cf3-9ca8-bd6464b8e620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:38.228474 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624036c4-f77a-4cf3-9ca8-bd6464b8e620 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:38.229143 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624036c4-f77a-4cf3-9ca8-bd6464b8e620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:38.231081 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624036c4-f77a-4cf3-9ca8-bd6464b8e620 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:38.310136 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1364/2692] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:20:38 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:20:38.314288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070bc77-9f85-4c28-ab05-954b2f797e72 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:38.324238 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070bc77-9f85-4c28-ab05-954b2f797e72 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:38.378819 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d34a6d-2088-44f6-b9bf-30aef5985e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:38.379471 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d34a6d-2088-44f6-b9bf-30aef5985e14 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:38.379924 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d34a6d-2088-44f6-b9bf-30aef5985e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:38.380232 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d34a6d-2088-44f6-b9bf-30aef5985e14 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:38.381045 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d34a6d-2088-44f6-b9bf-30aef5985e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:38.382957 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d34a6d-2088-44f6-b9bf-30aef5985e14 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:38.480996 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1329/2693] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:20:38 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:20:38.485474 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624036c4-f77a-4cf3-9ca8-bd6464b8e620 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:38.496042 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624036c4-f77a-4cf3-9ca8-bd6464b8e620 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:38.500982 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333c73f-0df0-4fd0-9e87-f194670aed0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:38.501743 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333c73f-0df0-4fd0-9e87-f194670aed0f admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:38.502060 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333c73f-0df0-4fd0-9e87-f194670aed0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:38.502335 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333c73f-0df0-4fd0-9e87-f194670aed0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:38.503089 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333c73f-0df0-4fd0-9e87-f194670aed0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:38.504666 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333c73f-0df0-4fd0-9e87-f194670aed0f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:38.515100 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1365/2694] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:20:38.519060 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d34a6d-2088-44f6-b9bf-30aef5985e14 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:38.529351 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d34a6d-2088-44f6-b9bf-30aef5985e14 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:38.533906 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c7352-426e-4c96-b2e9-8fdc3f7941a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:38.534546 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c7352-426e-4c96-b2e9-8fdc3f7941a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:38.534852 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c7352-426e-4c96-b2e9-8fdc3f7941a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:38.535124 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c7352-426e-4c96-b2e9-8fdc3f7941a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:38.535833 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c7352-426e-4c96-b2e9-8fdc3f7941a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:38.538105 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c7352-426e-4c96-b2e9-8fdc3f7941a2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:38.547980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1330/2695] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:20:38.551883 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333c73f-0df0-4fd0-9e87-f194670aed0f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:38.561707 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333c73f-0df0-4fd0-9e87-f194670aed0f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:38.566351 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5030d-b0b1-44d5-8ec0-1dd73a12bddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:38.567245 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5030d-b0b1-44d5-8ec0-1dd73a12bddf admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:38.567650 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5030d-b0b1-44d5-8ec0-1dd73a12bddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:38.568120 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5030d-b0b1-44d5-8ec0-1dd73a12bddf admin admin] PATH_INFO: `/v3/projects/2fa998cc64bb44aea39972f142d5e0ca/users/9837b3b2bb094f3d9dcdc9da3b40cf06/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:38.582276 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5030d-b0b1-44d5-8ec0-1dd73a12bddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa998cc64bb44aea39972f142d5e0ca, user_id=9837b3b2bb094f3d9dcdc9da3b40cf06, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:38.585878 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5030d-b0b1-44d5-8ec0-1dd73a12bddf admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:38.662167 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1366/2696] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:20:38 2022] PUT /identity/v3/projects/2fa998cc64bb44aea39972f142d5e0ca/users/9837b3b2bb094f3d9dcdc9da3b40cf06/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:20:38.673283 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b37b1-7462-4afe-939c-5400a375bb62 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:38.673567 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b37b1-7462-4afe-939c-5400a375bb62 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:38.673838 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b37b1-7462-4afe-939c-5400a375bb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:38.699525 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-d67b37b1-7462-4afe-939c-5400a375bb62 None None] MFA Rules not processed for user `9837b3b2bb094f3d9dcdc9da3b40cf06`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:20:38.700711 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-d67b37b1-7462-4afe-939c-5400a375bb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:38.761886 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1331/2697] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:20:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:20:38.772170 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5030d-b0b1-44d5-8ec0-1dd73a12bddf admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:38.773833 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-16e5030d-b0b1-44d5-8ec0-1dd73a12bddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:38.827842 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5030d-b0b1-44d5-8ec0-1dd73a12bddf admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:38.831499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6f1fd-e694-403d-83de-d15b4b117d29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:38.832126 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6f1fd-e694-403d-83de-d15b4b117d29 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:38.832404 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6f1fd-e694-403d-83de-d15b4b117d29 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:38.832673 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6f1fd-e694-403d-83de-d15b4b117d29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:38.841385 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6f1fd-e694-403d-83de-d15b4b117d29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:38.842815 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6f1fd-e694-403d-83de-d15b4b117d29 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:38.851491 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1367/2698] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:20:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:20:49.590062 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b37b1-7462-4afe-939c-5400a375bb62 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:49.651759 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b37b1-7462-4afe-939c-5400a375bb62 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:49.656313 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8806f3f-0634-4de7-b0fc-9fbee1e240fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:49.657167 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8806f3f-0634-4de7-b0fc-9fbee1e240fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:49.657471 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8806f3f-0634-4de7-b0fc-9fbee1e240fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:49.657768 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8806f3f-0634-4de7-b0fc-9fbee1e240fc admin admin] PATH_INFO: `/v3/users/9837b3b2bb094f3d9dcdc9da3b40cf06` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:49.658977 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8806f3f-0634-4de7-b0fc-9fbee1e240fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9837b3b2bb094f3d9dcdc9da3b40cf06)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:49.660860 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8806f3f-0634-4de7-b0fc-9fbee1e240fc admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:49.857569 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-c8806f3f-0634-4de7-b0fc-9fbee1e240fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9837b3b2bb094f3d9dcdc9da3b40cf06'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:49.858186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-c8806f3f-0634-4de7-b0fc-9fbee1e240fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9837b3b2bb094f3d9dcdc9da3b40cf06'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:49.871083 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-c8806f3f-0634-4de7-b0fc-9fbee1e240fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9837b3b2bb094f3d9dcdc9da3b40cf06'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:49.878153 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-c8806f3f-0634-4de7-b0fc-9fbee1e240fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9837b3b2bb094f3d9dcdc9da3b40cf06'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:49.935601 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-c8806f3f-0634-4de7-b0fc-9fbee1e240fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9837b3b2bb094f3d9dcdc9da3b40cf06'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:49.941911 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1332/2699] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:20:49 2022] DELETE /identity/v3/users/9837b3b2bb094f3d9dcdc9da3b40cf06 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:20:49.946619 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3fe46-41b4-47c2-82f8-2ad909878ed1 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:49.950185 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3fe46-41b4-47c2-82f8-2ad909878ed1 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:49.950185 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3fe46-41b4-47c2-82f8-2ad909878ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:49.964375 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-5ef3fe46-41b4-47c2-82f8-2ad909878ed1 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:20:49.965566 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5ef3fe46-41b4-47c2-82f8-2ad909878ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:50.021762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1368/2700] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:20:50.031357 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8806f3f-0634-4de7-b0fc-9fbee1e240fc admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:50.032831 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-c8806f3f-0634-4de7-b0fc-9fbee1e240fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:50.087046 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8806f3f-0634-4de7-b0fc-9fbee1e240fc admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:50.090707 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fbef8-e8e5-4312-bab3-d7e811d28617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:50.091343 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fbef8-e8e5-4312-bab3-d7e811d28617 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:50.091689 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fbef8-e8e5-4312-bab3-d7e811d28617 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:50.091965 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fbef8-e8e5-4312-bab3-d7e811d28617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:50.101528 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fbef8-e8e5-4312-bab3-d7e811d28617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:50.102959 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fbef8-e8e5-4312-bab3-d7e811d28617 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:50.112010 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1333/2701] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:20:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:20:50.486162 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3fe46-41b4-47c2-82f8-2ad909878ed1 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:50.487613 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5ef3fe46-41b4-47c2-82f8-2ad909878ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:50.500763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3fe46-41b4-47c2-82f8-2ad909878ed1 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:50.506087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2f5b0-0e9b-437a-85a2-7a187e5c13ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:50.507109 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2f5b0-0e9b-437a-85a2-7a187e5c13ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:50.507395 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2f5b0-0e9b-437a-85a2-7a187e5c13ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:50.507677 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2f5b0-0e9b-437a-85a2-7a187e5c13ee admin admin] PATH_INFO: `/v3/projects/2fa998cc64bb44aea39972f142d5e0ca` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:50.509137 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2f5b0-0e9b-437a-85a2-7a187e5c13ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fa998cc64bb44aea39972f142d5e0ca)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:50.511085 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2f5b0-0e9b-437a-85a2-7a187e5c13ee admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:50.616534 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-c7b2f5b0-0e9b-437a-85a2-7a187e5c13ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fa998cc64bb44aea39972f142d5e0ca', 'request_id': 'req-c7b2f5b0-0e9b-437a-85a2-7a187e5c13ee'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:50.691631 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-c7b2f5b0-0e9b-437a-85a2-7a187e5c13ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fa998cc64bb44aea39972f142d5e0ca', 'request_id': 'req-c7b2f5b0-0e9b-437a-85a2-7a187e5c13ee'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:50.697349 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-c7b2f5b0-0e9b-437a-85a2-7a187e5c13ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fa998cc64bb44aea39972f142d5e0ca', 'request_id': 'req-c7b2f5b0-0e9b-437a-85a2-7a187e5c13ee'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:50.707840 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-c7b2f5b0-0e9b-437a-85a2-7a187e5c13ee admin admin] The token cache is being invalidate because project 2fa998cc64bb44aea39972f142d5e0ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:20:50.708121 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-c7b2f5b0-0e9b-437a-85a2-7a187e5c13ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:50.708772 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-c7b2f5b0-0e9b-437a-85a2-7a187e5c13ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:20:50.710389 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1369/2702] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:20:50 2022] DELETE /identity/v3/projects/2fa998cc64bb44aea39972f142d5e0ca => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:20:50.715361 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad16cc-5de4-4504-ae9c-1bde127f2682 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:50.715861 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad16cc-5de4-4504-ae9c-1bde127f2682 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:50.715968 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad16cc-5de4-4504-ae9c-1bde127f2682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:50.734057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-f5ad16cc-5de4-4504-ae9c-1bde127f2682 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:20:50.735488 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-f5ad16cc-5de4-4504-ae9c-1bde127f2682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:50.792694 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1334/2703] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:20:50.800489 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0403395-d40b-4d41-80f8-389109c20294 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:50.800775 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0403395-d40b-4d41-80f8-389109c20294 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:50.801052 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0403395-d40b-4d41-80f8-389109c20294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:50.820386 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-f0403395-d40b-4d41-80f8-389109c20294 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:20:50.821591 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f0403395-d40b-4d41-80f8-389109c20294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:50.829599 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1370/2704] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:20:50.833916 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad16cc-5de4-4504-ae9c-1bde127f2682 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:50.843485 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad16cc-5de4-4504-ae9c-1bde127f2682 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:50.848107 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2e131-36d1-4a2b-9245-8b457d2a4590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:50.848746 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2e131-36d1-4a2b-9245-8b457d2a4590 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:50.849634 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2e131-36d1-4a2b-9245-8b457d2a4590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:50.849919 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2e131-36d1-4a2b-9245-8b457d2a4590 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:50.850636 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2e131-36d1-4a2b-9245-8b457d2a4590 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:20:50.850972 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2e131-36d1-4a2b-9245-8b457d2a4590 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:50.852541 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2e131-36d1-4a2b-9245-8b457d2a4590 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:50.863811 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1335/2705] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:20:50.868800 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0403395-d40b-4d41-80f8-389109c20294 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:50.878311 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0403395-d40b-4d41-80f8-389109c20294 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:50.883018 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e70bd-14eb-4f14-9eb0-b36387d735d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:50.883656 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e70bd-14eb-4f14-9eb0-b36387d735d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:50.883936 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e70bd-14eb-4f14-9eb0-b36387d735d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:50.884209 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e70bd-14eb-4f14-9eb0-b36387d735d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:50.884900 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e70bd-14eb-4f14-9eb0-b36387d735d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:50.886809 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e70bd-14eb-4f14-9eb0-b36387d735d0 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:50.967137 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1371/2706] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:20:50 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:20:50.971804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2e131-36d1-4a2b-9245-8b457d2a4590 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:50.982266 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2e131-36d1-4a2b-9245-8b457d2a4590 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:51.037460 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c4f96-f889-4f28-b1a5-87887f90da56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:51.038201 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c4f96-f889-4f28-b1a5-87887f90da56 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:51.038478 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c4f96-f889-4f28-b1a5-87887f90da56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:51.038807 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c4f96-f889-4f28-b1a5-87887f90da56 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:51.039494 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c4f96-f889-4f28-b1a5-87887f90da56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:51.041369 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c4f96-f889-4f28-b1a5-87887f90da56 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:51.104045 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1336/2707] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:20:50 2022] POST /identity/v3/users => generated 285 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:20:51.108077 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e70bd-14eb-4f14-9eb0-b36387d735d0 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:51.118260 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e70bd-14eb-4f14-9eb0-b36387d735d0 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:51.123227 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f1f86-e542-4316-8451-5477614ae712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:51.123810 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f1f86-e542-4316-8451-5477614ae712 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:51.124087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f1f86-e542-4316-8451-5477614ae712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:51.124357 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f1f86-e542-4316-8451-5477614ae712 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:51.125079 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f1f86-e542-4316-8451-5477614ae712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:51.126670 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f1f86-e542-4316-8451-5477614ae712 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:51.137945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1372/2708] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:20:51.141848 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c4f96-f889-4f28-b1a5-87887f90da56 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:51.152472 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c4f96-f889-4f28-b1a5-87887f90da56 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:51.157167 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e416953-260f-49b7-aab8-aedfd169dda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:51.157756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e416953-260f-49b7-aab8-aedfd169dda0 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:51.158033 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e416953-260f-49b7-aab8-aedfd169dda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:51.158307 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e416953-260f-49b7-aab8-aedfd169dda0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:51.159063 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e416953-260f-49b7-aab8-aedfd169dda0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:51.160627 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e416953-260f-49b7-aab8-aedfd169dda0 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:51.171064 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1337/2709] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:20:51.175051 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f1f86-e542-4316-8451-5477614ae712 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:51.185235 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f1f86-e542-4316-8451-5477614ae712 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:51.189839 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fab9c3-cd56-423a-818f-94032ee5a878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:51.190731 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fab9c3-cd56-423a-818f-94032ee5a878 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:51.191014 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fab9c3-cd56-423a-818f-94032ee5a878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:51.191287 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fab9c3-cd56-423a-818f-94032ee5a878 admin admin] PATH_INFO: `/v3/projects/fc8fca6fe5c9443ba253af498fbe807b/users/d1e5c6650ca641869fd6f4360d237c93/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:51.205636 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fab9c3-cd56-423a-818f-94032ee5a878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc8fca6fe5c9443ba253af498fbe807b, user_id=d1e5c6650ca641869fd6f4360d237c93, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:51.208808 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fab9c3-cd56-423a-818f-94032ee5a878 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:51.279015 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1373/2710] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:20:51 2022] PUT /identity/v3/projects/fc8fca6fe5c9443ba253af498fbe807b/users/d1e5c6650ca641869fd6f4360d237c93/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:20:51.290187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580ebee-12f3-4913-aaeb-b76366b07873 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:51.290502 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580ebee-12f3-4913-aaeb-b76366b07873 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:51.290913 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580ebee-12f3-4913-aaeb-b76366b07873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:51.316983 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-6580ebee-12f3-4913-aaeb-b76366b07873 None None] MFA Rules not processed for user `d1e5c6650ca641869fd6f4360d237c93`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:20:51.318325 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6580ebee-12f3-4913-aaeb-b76366b07873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:51.381959 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1338/2711] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:20:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:20:51.394363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fab9c3-cd56-423a-818f-94032ee5a878 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:20:51.397423 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-15fab9c3-cd56-423a-818f-94032ee5a878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:20:51.451873 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fab9c3-cd56-423a-818f-94032ee5a878 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:20:51.455552 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b46bd4-8a62-4c1e-9bb4-d8d0fe51c8ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b2c52a60aa499e82129ef29f8907ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:20:51.456187 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b46bd4-8a62-4c1e-9bb4-d8d0fe51c8ae service glance] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:20:51.456495 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b46bd4-8a62-4c1e-9bb4-d8d0fe51c8ae service glance] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:20:51.456782 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b46bd4-8a62-4c1e-9bb4-d8d0fe51c8ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:20:51.466217 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b46bd4-8a62-4c1e-9bb4-d8d0fe51c8ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:20:51.467668 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b46bd4-8a62-4c1e-9bb4-d8d0fe51c8ae service glance] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:20:51.476866 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1374/2712] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:20:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:21:23.515143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580ebee-12f3-4913-aaeb-b76366b07873 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:23.517154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6580ebee-12f3-4913-aaeb-b76366b07873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:23.598695 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580ebee-12f3-4913-aaeb-b76366b07873 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:23.606004 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617e0af-bb58-4191-b97c-32d84ec233eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:23.606679 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617e0af-bb58-4191-b97c-32d84ec233eb service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:23.609350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617e0af-bb58-4191-b97c-32d84ec233eb service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:23.609350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617e0af-bb58-4191-b97c-32d84ec233eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:23.609350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-a617e0af-bb58-4191-b97c-32d84ec233eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:23.623313 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617e0af-bb58-4191-b97c-32d84ec233eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:23.624956 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617e0af-bb58-4191-b97c-32d84ec233eb service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:23.636854 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1339/2713] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:21:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:21:28.637149 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b46bd4-8a62-4c1e-9bb4-d8d0fe51c8ae service glance] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:28.638582 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-c0b46bd4-8a62-4c1e-9bb4-d8d0fe51c8ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:28.655553 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b46bd4-8a62-4c1e-9bb4-d8d0fe51c8ae service glance] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:28.661631 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644896f1-744d-4e84-993b-eb77318cf054 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:28.662340 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644896f1-744d-4e84-993b-eb77318cf054 service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:28.662750 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644896f1-744d-4e84-993b-eb77318cf054 service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:28.663363 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644896f1-744d-4e84-993b-eb77318cf054 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:28.665186 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-644896f1-744d-4e84-993b-eb77318cf054 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:28.678294 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644896f1-744d-4e84-993b-eb77318cf054 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:28.679997 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644896f1-744d-4e84-993b-eb77318cf054 service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:28.691979 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1375/2714] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:21:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:21:32.703191 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617e0af-bb58-4191-b97c-32d84ec233eb service nova] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:32.704789 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-a617e0af-bb58-4191-b97c-32d84ec233eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:32.766418 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617e0af-bb58-4191-b97c-32d84ec233eb service nova] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:32.770282 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058fc32-dd85-4b6f-9ac5-fa5f7600de44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:32.770955 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058fc32-dd85-4b6f-9ac5-fa5f7600de44 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:32.771237 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058fc32-dd85-4b6f-9ac5-fa5f7600de44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:32.771513 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058fc32-dd85-4b6f-9ac5-fa5f7600de44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:32.773442 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-5058fc32-dd85-4b6f-9ac5-fa5f7600de44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:32.840981 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058fc32-dd85-4b6f-9ac5-fa5f7600de44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:32.842531 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058fc32-dd85-4b6f-9ac5-fa5f7600de44 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:32.853343 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1340/2715] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:21:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:21:36.946435 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644896f1-744d-4e84-993b-eb77318cf054 service nova] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:36.948343 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-644896f1-744d-4e84-993b-eb77318cf054 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:37.031281 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644896f1-744d-4e84-993b-eb77318cf054 service nova] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:37.036307 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd9046-559b-4fd0-9eb6-49ce70f08476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:37.040054 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9046-559b-4fd0-9eb6-49ce70f08476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:37.040435 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9046-559b-4fd0-9eb6-49ce70f08476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:37.040654 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9046-559b-4fd0-9eb6-49ce70f08476 admin admin] PATH_INFO: `/v3/users/dd1b4007dbea4e46835dcf36bdb8b727` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:37.042066 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd9046-559b-4fd0-9eb6-49ce70f08476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd1b4007dbea4e46835dcf36bdb8b727)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:37.044144 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd9046-559b-4fd0-9eb6-49ce70f08476 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:37.234415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-6afd9046-559b-4fd0-9eb6-49ce70f08476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd1b4007dbea4e46835dcf36bdb8b727'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:37.235011 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-6afd9046-559b-4fd0-9eb6-49ce70f08476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd1b4007dbea4e46835dcf36bdb8b727'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:37.247396 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-6afd9046-559b-4fd0-9eb6-49ce70f08476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd1b4007dbea4e46835dcf36bdb8b727'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:37.254055 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-6afd9046-559b-4fd0-9eb6-49ce70f08476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd1b4007dbea4e46835dcf36bdb8b727'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:37.254730 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-6afd9046-559b-4fd0-9eb6-49ce70f08476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd1b4007dbea4e46835dcf36bdb8b727'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:37.342356 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1376/2716] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:21:36 2022] DELETE /identity/v3/users/dd1b4007dbea4e46835dcf36bdb8b727 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:21:37.624745 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058fc32-dd85-4b6f-9ac5-fa5f7600de44 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:37.682174 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058fc32-dd85-4b6f-9ac5-fa5f7600de44 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:37.736669 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f6df7-a078-4652-894d-72865a819f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:37.737442 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f6df7-a078-4652-894d-72865a819f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:37.737714 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f6df7-a078-4652-894d-72865a819f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:37.737981 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f6df7-a078-4652-894d-72865a819f83 admin admin] PATH_INFO: `/v3/projects/3554a01c63b84fcc82046b45d4683c7f` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:37.739183 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f6df7-a078-4652-894d-72865a819f83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3554a01c63b84fcc82046b45d4683c7f)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:37.741051 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f6df7-a078-4652-894d-72865a819f83 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:37.840700 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f63f6df7-a078-4652-894d-72865a819f83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3554a01c63b84fcc82046b45d4683c7f', 'request_id': 'req-f63f6df7-a078-4652-894d-72865a819f83'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:37.931169 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f63f6df7-a078-4652-894d-72865a819f83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3554a01c63b84fcc82046b45d4683c7f', 'request_id': 'req-f63f6df7-a078-4652-894d-72865a819f83'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:37.937302 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f63f6df7-a078-4652-894d-72865a819f83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3554a01c63b84fcc82046b45d4683c7f', 'request_id': 'req-f63f6df7-a078-4652-894d-72865a819f83'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:37.949138 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f63f6df7-a078-4652-894d-72865a819f83 admin admin] The token cache is being invalidate because project 3554a01c63b84fcc82046b45d4683c7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:21:37.949423 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f63f6df7-a078-4652-894d-72865a819f83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:37.950072 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f63f6df7-a078-4652-894d-72865a819f83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:37.951637 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1341/2717] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:21:37 2022] DELETE /identity/v3/projects/3554a01c63b84fcc82046b45d4683c7f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:21:37.956806 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac0620-b239-4cfa-8002-00763e2d3489 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:37.957286 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac0620-b239-4cfa-8002-00763e2d3489 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:37.957421 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac0620-b239-4cfa-8002-00763e2d3489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:38.005318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-b2ac0620-b239-4cfa-8002-00763e2d3489 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:38.006527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-b2ac0620-b239-4cfa-8002-00763e2d3489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:38.065547 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1377/2718] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:21:38.074333 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59dbc5-c6fb-40be-855f-7d129c341550 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:38.074754 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59dbc5-c6fb-40be-855f-7d129c341550 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:38.075101 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59dbc5-c6fb-40be-855f-7d129c341550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:38.095930 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-7f59dbc5-c6fb-40be-855f-7d129c341550 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:38.097198 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-7f59dbc5-c6fb-40be-855f-7d129c341550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:38.108359 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac0620-b239-4cfa-8002-00763e2d3489 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:38.110444 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-b2ac0620-b239-4cfa-8002-00763e2d3489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:38.113381 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1342/2719] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:21:38.114456 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59dbc5-c6fb-40be-855f-7d129c341550 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:38.123558 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac0620-b239-4cfa-8002-00763e2d3489 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:38.124996 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59dbc5-c6fb-40be-855f-7d129c341550 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:38.129190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb68f29-44d5-4b7e-8946-4d38601f1452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:38.129651 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc41c9-e349-4a70-a1f0-f998c82a83f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:38.130056 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb68f29-44d5-4b7e-8946-4d38601f1452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:38.130305 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc41c9-e349-4a70-a1f0-f998c82a83f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:38.130417 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb68f29-44d5-4b7e-8946-4d38601f1452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:38.130569 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc41c9-e349-4a70-a1f0-f998c82a83f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:38.130734 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb68f29-44d5-4b7e-8946-4d38601f1452 admin admin] PATH_INFO: `/v3/users/d1e5c6650ca641869fd6f4360d237c93` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:38.131159 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc41c9-e349-4a70-a1f0-f998c82a83f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:38.131875 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc41c9-e349-4a70-a1f0-f998c82a83f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:21:38.131983 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb68f29-44d5-4b7e-8946-4d38601f1452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e5c6650ca641869fd6f4360d237c93)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:38.132753 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc41c9-e349-4a70-a1f0-f998c82a83f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:38.134870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb68f29-44d5-4b7e-8946-4d38601f1452 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:38.135017 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc41c9-e349-4a70-a1f0-f998c82a83f5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:38.147211 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1343/2720] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:21:38.151571 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc41c9-e349-4a70-a1f0-f998c82a83f5 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:38.162639 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc41c9-e349-4a70-a1f0-f998c82a83f5 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:38.167857 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c3302-652e-49f1-8b5c-d20f89b62752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:38.178409 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c3302-652e-49f1-8b5c-d20f89b62752 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:38.178409 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c3302-652e-49f1-8b5c-d20f89b62752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:38.178409 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c3302-652e-49f1-8b5c-d20f89b62752 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:38.178409 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c3302-652e-49f1-8b5c-d20f89b62752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:38.178409 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c3302-652e-49f1-8b5c-d20f89b62752 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:38.252916 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1344/2721] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:21:38 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:21:38.256859 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c3302-652e-49f1-8b5c-d20f89b62752 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:38.317671 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c3302-652e-49f1-8b5c-d20f89b62752 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:38.319790 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-bcb68f29-44d5-4b7e-8946-4d38601f1452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e5c6650ca641869fd6f4360d237c93'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:38.320473 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-bcb68f29-44d5-4b7e-8946-4d38601f1452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e5c6650ca641869fd6f4360d237c93'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:38.323001 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf323027-b369-4420-9b56-9c0274101fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:38.323772 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf323027-b369-4420-9b56-9c0274101fdb admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:38.324157 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf323027-b369-4420-9b56-9c0274101fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:38.324545 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf323027-b369-4420-9b56-9c0274101fdb admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:38.325355 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf323027-b369-4420-9b56-9c0274101fdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:38.327398 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf323027-b369-4420-9b56-9c0274101fdb admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:38.333197 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-bcb68f29-44d5-4b7e-8946-4d38601f1452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e5c6650ca641869fd6f4360d237c93'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:38.344205 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-bcb68f29-44d5-4b7e-8946-4d38601f1452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e5c6650ca641869fd6f4360d237c93'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:38.344951 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-bcb68f29-44d5-4b7e-8946-4d38601f1452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e5c6650ca641869fd6f4360d237c93'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:38.417583 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1345/2722] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:21:38 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:21:38.427715 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf323027-b369-4420-9b56-9c0274101fdb admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:38.430015 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-bf323027-b369-4420-9b56-9c0274101fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:38.438261 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1378/2723] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:21:38 2022] DELETE /identity/v3/users/d1e5c6650ca641869fd6f4360d237c93 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:21:38.444957 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57a82d-5458-45be-8ffa-6399a3429445 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:38.446085 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57a82d-5458-45be-8ffa-6399a3429445 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:38.446578 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57a82d-5458-45be-8ffa-6399a3429445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:38.453758 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf323027-b369-4420-9b56-9c0274101fdb admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:38.468802 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-4d57a82d-5458-45be-8ffa-6399a3429445 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:38.470863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-4d57a82d-5458-45be-8ffa-6399a3429445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:38.545238 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b487e36-73b0-42a7-9999-bd2e9cb89ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:38.546249 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487e36-73b0-42a7-9999-bd2e9cb89ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:38.546523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487e36-73b0-42a7-9999-bd2e9cb89ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:38.547135 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487e36-73b0-42a7-9999-bd2e9cb89ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:38.548031 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b487e36-73b0-42a7-9999-bd2e9cb89ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:38.550136 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b487e36-73b0-42a7-9999-bd2e9cb89ce7 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:38.557146 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1379/2724] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:21:38.565715 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1346/2725] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:21:38.567670 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57a82d-5458-45be-8ffa-6399a3429445 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:38.569463 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-4d57a82d-5458-45be-8ffa-6399a3429445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:38.570551 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b487e36-73b0-42a7-9999-bd2e9cb89ce7 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:38.586080 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b487e36-73b0-42a7-9999-bd2e9cb89ce7 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:38.594350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f53942-a53c-4320-a3c3-643cf097d7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:38.600622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f53942-a53c-4320-a3c3-643cf097d7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:38.600622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f53942-a53c-4320-a3c3-643cf097d7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:38.600622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f53942-a53c-4320-a3c3-643cf097d7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:38.600622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f53942-a53c-4320-a3c3-643cf097d7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:38.600622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f53942-a53c-4320-a3c3-643cf097d7c4 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:38.619181 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1347/2726] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:21:38.623818 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f53942-a53c-4320-a3c3-643cf097d7c4 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:38.637425 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f53942-a53c-4320-a3c3-643cf097d7c4 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:38.644546 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984ad0a-3b71-487c-a8fb-c88b39c4c590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:38.645894 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984ad0a-3b71-487c-a8fb-c88b39c4c590 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:38.646372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984ad0a-3b71-487c-a8fb-c88b39c4c590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:38.646904 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984ad0a-3b71-487c-a8fb-c88b39c4c590 admin admin] PATH_INFO: `/v3/projects/57c48967897a443b9fae3dc5aada13b8/users/464f4dfde7bc4ac598259d3055a91efc/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:38.665458 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984ad0a-3b71-487c-a8fb-c88b39c4c590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c48967897a443b9fae3dc5aada13b8, user_id=464f4dfde7bc4ac598259d3055a91efc, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:38.668593 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984ad0a-3b71-487c-a8fb-c88b39c4c590 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:38.685031 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57a82d-5458-45be-8ffa-6399a3429445 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:38.687763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b17f04-c926-48c8-80b8-327e6a580d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:38.688483 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b17f04-c926-48c8-80b8-327e6a580d7a service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:38.688760 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b17f04-c926-48c8-80b8-327e6a580d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:38.689026 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b17f04-c926-48c8-80b8-327e6a580d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:38.698860 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b17f04-c926-48c8-80b8-327e6a580d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:38.700290 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b17f04-c926-48c8-80b8-327e6a580d7a service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:38.709940 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1380/2727] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:21:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:21:38.759351 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1348/2728] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:21:38 2022] PUT /identity/v3/projects/57c48967897a443b9fae3dc5aada13b8/users/464f4dfde7bc4ac598259d3055a91efc/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:21:38.776150 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fb3ea-331b-4dc7-a87b-cd4f17f78e47 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:38.776451 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fb3ea-331b-4dc7-a87b-cd4f17f78e47 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:38.776729 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fb3ea-331b-4dc7-a87b-cd4f17f78e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:38.811700 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-a59fb3ea-331b-4dc7-a87b-cd4f17f78e47 None None] MFA Rules not processed for user `464f4dfde7bc4ac598259d3055a91efc`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:38.813651 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a59fb3ea-331b-4dc7-a87b-cd4f17f78e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:38.905137 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1381/2729] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:21:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:21:38.915034 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984ad0a-3b71-487c-a8fb-c88b39c4c590 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:38.916750 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b984ad0a-3b71-487c-a8fb-c88b39c4c590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:38.992898 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984ad0a-3b71-487c-a8fb-c88b39c4c590 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:38.997885 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20483e0c-7488-4261-8f48-73e7debeba35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:38.999202 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20483e0c-7488-4261-8f48-73e7debeba35 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:38.999474 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20483e0c-7488-4261-8f48-73e7debeba35 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:38.999935 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20483e0c-7488-4261-8f48-73e7debeba35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:39.010303 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20483e0c-7488-4261-8f48-73e7debeba35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:39.012440 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20483e0c-7488-4261-8f48-73e7debeba35 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:39.030244 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1349/2730] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:21:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:21:39.344026 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fb3ea-331b-4dc7-a87b-cd4f17f78e47 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:39.347622 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a59fb3ea-331b-4dc7-a87b-cd4f17f78e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:39.423519 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fb3ea-331b-4dc7-a87b-cd4f17f78e47 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:39.428400 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dadd7c-cd78-460f-b14c-d91f80683b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:39.429828 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dadd7c-cd78-460f-b14c-d91f80683b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:39.430110 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dadd7c-cd78-460f-b14c-d91f80683b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:39.430424 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dadd7c-cd78-460f-b14c-d91f80683b21 admin admin] PATH_INFO: `/v3/projects/fc8fca6fe5c9443ba253af498fbe807b` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:39.431727 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dadd7c-cd78-460f-b14c-d91f80683b21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc8fca6fe5c9443ba253af498fbe807b)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:39.434018 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dadd7c-cd78-460f-b14c-d91f80683b21 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:39.541151 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d2dadd7c-cd78-460f-b14c-d91f80683b21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc8fca6fe5c9443ba253af498fbe807b', 'request_id': 'req-d2dadd7c-cd78-460f-b14c-d91f80683b21'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:39.639853 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d2dadd7c-cd78-460f-b14c-d91f80683b21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc8fca6fe5c9443ba253af498fbe807b', 'request_id': 'req-d2dadd7c-cd78-460f-b14c-d91f80683b21'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:39.645919 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d2dadd7c-cd78-460f-b14c-d91f80683b21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc8fca6fe5c9443ba253af498fbe807b', 'request_id': 'req-d2dadd7c-cd78-460f-b14c-d91f80683b21'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:39.657248 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d2dadd7c-cd78-460f-b14c-d91f80683b21 admin admin] The token cache is being invalidate because project fc8fca6fe5c9443ba253af498fbe807b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:21:39.657537 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d2dadd7c-cd78-460f-b14c-d91f80683b21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:39.658198 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d2dadd7c-cd78-460f-b14c-d91f80683b21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:39.659766 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1382/2731] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:21:39 2022] DELETE /identity/v3/projects/fc8fca6fe5c9443ba253af498fbe807b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:21:39.665097 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda7a27-f50c-4df5-b7a2-f78b0f05431e None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:39.665564 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda7a27-f50c-4df5-b7a2-f78b0f05431e None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:39.665711 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda7a27-f50c-4df5-b7a2-f78b0f05431e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:39.684202 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-1eda7a27-f50c-4df5-b7a2-f78b0f05431e None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:39.685404 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-1eda7a27-f50c-4df5-b7a2-f78b0f05431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:39.746077 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1350/2732] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:21:39.755378 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09769502-331e-47d1-85b1-646069d0b932 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:39.755664 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09769502-331e-47d1-85b1-646069d0b932 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:39.755935 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09769502-331e-47d1-85b1-646069d0b932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:39.775225 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-09769502-331e-47d1-85b1-646069d0b932 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:39.776598 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-09769502-331e-47d1-85b1-646069d0b932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:39.784587 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1383/2733] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:21:39.788935 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda7a27-f50c-4df5-b7a2-f78b0f05431e None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:39.798614 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda7a27-f50c-4df5-b7a2-f78b0f05431e None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:39.803686 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0d758-8f6a-4748-8de6-a813774a3185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:39.804791 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0d758-8f6a-4748-8de6-a813774a3185 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:39.805078 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0d758-8f6a-4748-8de6-a813774a3185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:39.805353 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0d758-8f6a-4748-8de6-a813774a3185 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:39.806102 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0d758-8f6a-4748-8de6-a813774a3185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:21:39.806410 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0d758-8f6a-4748-8de6-a813774a3185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:39.808031 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0d758-8f6a-4748-8de6-a813774a3185 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:39.820963 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1351/2734] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 17:21:39.825756 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09769502-331e-47d1-85b1-646069d0b932 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:39.836790 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09769502-331e-47d1-85b1-646069d0b932 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:39.844673 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049b5a7-f878-4f16-97ee-911763e2957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:39.850086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049b5a7-f878-4f16-97ee-911763e2957b admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:39.850086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049b5a7-f878-4f16-97ee-911763e2957b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:39.850086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049b5a7-f878-4f16-97ee-911763e2957b admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:39.850086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049b5a7-f878-4f16-97ee-911763e2957b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:39.850086 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049b5a7-f878-4f16-97ee-911763e2957b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:39.939512 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1384/2735] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:21:39 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:21:39.943742 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0d758-8f6a-4748-8de6-a813774a3185 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:39.956135 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0d758-8f6a-4748-8de6-a813774a3185 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:40.017939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72d879-e986-44e1-8d49-efe1d160cfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:40.018600 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72d879-e986-44e1-8d49-efe1d160cfa3 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:40.018908 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72d879-e986-44e1-8d49-efe1d160cfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:40.019231 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72d879-e986-44e1-8d49-efe1d160cfa3 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:40.019925 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72d879-e986-44e1-8d49-efe1d160cfa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:40.021812 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72d879-e986-44e1-8d49-efe1d160cfa3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:40.119445 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1352/2736] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:21:39 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:21:40.124648 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049b5a7-f878-4f16-97ee-911763e2957b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:40.137058 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049b5a7-f878-4f16-97ee-911763e2957b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:40.141906 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c725dd-088e-4e53-a34b-0101d35f74a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:40.142558 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c725dd-088e-4e53-a34b-0101d35f74a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:40.142863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c725dd-088e-4e53-a34b-0101d35f74a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:40.143137 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c725dd-088e-4e53-a34b-0101d35f74a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:40.144773 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c725dd-088e-4e53-a34b-0101d35f74a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:40.145414 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c725dd-088e-4e53-a34b-0101d35f74a7 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:40.156551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1385/2737] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:21:40.160632 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72d879-e986-44e1-8d49-efe1d160cfa3 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:40.172449 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72d879-e986-44e1-8d49-efe1d160cfa3 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:40.179320 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80558a-a40f-477c-82d3-da502e4b76d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:40.179320 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80558a-a40f-477c-82d3-da502e4b76d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:40.179674 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80558a-a40f-477c-82d3-da502e4b76d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:40.180065 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80558a-a40f-477c-82d3-da502e4b76d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:40.180856 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80558a-a40f-477c-82d3-da502e4b76d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:40.182554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80558a-a40f-477c-82d3-da502e4b76d3 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:40.193382 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1353/2738] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:21:40.197896 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c725dd-088e-4e53-a34b-0101d35f74a7 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:40.209229 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c725dd-088e-4e53-a34b-0101d35f74a7 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:40.214318 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1985ebd-660e-49bf-8e1d-befd475be922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:40.215248 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1985ebd-660e-49bf-8e1d-befd475be922 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:40.215549 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1985ebd-660e-49bf-8e1d-befd475be922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:40.215812 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1985ebd-660e-49bf-8e1d-befd475be922 admin admin] PATH_INFO: `/v3/projects/253a843df1be4a2f8c30e1e06eca8b56/users/34d53bd8a6b84f38897666568873a36b/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:40.231860 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1985ebd-660e-49bf-8e1d-befd475be922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=253a843df1be4a2f8c30e1e06eca8b56, user_id=34d53bd8a6b84f38897666568873a36b, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:40.234982 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1985ebd-660e-49bf-8e1d-befd475be922 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:40.324734 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1386/2739] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:21:40 2022] PUT /identity/v3/projects/253a843df1be4a2f8c30e1e06eca8b56/users/34d53bd8a6b84f38897666568873a36b/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:21:40.330297 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbf262-fcab-4e76-808c-2680f7fdb5ec None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:40.330577 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbf262-fcab-4e76-808c-2680f7fdb5ec None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:40.330888 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbf262-fcab-4e76-808c-2680f7fdb5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:40.349220 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-1efbf262-fcab-4e76-808c-2680f7fdb5ec None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:40.350343 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-1efbf262-fcab-4e76-808c-2680f7fdb5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:40.415366 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1354/2740] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:21:40.425186 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1985ebd-660e-49bf-8e1d-befd475be922 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:40.427082 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f1985ebd-660e-49bf-8e1d-befd475be922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:40.484973 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1985ebd-660e-49bf-8e1d-befd475be922 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:40.488870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e78f05-936e-48e8-8fb2-efede833a6e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:40.489521 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e78f05-936e-48e8-8fb2-efede833a6e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:40.489805 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e78f05-936e-48e8-8fb2-efede833a6e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:40.490078 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e78f05-936e-48e8-8fb2-efede833a6e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:40.501203 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e78f05-936e-48e8-8fb2-efede833a6e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:40.502668 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e78f05-936e-48e8-8fb2-efede833a6e3 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:40.513471 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1387/2741] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:21:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:21:45.490028 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbf262-fcab-4e76-808c-2680f7fdb5ec None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:45.493389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-1efbf262-fcab-4e76-808c-2680f7fdb5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:45.511548 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbf262-fcab-4e76-808c-2680f7fdb5ec None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:45.515869 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dacad2-801a-4f6d-b76f-4ac00663f9d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:45.516785 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dacad2-801a-4f6d-b76f-4ac00663f9d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:45.517271 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dacad2-801a-4f6d-b76f-4ac00663f9d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:45.517603 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dacad2-801a-4f6d-b76f-4ac00663f9d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:45.523237 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e4dacad2-801a-4f6d-b76f-4ac00663f9d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:45.542454 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dacad2-801a-4f6d-b76f-4ac00663f9d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:45.544145 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dacad2-801a-4f6d-b76f-4ac00663f9d6 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:45.570110 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1355/2742] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:21:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:21:47.005988 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9181c-3e6d-42df-8a11-e20feddec091 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:47.007716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9181c-3e6d-42df-8a11-e20feddec091 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:47.007716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9181c-3e6d-42df-8a11-e20feddec091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:47.071923 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-a7d9181c-3e6d-42df-8a11-e20feddec091 None None] MFA Rules not processed for user `34d53bd8a6b84f38897666568873a36b`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:47.073115 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a7d9181c-3e6d-42df-8a11-e20feddec091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:47.201803 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1388/2743] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:21:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:21:47.206085 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dacad2-801a-4f6d-b76f-4ac00663f9d6 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:47.218203 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dacad2-801a-4f6d-b76f-4ac00663f9d6 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:47.223842 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb94b33-5d96-49c9-a619-01bb8aa1e35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:47.224796 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb94b33-5d96-49c9-a619-01bb8aa1e35b admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:47.225866 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb94b33-5d96-49c9-a619-01bb8aa1e35b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:47.226435 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb94b33-5d96-49c9-a619-01bb8aa1e35b admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:47.227575 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb94b33-5d96-49c9-a619-01bb8aa1e35b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:47.229679 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb94b33-5d96-49c9-a619-01bb8aa1e35b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:47.338353 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1356/2744] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:21:47 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:21:47.343060 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9181c-3e6d-42df-8a11-e20feddec091 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:47.354596 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9181c-3e6d-42df-8a11-e20feddec091 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:47.420027 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9997d11-e838-4e17-8405-568efcbe7ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:47.420716 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9997d11-e838-4e17-8405-568efcbe7ada admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:47.421000 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9997d11-e838-4e17-8405-568efcbe7ada admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:47.421276 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9997d11-e838-4e17-8405-568efcbe7ada admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:47.421974 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9997d11-e838-4e17-8405-568efcbe7ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:47.424096 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9997d11-e838-4e17-8405-568efcbe7ada admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:47.564544 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1389/2745] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:21:47 2022] POST /identity/v3/users => generated 299 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:21:47.568762 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb94b33-5d96-49c9-a619-01bb8aa1e35b admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:47.584042 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb94b33-5d96-49c9-a619-01bb8aa1e35b admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:47.589217 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fc5d1-52d7-43ff-9578-4b0e9a549026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:47.590140 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fc5d1-52d7-43ff-9578-4b0e9a549026 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:47.590602 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fc5d1-52d7-43ff-9578-4b0e9a549026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:47.591072 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fc5d1-52d7-43ff-9578-4b0e9a549026 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:47.592125 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fc5d1-52d7-43ff-9578-4b0e9a549026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:47.593974 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fc5d1-52d7-43ff-9578-4b0e9a549026 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:47.606530 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1357/2746] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:21:47.610893 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9997d11-e838-4e17-8405-568efcbe7ada admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:47.625552 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9997d11-e838-4e17-8405-568efcbe7ada admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:47.631108 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb31745-5165-47aa-80be-0fd98fa49f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:47.632822 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb31745-5165-47aa-80be-0fd98fa49f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:47.633103 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb31745-5165-47aa-80be-0fd98fa49f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:47.633576 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb31745-5165-47aa-80be-0fd98fa49f2a admin admin] PATH_INFO: `/v3/projects/48ad682ce2d742809aae21643d732761/users/bdadf97ebedc43ccaeec27255dc8f16c/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:47.660034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb31745-5165-47aa-80be-0fd98fa49f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ad682ce2d742809aae21643d732761, user_id=bdadf97ebedc43ccaeec27255dc8f16c, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:47.663887 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb31745-5165-47aa-80be-0fd98fa49f2a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:47.766114 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1390/2747] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:21:47 2022] PUT /identity/v3/projects/48ad682ce2d742809aae21643d732761/users/bdadf97ebedc43ccaeec27255dc8f16c/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:21:47.770070 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fc5d1-52d7-43ff-9578-4b0e9a549026 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:47.781737 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fc5d1-52d7-43ff-9578-4b0e9a549026 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:47.848304 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dba834-8fbc-406b-9037-c57c1780c9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:47.848987 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dba834-8fbc-406b-9037-c57c1780c9fb admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:47.849540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dba834-8fbc-406b-9037-c57c1780c9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:47.849845 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dba834-8fbc-406b-9037-c57c1780c9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:47.850826 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dba834-8fbc-406b-9037-c57c1780c9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:47.853217 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dba834-8fbc-406b-9037-c57c1780c9fb admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:47.867695 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1358/2748] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:21:47.869015 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb31745-5165-47aa-80be-0fd98fa49f2a admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:47.884920 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb31745-5165-47aa-80be-0fd98fa49f2a admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:47.895754 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e167c-b5ec-41ff-bcf5-04f0469e4d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:47.900359 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e167c-b5ec-41ff-bcf5-04f0469e4d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:47.900592 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e167c-b5ec-41ff-bcf5-04f0469e4d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:47.900872 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e167c-b5ec-41ff-bcf5-04f0469e4d26 admin admin] PATH_INFO: `/v3/projects/48ad682ce2d742809aae21643d732761/users/bdadf97ebedc43ccaeec27255dc8f16c/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:47.903088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e167c-b5ec-41ff-bcf5-04f0469e4d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ad682ce2d742809aae21643d732761, user_id=bdadf97ebedc43ccaeec27255dc8f16c, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:47.905788 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e167c-b5ec-41ff-bcf5-04f0469e4d26 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:47.929171 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1391/2749] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:21:47 2022] PUT /identity/v3/projects/48ad682ce2d742809aae21643d732761/users/bdadf97ebedc43ccaeec27255dc8f16c/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:21:49.186717 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dba834-8fbc-406b-9037-c57c1780c9fb admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:49.188569 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-07dba834-8fbc-406b-9037-c57c1780c9fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:49.202135 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dba834-8fbc-406b-9037-c57c1780c9fb admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:49.291629 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfdbe5-25a1-4d3c-b017-4d7993fcac3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:49.292517 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfdbe5-25a1-4d3c-b017-4d7993fcac3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:49.292793 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfdbe5-25a1-4d3c-b017-4d7993fcac3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:49.293065 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfdbe5-25a1-4d3c-b017-4d7993fcac3f admin admin] PATH_INFO: `/v3/users/464f4dfde7bc4ac598259d3055a91efc` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:49.295597 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfdbe5-25a1-4d3c-b017-4d7993fcac3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=464f4dfde7bc4ac598259d3055a91efc)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:49.297559 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfdbe5-25a1-4d3c-b017-4d7993fcac3f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:49.485876 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-76cfdbe5-25a1-4d3c-b017-4d7993fcac3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '464f4dfde7bc4ac598259d3055a91efc'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:49.488137 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-76cfdbe5-25a1-4d3c-b017-4d7993fcac3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '464f4dfde7bc4ac598259d3055a91efc'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:49.517903 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-76cfdbe5-25a1-4d3c-b017-4d7993fcac3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '464f4dfde7bc4ac598259d3055a91efc'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:49.526338 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-76cfdbe5-25a1-4d3c-b017-4d7993fcac3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '464f4dfde7bc4ac598259d3055a91efc'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:49.597544 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-76cfdbe5-25a1-4d3c-b017-4d7993fcac3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '464f4dfde7bc4ac598259d3055a91efc'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:49.611624 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1359/2750] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:21:49 2022] DELETE /identity/v3/users/464f4dfde7bc4ac598259d3055a91efc => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:21:49.613779 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf74d4-397b-434f-88f0-19ba58a23d0c None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:49.614617 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf74d4-397b-434f-88f0-19ba58a23d0c None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:49.615170 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf74d4-397b-434f-88f0-19ba58a23d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:49.651459 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-73cf74d4-397b-434f-88f0-19ba58a23d0c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:49.653670 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-73cf74d4-397b-434f-88f0-19ba58a23d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:49.752490 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1392/2751] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:21:49.771187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfdbe5-25a1-4d3c-b017-4d7993fcac3f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:49.782356 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-76cfdbe5-25a1-4d3c-b017-4d7993fcac3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:49.859513 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfdbe5-25a1-4d3c-b017-4d7993fcac3f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:49.863363 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75030a31-4902-4e82-ad42-84f480569ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:49.864019 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75030a31-4902-4e82-ad42-84f480569ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:49.864297 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75030a31-4902-4e82-ad42-84f480569ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:49.864575 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75030a31-4902-4e82-ad42-84f480569ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:49.876091 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75030a31-4902-4e82-ad42-84f480569ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:49.877539 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75030a31-4902-4e82-ad42-84f480569ab5 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:49.894114 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1360/2752] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:21:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:21:50.891762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf74d4-397b-434f-88f0-19ba58a23d0c None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:50.894157 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-73cf74d4-397b-434f-88f0-19ba58a23d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:50.909017 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf74d4-397b-434f-88f0-19ba58a23d0c None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:50.914279 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73b6e5-27d3-4405-ae17-de2ac2066d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:50.915217 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73b6e5-27d3-4405-ae17-de2ac2066d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:50.915497 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73b6e5-27d3-4405-ae17-de2ac2066d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:50.915955 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73b6e5-27d3-4405-ae17-de2ac2066d7a admin admin] PATH_INFO: `/v3/projects/57c48967897a443b9fae3dc5aada13b8` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:50.917264 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73b6e5-27d3-4405-ae17-de2ac2066d7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=57c48967897a443b9fae3dc5aada13b8)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:50.919326 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73b6e5-27d3-4405-ae17-de2ac2066d7a admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:51.045022 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1b73b6e5-27d3-4405-ae17-de2ac2066d7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57c48967897a443b9fae3dc5aada13b8', 'request_id': 'req-1b73b6e5-27d3-4405-ae17-de2ac2066d7a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:51.108981 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1b73b6e5-27d3-4405-ae17-de2ac2066d7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57c48967897a443b9fae3dc5aada13b8', 'request_id': 'req-1b73b6e5-27d3-4405-ae17-de2ac2066d7a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:51.117239 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1b73b6e5-27d3-4405-ae17-de2ac2066d7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57c48967897a443b9fae3dc5aada13b8', 'request_id': 'req-1b73b6e5-27d3-4405-ae17-de2ac2066d7a'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:51.130886 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1b73b6e5-27d3-4405-ae17-de2ac2066d7a admin admin] The token cache is being invalidate because project 57c48967897a443b9fae3dc5aada13b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:21:51.139083 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1b73b6e5-27d3-4405-ae17-de2ac2066d7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:51.139083 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1b73b6e5-27d3-4405-ae17-de2ac2066d7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:51.139083 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1393/2753] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:21:50 2022] DELETE /identity/v3/projects/57c48967897a443b9fae3dc5aada13b8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:21:51.140331 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0ba73-2528-4c40-8aa8-95a1d787cbfd None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:51.141117 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0ba73-2528-4c40-8aa8-95a1d787cbfd None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:51.141565 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0ba73-2528-4c40-8aa8-95a1d787cbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:51.164486 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-98a0ba73-2528-4c40-8aa8-95a1d787cbfd None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:51.166000 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-98a0ba73-2528-4c40-8aa8-95a1d787cbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:51.252407 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1361/2754] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:21:51.260328 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e814f05-773c-45e0-b08c-657abce57d98 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:51.261959 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e814f05-773c-45e0-b08c-657abce57d98 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:51.261959 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e814f05-773c-45e0-b08c-657abce57d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:51.283057 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-7e814f05-773c-45e0-b08c-657abce57d98 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:51.284852 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-7e814f05-773c-45e0-b08c-657abce57d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:51.305052 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1394/2755] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:21:51.306239 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0ba73-2528-4c40-8aa8-95a1d787cbfd None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:51.317154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0ba73-2528-4c40-8aa8-95a1d787cbfd None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:51.327472 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30dfbd-c6b6-4894-a116-a34bbe62575e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:51.330954 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30dfbd-c6b6-4894-a116-a34bbe62575e admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:51.331643 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30dfbd-c6b6-4894-a116-a34bbe62575e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:51.332164 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30dfbd-c6b6-4894-a116-a34bbe62575e admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:51.333926 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30dfbd-c6b6-4894-a116-a34bbe62575e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:21:51.334494 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30dfbd-c6b6-4894-a116-a34bbe62575e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:51.338540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30dfbd-c6b6-4894-a116-a34bbe62575e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:51.358818 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1362/2756] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:21:51.359572 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e814f05-773c-45e0-b08c-657abce57d98 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:51.370619 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e814f05-773c-45e0-b08c-657abce57d98 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:51.378474 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e93c5-4abd-473b-a7df-5f00b2480edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:51.379925 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e93c5-4abd-473b-a7df-5f00b2480edc admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:51.380429 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e93c5-4abd-473b-a7df-5f00b2480edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:51.381066 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e93c5-4abd-473b-a7df-5f00b2480edc admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:51.382474 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e93c5-4abd-473b-a7df-5f00b2480edc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:51.385467 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e93c5-4abd-473b-a7df-5f00b2480edc admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:51.555720 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1395/2757] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:21:51 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:21:51.555887 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30dfbd-c6b6-4894-a116-a34bbe62575e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:51.565171 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30dfbd-c6b6-4894-a116-a34bbe62575e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:51.674133 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78458c-dc74-46d9-9b16-516e9f14986f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:51.674702 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78458c-dc74-46d9-9b16-516e9f14986f admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:51.674987 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78458c-dc74-46d9-9b16-516e9f14986f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:51.675254 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78458c-dc74-46d9-9b16-516e9f14986f admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:51.675991 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78458c-dc74-46d9-9b16-516e9f14986f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:51.678081 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78458c-dc74-46d9-9b16-516e9f14986f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:51.772510 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1363/2758] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:21:51 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:21:51.776790 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e93c5-4abd-473b-a7df-5f00b2480edc admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:51.788408 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e93c5-4abd-473b-a7df-5f00b2480edc admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:51.795213 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d60aa-87b9-42e1-8f3a-f49b51618267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:51.796834 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d60aa-87b9-42e1-8f3a-f49b51618267 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:51.796834 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d60aa-87b9-42e1-8f3a-f49b51618267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:51.796834 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d60aa-87b9-42e1-8f3a-f49b51618267 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:51.797778 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d60aa-87b9-42e1-8f3a-f49b51618267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:51.799567 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d60aa-87b9-42e1-8f3a-f49b51618267 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:51.816160 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1396/2759] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:21:51.817752 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78458c-dc74-46d9-9b16-516e9f14986f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:51.829696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78458c-dc74-46d9-9b16-516e9f14986f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:51.835312 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58161939-b04f-41f9-97fe-443a5991df06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:51.836005 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58161939-b04f-41f9-97fe-443a5991df06 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:51.836289 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58161939-b04f-41f9-97fe-443a5991df06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:51.836565 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58161939-b04f-41f9-97fe-443a5991df06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:51.837298 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58161939-b04f-41f9-97fe-443a5991df06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:51.839023 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58161939-b04f-41f9-97fe-443a5991df06 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:51.851331 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1364/2760] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:21:51.856135 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d60aa-87b9-42e1-8f3a-f49b51618267 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:51.868672 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d60aa-87b9-42e1-8f3a-f49b51618267 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:51.875451 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f4281-4ad9-456b-930c-c50f97c2ae80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:51.876980 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f4281-4ad9-456b-930c-c50f97c2ae80 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:51.877102 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f4281-4ad9-456b-930c-c50f97c2ae80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:51.877482 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f4281-4ad9-456b-930c-c50f97c2ae80 admin admin] PATH_INFO: `/v3/projects/540de269907e4b0eb5feb5b28db7df94/users/706c34ffa1c3433db252bf6277d907c6/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:51.897792 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f4281-4ad9-456b-930c-c50f97c2ae80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=540de269907e4b0eb5feb5b28db7df94, user_id=706c34ffa1c3433db252bf6277d907c6, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:51.900739 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f4281-4ad9-456b-930c-c50f97c2ae80 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:51.966676 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1397/2761] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:21:51 2022] PUT /identity/v3/projects/540de269907e4b0eb5feb5b28db7df94/users/706c34ffa1c3433db252bf6277d907c6/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:21:51.977773 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c625cef-695d-4d18-ae7a-9ba0f2a56417 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:51.978224 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c625cef-695d-4d18-ae7a-9ba0f2a56417 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:51.978597 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c625cef-695d-4d18-ae7a-9ba0f2a56417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:52.011183 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-9c625cef-695d-4d18-ae7a-9ba0f2a56417 None None] MFA Rules not processed for user `706c34ffa1c3433db252bf6277d907c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:52.012745 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-9c625cef-695d-4d18-ae7a-9ba0f2a56417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:52.104417 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1365/2762] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:21:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:21:52.108541 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f4281-4ad9-456b-930c-c50f97c2ae80 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:52.183900 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f4281-4ad9-456b-930c-c50f97c2ae80 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:52.189194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c7156-e168-4078-8e1e-0298e7f390b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:52.194001 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c7156-e168-4078-8e1e-0298e7f390b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:52.194830 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c7156-e168-4078-8e1e-0298e7f390b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:52.195293 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c7156-e168-4078-8e1e-0298e7f390b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:52.196454 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c7156-e168-4078-8e1e-0298e7f390b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:52.198787 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c7156-e168-4078-8e1e-0298e7f390b8 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:52.298158 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1398/2763] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:21:52 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:21:52.299537 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c625cef-695d-4d18-ae7a-9ba0f2a56417 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:52.313096 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c625cef-695d-4d18-ae7a-9ba0f2a56417 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:52.387005 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47104114-f8d6-43e9-9bb9-1402ede4f03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:52.387988 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47104114-f8d6-43e9-9bb9-1402ede4f03e admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:52.388502 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47104114-f8d6-43e9-9bb9-1402ede4f03e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:52.389140 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47104114-f8d6-43e9-9bb9-1402ede4f03e admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:52.390068 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47104114-f8d6-43e9-9bb9-1402ede4f03e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:52.392480 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47104114-f8d6-43e9-9bb9-1402ede4f03e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:52.509952 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1366/2764] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:21:52 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:21:52.514206 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c7156-e168-4078-8e1e-0298e7f390b8 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:52.531612 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c7156-e168-4078-8e1e-0298e7f390b8 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:52.537164 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d202d-d6c5-43ba-b80b-27c5d09a7634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:52.538321 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d202d-d6c5-43ba-b80b-27c5d09a7634 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:52.538987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d202d-d6c5-43ba-b80b-27c5d09a7634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:52.539516 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d202d-d6c5-43ba-b80b-27c5d09a7634 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:52.540499 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d202d-d6c5-43ba-b80b-27c5d09a7634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:52.542728 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d202d-d6c5-43ba-b80b-27c5d09a7634 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:52.562590 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1399/2765] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:21:52.567101 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47104114-f8d6-43e9-9bb9-1402ede4f03e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:52.582690 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47104114-f8d6-43e9-9bb9-1402ede4f03e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:52.590062 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491fa8f-273f-4a64-b038-ccb472345862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:52.598095 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491fa8f-273f-4a64-b038-ccb472345862 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:52.598095 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491fa8f-273f-4a64-b038-ccb472345862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:52.598095 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491fa8f-273f-4a64-b038-ccb472345862 admin admin] PATH_INFO: `/v3/projects/40d8578b4c074553ad75d9f9da4d6b46/users/f89ea00f1a604a80935f07d9182bdef0/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:52.624488 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491fa8f-273f-4a64-b038-ccb472345862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40d8578b4c074553ad75d9f9da4d6b46, user_id=f89ea00f1a604a80935f07d9182bdef0, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:52.630630 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491fa8f-273f-4a64-b038-ccb472345862 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:52.738073 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1367/2766] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:21:52 2022] PUT /identity/v3/projects/40d8578b4c074553ad75d9f9da4d6b46/users/f89ea00f1a604a80935f07d9182bdef0/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:21:52.747255 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d202d-d6c5-43ba-b80b-27c5d09a7634 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:52.753812 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d202d-d6c5-43ba-b80b-27c5d09a7634 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:52.873045 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330817d-8b94-49ac-af36-599d7a6f5074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:52.873736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330817d-8b94-49ac-af36-599d7a6f5074 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:52.874012 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330817d-8b94-49ac-af36-599d7a6f5074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:52.874280 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330817d-8b94-49ac-af36-599d7a6f5074 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:52.875038 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330817d-8b94-49ac-af36-599d7a6f5074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:52.882880 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330817d-8b94-49ac-af36-599d7a6f5074 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:52.910033 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1400/2767] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:21:52.910875 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491fa8f-273f-4a64-b038-ccb472345862 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:52.932120 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491fa8f-273f-4a64-b038-ccb472345862 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:52.947507 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c214332-81ec-4763-9a0d-78d18d59979d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:52.948782 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c214332-81ec-4763-9a0d-78d18d59979d admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:52.949239 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c214332-81ec-4763-9a0d-78d18d59979d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:52.949696 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c214332-81ec-4763-9a0d-78d18d59979d admin admin] PATH_INFO: `/v3/projects/40d8578b4c074553ad75d9f9da4d6b46/users/f89ea00f1a604a80935f07d9182bdef0/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:52.953445 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c214332-81ec-4763-9a0d-78d18d59979d admin admin] RBAC: Authorizing `identity:create_grant(project_id=40d8578b4c074553ad75d9f9da4d6b46, user_id=f89ea00f1a604a80935f07d9182bdef0, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:52.959797 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c214332-81ec-4763-9a0d-78d18d59979d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:52.996402 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1368/2768] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:21:52 2022] PUT /identity/v3/projects/40d8578b4c074553ad75d9f9da4d6b46/users/f89ea00f1a604a80935f07d9182bdef0/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:21:52.997545 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189a4b7-73c9-480c-ae1b-bf7f01acdabf None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:52.997834 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189a4b7-73c9-480c-ae1b-bf7f01acdabf None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:52.998164 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189a4b7-73c9-480c-ae1b-bf7f01acdabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:53.046068 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-d189a4b7-73c9-480c-ae1b-bf7f01acdabf None None] MFA Rules not processed for user `f89ea00f1a604a80935f07d9182bdef0`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:53.047328 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d189a4b7-73c9-480c-ae1b-bf7f01acdabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:53.186136 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1401/2769] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:21:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:21:53.197642 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c214332-81ec-4763-9a0d-78d18d59979d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:53.200376 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-3c214332-81ec-4763-9a0d-78d18d59979d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:53.267840 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c214332-81ec-4763-9a0d-78d18d59979d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:53.271923 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef031b-3709-48e8-88c1-cd0853b9602b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:53.274068 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef031b-3709-48e8-88c1-cd0853b9602b service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:53.274458 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef031b-3709-48e8-88c1-cd0853b9602b service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:53.274867 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef031b-3709-48e8-88c1-cd0853b9602b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:53.285520 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef031b-3709-48e8-88c1-cd0853b9602b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:53.287136 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef031b-3709-48e8-88c1-cd0853b9602b service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:53.300884 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1369/2770] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:21:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:21:53.523095 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189a4b7-73c9-480c-ae1b-bf7f01acdabf None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:53.625841 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189a4b7-73c9-480c-ae1b-bf7f01acdabf None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:53.632674 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491325c-85f1-45c2-b5fe-8b666b72e337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:53.633545 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491325c-85f1-45c2-b5fe-8b666b72e337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:53.633822 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491325c-85f1-45c2-b5fe-8b666b72e337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:53.634095 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491325c-85f1-45c2-b5fe-8b666b72e337 admin admin] PATH_INFO: `/v3/users/706c34ffa1c3433db252bf6277d907c6` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:53.636182 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491325c-85f1-45c2-b5fe-8b666b72e337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=706c34ffa1c3433db252bf6277d907c6)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:53.638095 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491325c-85f1-45c2-b5fe-8b666b72e337 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:53.884239 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d491325c-85f1-45c2-b5fe-8b666b72e337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '706c34ffa1c3433db252bf6277d907c6'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:53.887068 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d491325c-85f1-45c2-b5fe-8b666b72e337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '706c34ffa1c3433db252bf6277d907c6'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:53.912233 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d491325c-85f1-45c2-b5fe-8b666b72e337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '706c34ffa1c3433db252bf6277d907c6'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:53.924401 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d491325c-85f1-45c2-b5fe-8b666b72e337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '706c34ffa1c3433db252bf6277d907c6'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:53.925648 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-d491325c-85f1-45c2-b5fe-8b666b72e337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '706c34ffa1c3433db252bf6277d907c6'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:54.071622 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1402/2771] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:21:53 2022] DELETE /identity/v3/users/706c34ffa1c3433db252bf6277d907c6 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:21:54.072963 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f60c3-78e3-4c4d-b4ac-4bb857aae340 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:54.073422 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f60c3-78e3-4c4d-b4ac-4bb857aae340 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:54.073861 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f60c3-78e3-4c4d-b4ac-4bb857aae340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:54.093503 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-0e2f60c3-78e3-4c4d-b4ac-4bb857aae340 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:54.095166 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-0e2f60c3-78e3-4c4d-b4ac-4bb857aae340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:54.185164 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1370/2772] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:21:54.196058 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491325c-85f1-45c2-b5fe-8b666b72e337 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:54.197823 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d491325c-85f1-45c2-b5fe-8b666b72e337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:54.273809 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491325c-85f1-45c2-b5fe-8b666b72e337 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:54.281028 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6f7c3-6766-4ff0-bbee-dc171bdf1a03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:54.282174 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6f7c3-6766-4ff0-bbee-dc171bdf1a03 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:54.282462 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6f7c3-6766-4ff0-bbee-dc171bdf1a03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:54.282767 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6f7c3-6766-4ff0-bbee-dc171bdf1a03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:54.297523 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6f7c3-6766-4ff0-bbee-dc171bdf1a03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:54.299128 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6f7c3-6766-4ff0-bbee-dc171bdf1a03 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:54.314352 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1403/2773] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:21:54.885864 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f60c3-78e3-4c4d-b4ac-4bb857aae340 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:54.887450 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-0e2f60c3-78e3-4c4d-b4ac-4bb857aae340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:54.901016 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f60c3-78e3-4c4d-b4ac-4bb857aae340 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:54.915381 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ef556-4c66-4bc7-ac30-55fc5a423237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:54.916269 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ef556-4c66-4bc7-ac30-55fc5a423237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:54.916540 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ef556-4c66-4bc7-ac30-55fc5a423237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:54.916813 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ef556-4c66-4bc7-ac30-55fc5a423237 admin admin] PATH_INFO: `/v3/projects/540de269907e4b0eb5feb5b28db7df94` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:54.918322 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ef556-4c66-4bc7-ac30-55fc5a423237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=540de269907e4b0eb5feb5b28db7df94)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:54.924620 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ef556-4c66-4bc7-ac30-55fc5a423237 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:55.071506 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-cd7ef556-4c66-4bc7-ac30-55fc5a423237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '540de269907e4b0eb5feb5b28db7df94', 'request_id': 'req-cd7ef556-4c66-4bc7-ac30-55fc5a423237'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:55.152262 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-cd7ef556-4c66-4bc7-ac30-55fc5a423237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '540de269907e4b0eb5feb5b28db7df94', 'request_id': 'req-cd7ef556-4c66-4bc7-ac30-55fc5a423237'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:55.165653 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-cd7ef556-4c66-4bc7-ac30-55fc5a423237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '540de269907e4b0eb5feb5b28db7df94', 'request_id': 'req-cd7ef556-4c66-4bc7-ac30-55fc5a423237'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:55.206841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-cd7ef556-4c66-4bc7-ac30-55fc5a423237 admin admin] The token cache is being invalidate because project 540de269907e4b0eb5feb5b28db7df94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:21:55.206841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-cd7ef556-4c66-4bc7-ac30-55fc5a423237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:55.206841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-cd7ef556-4c66-4bc7-ac30-55fc5a423237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:55.206841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1371/2774] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:21:54 2022] DELETE /identity/v3/projects/540de269907e4b0eb5feb5b28db7df94 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:21:55.207611 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6f7c3-6766-4ff0-bbee-dc171bdf1a03 service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:55.207611 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6f7c3-6766-4ff0-bbee-dc171bdf1a03 service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:55.283142 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742f42f-8449-49cf-bcbe-1b0bb4fbd1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:55.284083 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742f42f-8449-49cf-bcbe-1b0bb4fbd1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:55.284375 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742f42f-8449-49cf-bcbe-1b0bb4fbd1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:55.284640 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742f42f-8449-49cf-bcbe-1b0bb4fbd1eb admin admin] PATH_INFO: `/v3/users/f89ea00f1a604a80935f07d9182bdef0` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:55.288762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742f42f-8449-49cf-bcbe-1b0bb4fbd1eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f89ea00f1a604a80935f07d9182bdef0)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:55.290736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742f42f-8449-49cf-bcbe-1b0bb4fbd1eb admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:55.598247 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4742f42f-8449-49cf-bcbe-1b0bb4fbd1eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f89ea00f1a604a80935f07d9182bdef0'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:55.599150 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4742f42f-8449-49cf-bcbe-1b0bb4fbd1eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f89ea00f1a604a80935f07d9182bdef0'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:55.624553 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4742f42f-8449-49cf-bcbe-1b0bb4fbd1eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f89ea00f1a604a80935f07d9182bdef0'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:55.638278 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4742f42f-8449-49cf-bcbe-1b0bb4fbd1eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f89ea00f1a604a80935f07d9182bdef0'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:55.638278 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4742f42f-8449-49cf-bcbe-1b0bb4fbd1eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f89ea00f1a604a80935f07d9182bdef0'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:55.771549 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1404/2775] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:21:55 2022] DELETE /identity/v3/users/f89ea00f1a604a80935f07d9182bdef0 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:21:56.323597 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb085d-a3f0-4a1f-9f48-0a85749edf66 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:56.324091 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb085d-a3f0-4a1f-9f48-0a85749edf66 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:56.324192 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb085d-a3f0-4a1f-9f48-0a85749edf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:56.353055 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-2bdb085d-a3f0-4a1f-9f48-0a85749edf66 None None] MFA Rules not processed for user `bdadf97ebedc43ccaeec27255dc8f16c`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:56.354603 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-2bdb085d-a3f0-4a1f-9f48-0a85749edf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:56.398680 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742f42f-8449-49cf-bcbe-1b0bb4fbd1eb admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:56.401267 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-4742f42f-8449-49cf-bcbe-1b0bb4fbd1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:56.488197 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742f42f-8449-49cf-bcbe-1b0bb4fbd1eb admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:56.494748 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126c60c-c8b4-41ad-b7f4-5aab2aad86ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:56.496426 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126c60c-c8b4-41ad-b7f4-5aab2aad86ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:56.497135 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126c60c-c8b4-41ad-b7f4-5aab2aad86ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:56.497542 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1372/2776] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:21:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:21:56.497805 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126c60c-c8b4-41ad-b7f4-5aab2aad86ba admin admin] PATH_INFO: `/v3/projects/40d8578b4c074553ad75d9f9da4d6b46` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:56.500767 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126c60c-c8b4-41ad-b7f4-5aab2aad86ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=40d8578b4c074553ad75d9f9da4d6b46)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:56.503288 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126c60c-c8b4-41ad-b7f4-5aab2aad86ba admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:56.504894 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb085d-a3f0-4a1f-9f48-0a85749edf66 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:56.507334 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-2bdb085d-a3f0-4a1f-9f48-0a85749edf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:56.589951 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb085d-a3f0-4a1f-9f48-0a85749edf66 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:56.594974 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046553b5-a020-4a79-9e24-4761c34e3969 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b2c52a60aa499e82129ef29f8907ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:56.595847 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046553b5-a020-4a79-9e24-4761c34e3969 service glance] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:56.596303 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046553b5-a020-4a79-9e24-4761c34e3969 service glance] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:56.596764 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046553b5-a020-4a79-9e24-4761c34e3969 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:56.600029 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-046553b5-a020-4a79-9e24-4761c34e3969 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:56.628655 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4126c60c-c8b4-41ad-b7f4-5aab2aad86ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40d8578b4c074553ad75d9f9da4d6b46', 'request_id': 'req-4126c60c-c8b4-41ad-b7f4-5aab2aad86ba'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:56.688594 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046553b5-a020-4a79-9e24-4761c34e3969 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:56.690097 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046553b5-a020-4a79-9e24-4761c34e3969 service glance] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:56.708722 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1373/2777] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:21:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:21:56.771302 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4126c60c-c8b4-41ad-b7f4-5aab2aad86ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40d8578b4c074553ad75d9f9da4d6b46', 'request_id': 'req-4126c60c-c8b4-41ad-b7f4-5aab2aad86ba'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:56.777959 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4126c60c-c8b4-41ad-b7f4-5aab2aad86ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40d8578b4c074553ad75d9f9da4d6b46', 'request_id': 'req-4126c60c-c8b4-41ad-b7f4-5aab2aad86ba'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:56.791020 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4126c60c-c8b4-41ad-b7f4-5aab2aad86ba admin admin] The token cache is being invalidate because project 40d8578b4c074553ad75d9f9da4d6b46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:21:56.791608 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4126c60c-c8b4-41ad-b7f4-5aab2aad86ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:56.792261 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4126c60c-c8b4-41ad-b7f4-5aab2aad86ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:56.794396 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1405/2778] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:21:56 2022] DELETE /identity/v3/projects/40d8578b4c074553ad75d9f9da4d6b46 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:21:56.799129 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdace8a-fae0-4af3-b72c-b7b6585ccce6 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:56.799586 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdace8a-fae0-4af3-b72c-b7b6585ccce6 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:56.800028 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdace8a-fae0-4af3-b72c-b7b6585ccce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:56.821647 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-2cdace8a-fae0-4af3-b72c-b7b6585ccce6 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:56.822760 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-2cdace8a-fae0-4af3-b72c-b7b6585ccce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:56.911685 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1374/2779] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:21:56.912651 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c07fdb-5752-4ebb-a27e-3c928a0e9772 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:56.912981 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c07fdb-5752-4ebb-a27e-3c928a0e9772 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:56.913253 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c07fdb-5752-4ebb-a27e-3c928a0e9772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:56.947082 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-37c07fdb-5752-4ebb-a27e-3c928a0e9772 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:56.948304 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-37c07fdb-5752-4ebb-a27e-3c928a0e9772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:56.958095 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1406/2780] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:21:56.965969 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdace8a-fae0-4af3-b72c-b7b6585ccce6 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:56.991894 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdace8a-fae0-4af3-b72c-b7b6585ccce6 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:57.008980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5099d0-8bed-4f0f-bf90-6bf3712f2c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:57.010174 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5099d0-8bed-4f0f-bf90-6bf3712f2c57 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:57.010174 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5099d0-8bed-4f0f-bf90-6bf3712f2c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:57.010174 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5099d0-8bed-4f0f-bf90-6bf3712f2c57 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:57.010974 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5099d0-8bed-4f0f-bf90-6bf3712f2c57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:21:57.011307 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5099d0-8bed-4f0f-bf90-6bf3712f2c57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:57.012905 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5099d0-8bed-4f0f-bf90-6bf3712f2c57 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:57.025690 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e535073-6af2-4a02-ad9d-a8213ec549dc None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:57.026107 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e535073-6af2-4a02-ad9d-a8213ec549dc None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:57.026438 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e535073-6af2-4a02-ad9d-a8213ec549dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:57.028588 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1375/2781] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:21:57.032900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5099d0-8bed-4f0f-bf90-6bf3712f2c57 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:57.045484 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5099d0-8bed-4f0f-bf90-6bf3712f2c57 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:57.048855 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-8e535073-6af2-4a02-ad9d-a8213ec549dc None None] MFA Rules not processed for user `fa9ea7738c634318a532ebca2e564745`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:57.050201 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-8e535073-6af2-4a02-ad9d-a8213ec549dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:57.051154 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73ed0d-b79f-49f0-af33-0c2b38ab5c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:57.051801 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73ed0d-b79f-49f0-af33-0c2b38ab5c2e admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:57.052078 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73ed0d-b79f-49f0-af33-0c2b38ab5c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:57.052352 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73ed0d-b79f-49f0-af33-0c2b38ab5c2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:57.053557 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73ed0d-b79f-49f0-af33-0c2b38ab5c2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:57.056411 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73ed0d-b79f-49f0-af33-0c2b38ab5c2e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:57.118691 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1407/2782] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Feb 16 17:21:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:21:57.166770 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1376/2783] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:21:57 2022] POST /identity/v3/projects => generated 391 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:21:57.169970 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e535073-6af2-4a02-ad9d-a8213ec549dc None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:57.181885 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e535073-6af2-4a02-ad9d-a8213ec549dc None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:57.244279 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d6c32-361d-4960-bc2b-2cf9e416a57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:57.245012 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d6c32-361d-4960-bc2b-2cf9e416a57c admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:57.245375 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d6c32-361d-4960-bc2b-2cf9e416a57c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:57.245713 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d6c32-361d-4960-bc2b-2cf9e416a57c admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:57.246511 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d6c32-361d-4960-bc2b-2cf9e416a57c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:57.248917 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d6c32-361d-4960-bc2b-2cf9e416a57c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:57.299015 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73ed0d-b79f-49f0-af33-0c2b38ab5c2e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:57.301180 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-0b73ed0d-b79f-49f0-af33-0c2b38ab5c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:57.383172 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73ed0d-b79f-49f0-af33-0c2b38ab5c2e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:57.385771 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1408/2784] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:21:57 2022] POST /identity/v3/users => generated 296 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:21:57.386809 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d6c32-361d-4960-bc2b-2cf9e416a57c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:57.390144 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-cd4d6c32-361d-4960-bc2b-2cf9e416a57c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:57.391818 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313747b9-9e05-4966-a2d6-9afeb03df0e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc59cb98783b4353a405b8b9a3a9d592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:57.393287 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313747b9-9e05-4966-a2d6-9afeb03df0e2 service swift] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:57.398032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313747b9-9e05-4966-a2d6-9afeb03df0e2 service swift] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:57.398032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313747b9-9e05-4966-a2d6-9afeb03df0e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:57.404492 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d6c32-361d-4960-bc2b-2cf9e416a57c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:57.410386 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90196c-37ab-46ca-bd56-827428607be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:57.411310 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90196c-37ab-46ca-bd56-827428607be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:57.411589 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90196c-37ab-46ca-bd56-827428607be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:57.411861 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90196c-37ab-46ca-bd56-827428607be9 admin admin] PATH_INFO: `/v3/users/b5ea1801f0674e8297e2cd8a964333d4` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:57.429894 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90196c-37ab-46ca-bd56-827428607be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5ea1801f0674e8297e2cd8a964333d4)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:57.431875 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90196c-37ab-46ca-bd56-827428607be9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:57.465942 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313747b9-9e05-4966-a2d6-9afeb03df0e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:57.467577 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313747b9-9e05-4966-a2d6-9afeb03df0e2 service swift] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:57.476270 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1377/2785] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Feb 16 17:21:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 17:21:57.477155 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313747b9-9e05-4966-a2d6-9afeb03df0e2 service swift] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:57.496729 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313747b9-9e05-4966-a2d6-9afeb03df0e2 service swift] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:57.496729 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aff077-659c-4b62-972f-bb81329e4164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:57.496729 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aff077-659c-4b62-972f-bb81329e4164 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:57.496729 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aff077-659c-4b62-972f-bb81329e4164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:57.497447 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aff077-659c-4b62-972f-bb81329e4164 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:57.497846 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aff077-659c-4b62-972f-bb81329e4164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:57.499474 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aff077-659c-4b62-972f-bb81329e4164 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:57.516914 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1378/2786] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:21:57.521702 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aff077-659c-4b62-972f-bb81329e4164 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:57.543255 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aff077-659c-4b62-972f-bb81329e4164 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:57.554360 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5343b-bc31-497f-826c-4f5597938f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:57.555076 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5343b-bc31-497f-826c-4f5597938f5b admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:57.555351 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5343b-bc31-497f-826c-4f5597938f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:57.555925 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5343b-bc31-497f-826c-4f5597938f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:57.556852 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5343b-bc31-497f-826c-4f5597938f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:57.558726 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5343b-bc31-497f-826c-4f5597938f5b admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:57.570076 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1379/2787] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:21:57.581952 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5343b-bc31-497f-826c-4f5597938f5b admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:57.595933 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5343b-bc31-497f-826c-4f5597938f5b admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:57.605737 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed40e5c-faba-48a0-9c91-6f7179c3d168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:57.606913 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed40e5c-faba-48a0-9c91-6f7179c3d168 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:57.607259 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed40e5c-faba-48a0-9c91-6f7179c3d168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:57.607614 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed40e5c-faba-48a0-9c91-6f7179c3d168 admin admin] PATH_INFO: `/v3/projects/46b6fea8ab4d41648fa3dc45275122a0/users/f09910d3266f44e59b0274ae72e4ceca/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:57.650681 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed40e5c-faba-48a0-9c91-6f7179c3d168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b6fea8ab4d41648fa3dc45275122a0, user_id=f09910d3266f44e59b0274ae72e4ceca, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:57.659274 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed40e5c-faba-48a0-9c91-6f7179c3d168 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:57.733449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1d90196c-37ab-46ca-bd56-827428607be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5ea1801f0674e8297e2cd8a964333d4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:57.734367 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1d90196c-37ab-46ca-bd56-827428607be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5ea1801f0674e8297e2cd8a964333d4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:57.775577 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1d90196c-37ab-46ca-bd56-827428607be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5ea1801f0674e8297e2cd8a964333d4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:57.788013 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1d90196c-37ab-46ca-bd56-827428607be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5ea1801f0674e8297e2cd8a964333d4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:57.791552 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1d90196c-37ab-46ca-bd56-827428607be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5ea1801f0674e8297e2cd8a964333d4'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:57.840146 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1380/2788] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:21:57 2022] PUT /identity/v3/projects/46b6fea8ab4d41648fa3dc45275122a0/users/f09910d3266f44e59b0274ae72e4ceca/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:21:57.843964 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809ecff-dedb-49d8-bcb3-dae681527224 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:57.844417 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809ecff-dedb-49d8-bcb3-dae681527224 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:57.844831 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809ecff-dedb-49d8-bcb3-dae681527224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:57.898075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-8809ecff-dedb-49d8-bcb3-dae681527224 None None] MFA Rules not processed for user `f09910d3266f44e59b0274ae72e4ceca`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:57.899870 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-8809ecff-dedb-49d8-bcb3-dae681527224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:57.916200 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1409/2789] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:21:57 2022] DELETE /identity/v3/users/b5ea1801f0674e8297e2cd8a964333d4 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:21:58.027254 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1381/2790] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:21:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:21:58.032479 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90196c-37ab-46ca-bd56-827428607be9 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:58.034153 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-1d90196c-37ab-46ca-bd56-827428607be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:58.136608 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90196c-37ab-46ca-bd56-827428607be9 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:58.151333 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd9ba7-8eab-4c16-a7c4-a8bbea684e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:58.152161 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd9ba7-8eab-4c16-a7c4-a8bbea684e6c admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:58.152511 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd9ba7-8eab-4c16-a7c4-a8bbea684e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:58.152875 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd9ba7-8eab-4c16-a7c4-a8bbea684e6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:58.154159 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd9ba7-8eab-4c16-a7c4-a8bbea684e6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:58.156705 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd9ba7-8eab-4c16-a7c4-a8bbea684e6c admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:58.262226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1410/2791] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:21:58 2022] POST /identity/v3/projects => generated 393 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:21:58.266102 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809ecff-dedb-49d8-bcb3-dae681527224 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:58.344349 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd9ba7-8eab-4c16-a7c4-a8bbea684e6c admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:58.344665 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d7cd9ba7-8eab-4c16-a7c4-a8bbea684e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:58.391640 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809ecff-dedb-49d8-bcb3-dae681527224 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:58.477693 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e90f5-4253-4dc2-88a5-883258db9158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:58.479178 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e90f5-4253-4dc2-88a5-883258db9158 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:58.479605 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e90f5-4253-4dc2-88a5-883258db9158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:58.480040 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e90f5-4253-4dc2-88a5-883258db9158 admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:58.480896 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e90f5-4253-4dc2-88a5-883258db9158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:58.483195 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e90f5-4253-4dc2-88a5-883258db9158 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:58.488893 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd9ba7-8eab-4c16-a7c4-a8bbea684e6c admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:58.503928 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8422b33-547d-4d31-9fb7-b300ff7c217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:58.505700 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8422b33-547d-4d31-9fb7-b300ff7c217d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:58.509090 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8422b33-547d-4d31-9fb7-b300ff7c217d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:58.509487 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8422b33-547d-4d31-9fb7-b300ff7c217d admin admin] PATH_INFO: `/v3/projects/8d3245f4aa7b4332b05463ba37bd9f40` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:58.544959 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8422b33-547d-4d31-9fb7-b300ff7c217d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d3245f4aa7b4332b05463ba37bd9f40)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:58.550543 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8422b33-547d-4d31-9fb7-b300ff7c217d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:58.617741 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1382/2792] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:21:58 2022] POST /identity/v3/users => generated 303 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:21:58.621359 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e90f5-4253-4dc2-88a5-883258db9158 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:58.647006 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e90f5-4253-4dc2-88a5-883258db9158 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:58.654278 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8568ce2-9a43-4291-a999-d53df3513496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:58.655003 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8568ce2-9a43-4291-a999-d53df3513496 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:58.655281 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8568ce2-9a43-4291-a999-d53df3513496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:58.655557 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8568ce2-9a43-4291-a999-d53df3513496 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:58.656280 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8568ce2-9a43-4291-a999-d53df3513496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:58.657867 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8568ce2-9a43-4291-a999-d53df3513496 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:58.686693 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1383/2793] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:21:58.690274 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8568ce2-9a43-4291-a999-d53df3513496 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:58.702043 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b8422b33-547d-4d31-9fb7-b300ff7c217d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d3245f4aa7b4332b05463ba37bd9f40', 'request_id': 'req-b8422b33-547d-4d31-9fb7-b300ff7c217d'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:58.715095 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8568ce2-9a43-4291-a999-d53df3513496 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:58.788608 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b8422b33-547d-4d31-9fb7-b300ff7c217d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d3245f4aa7b4332b05463ba37bd9f40', 'request_id': 'req-b8422b33-547d-4d31-9fb7-b300ff7c217d'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:58.799030 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b8422b33-547d-4d31-9fb7-b300ff7c217d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d3245f4aa7b4332b05463ba37bd9f40', 'request_id': 'req-b8422b33-547d-4d31-9fb7-b300ff7c217d'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:58.803474 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f44ec-efc0-4f11-9e3d-74f9ae6c5df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:58.805629 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f44ec-efc0-4f11-9e3d-74f9ae6c5df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:58.806015 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f44ec-efc0-4f11-9e3d-74f9ae6c5df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:58.806390 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f44ec-efc0-4f11-9e3d-74f9ae6c5df5 admin admin] PATH_INFO: `/v3/projects/45853845fdbd4539b64894fdee198415/users/5f043d03c2334097b3a15b1b2b43b20f/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:58.814034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b8422b33-547d-4d31-9fb7-b300ff7c217d admin admin] The token cache is being invalidate because project 8d3245f4aa7b4332b05463ba37bd9f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:21:58.814553 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b8422b33-547d-4d31-9fb7-b300ff7c217d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:58.815505 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b8422b33-547d-4d31-9fb7-b300ff7c217d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:58.818188 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1411/2794] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:21:58 2022] DELETE /identity/v3/projects/8d3245f4aa7b4332b05463ba37bd9f40 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:21:58.822073 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8422b33-547d-4d31-9fb7-b300ff7c217d admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:58.824132 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-b8422b33-547d-4d31-9fb7-b300ff7c217d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:58.861860 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f44ec-efc0-4f11-9e3d-74f9ae6c5df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45853845fdbd4539b64894fdee198415, user_id=5f043d03c2334097b3a15b1b2b43b20f, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:58.864661 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f44ec-efc0-4f11-9e3d-74f9ae6c5df5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:58.866636 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8422b33-547d-4d31-9fb7-b300ff7c217d admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:58.892623 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3cd91-5595-411f-bcf6-aba2457c0784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:58.896903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3cd91-5595-411f-bcf6-aba2457c0784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:58.896903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3cd91-5595-411f-bcf6-aba2457c0784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:58.896903 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3cd91-5595-411f-bcf6-aba2457c0784 admin admin] PATH_INFO: `/v3/users/d5e846e3629e4bbe98f1e6e848165bf5` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:58.922453 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3cd91-5595-411f-bcf6-aba2457c0784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5e846e3629e4bbe98f1e6e848165bf5)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:58.924489 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3cd91-5595-411f-bcf6-aba2457c0784 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:58.952564 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1384/2795] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:21:58 2022] PUT /identity/v3/projects/45853845fdbd4539b64894fdee198415/users/5f043d03c2334097b3a15b1b2b43b20f/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:21:58.958111 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f44ec-efc0-4f11-9e3d-74f9ae6c5df5 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:58.960002 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-1c1f44ec-efc0-4f11-9e3d-74f9ae6c5df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:59.044795 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f44ec-efc0-4f11-9e3d-74f9ae6c5df5 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:59.050289 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a9d90-845e-4177-b5f8-869218ec298e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:59.051324 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a9d90-845e-4177-b5f8-869218ec298e admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:59.051699 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a9d90-845e-4177-b5f8-869218ec298e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:59.059032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a9d90-845e-4177-b5f8-869218ec298e admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:59.059032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a9d90-845e-4177-b5f8-869218ec298e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:59.059032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a9d90-845e-4177-b5f8-869218ec298e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:59.078277 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1385/2796] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:21:59.082221 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a9d90-845e-4177-b5f8-869218ec298e admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:59.097021 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-99a3cd91-5595-411f-bcf6-aba2457c0784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5e846e3629e4bbe98f1e6e848165bf5'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:59.097926 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-99a3cd91-5595-411f-bcf6-aba2457c0784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5e846e3629e4bbe98f1e6e848165bf5'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:59.098389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a9d90-845e-4177-b5f8-869218ec298e admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:59.106853 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34df53-5860-4131-bf13-10c938a4c27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:59.106853 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34df53-5860-4131-bf13-10c938a4c27e admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:59.106853 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34df53-5860-4131-bf13-10c938a4c27e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:59.106853 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34df53-5860-4131-bf13-10c938a4c27e admin admin] PATH_INFO: `/v3/projects/45853845fdbd4539b64894fdee198415/users/5f043d03c2334097b3a15b1b2b43b20f/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:59.108139 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34df53-5860-4131-bf13-10c938a4c27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=45853845fdbd4539b64894fdee198415, user_id=5f043d03c2334097b3a15b1b2b43b20f, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:59.111341 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34df53-5860-4131-bf13-10c938a4c27e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:59.117570 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-99a3cd91-5595-411f-bcf6-aba2457c0784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5e846e3629e4bbe98f1e6e848165bf5'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:59.133359 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-99a3cd91-5595-411f-bcf6-aba2457c0784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5e846e3629e4bbe98f1e6e848165bf5'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:59.134558 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-99a3cd91-5595-411f-bcf6-aba2457c0784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5e846e3629e4bbe98f1e6e848165bf5'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:21:59.134770 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1386/2797] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:21:59 2022] PUT /identity/v3/projects/45853845fdbd4539b64894fdee198415/users/5f043d03c2334097b3a15b1b2b43b20f/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:21:59.147396 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc384964-6024-4b60-9f6f-0aa0ec205249 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:59.147716 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc384964-6024-4b60-9f6f-0aa0ec205249 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:59.148523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc384964-6024-4b60-9f6f-0aa0ec205249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:59.185011 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-dc384964-6024-4b60-9f6f-0aa0ec205249 None None] MFA Rules not processed for user `5f043d03c2334097b3a15b1b2b43b20f`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:21:59.186705 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-dc384964-6024-4b60-9f6f-0aa0ec205249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:59.246496 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1412/2798] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:21:58 2022] DELETE /identity/v3/users/d5e846e3629e4bbe98f1e6e848165bf5 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:21:59.282180 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1387/2799] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:21:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:21:59.294337 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3cd91-5595-411f-bcf6-aba2457c0784 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:59.295870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-99a3cd91-5595-411f-bcf6-aba2457c0784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:59.385714 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3cd91-5595-411f-bcf6-aba2457c0784 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:59.396477 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b98a5b-b2f3-4fd6-9783-3a4e268450c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:59.399396 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b98a5b-b2f3-4fd6-9783-3a4e268450c8 service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:59.399889 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b98a5b-b2f3-4fd6-9783-3a4e268450c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:59.400152 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b98a5b-b2f3-4fd6-9783-3a4e268450c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:59.510252 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b98a5b-b2f3-4fd6-9783-3a4e268450c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:59.512651 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b98a5b-b2f3-4fd6-9783-3a4e268450c8 service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:59.532835 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1413/2800] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:21:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:21:59.625563 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc384964-6024-4b60-9f6f-0aa0ec205249 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:59.627691 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-dc384964-6024-4b60-9f6f-0aa0ec205249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:59.644945 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b98a5b-b2f3-4fd6-9783-3a4e268450c8 service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:21:59.648337 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d4b98a5b-b2f3-4fd6-9783-3a4e268450c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:59.722978 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc384964-6024-4b60-9f6f-0aa0ec205249 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:59.727466 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643e248-b38b-4b97-a7fd-108167e72d5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:59.728193 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643e248-b38b-4b97-a7fd-108167e72d5d service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:59.728541 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643e248-b38b-4b97-a7fd-108167e72d5d service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:59.728884 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643e248-b38b-4b97-a7fd-108167e72d5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:59.731101 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-8643e248-b38b-4b97-a7fd-108167e72d5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:21:59.762232 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b98a5b-b2f3-4fd6-9783-3a4e268450c8 service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:21:59.775350 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ddac2-fd4b-4dea-8484-6613b5c3dd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:21:59.776492 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ddac2-fd4b-4dea-8484-6613b5c3dd19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:21:59.776947 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ddac2-fd4b-4dea-8484-6613b5c3dd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:21:59.777397 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ddac2-fd4b-4dea-8484-6613b5c3dd19 admin admin] PATH_INFO: `/v3/projects/62596e5209834a61b3a68da289b17b80` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:21:59.805692 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ddac2-fd4b-4dea-8484-6613b5c3dd19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62596e5209834a61b3a68da289b17b80)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:59.807742 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ddac2-fd4b-4dea-8484-6613b5c3dd19 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:59.839117 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643e248-b38b-4b97-a7fd-108167e72d5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:21:59.842939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643e248-b38b-4b97-a7fd-108167e72d5d service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:21:59.854166 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1388/2801] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:21:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:21:59.979341 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1e0ddac2-fd4b-4dea-8484-6613b5c3dd19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62596e5209834a61b3a68da289b17b80', 'request_id': 'req-1e0ddac2-fd4b-4dea-8484-6613b5c3dd19'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:00.056723 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1e0ddac2-fd4b-4dea-8484-6613b5c3dd19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62596e5209834a61b3a68da289b17b80', 'request_id': 'req-1e0ddac2-fd4b-4dea-8484-6613b5c3dd19'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:00.068647 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1e0ddac2-fd4b-4dea-8484-6613b5c3dd19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62596e5209834a61b3a68da289b17b80', 'request_id': 'req-1e0ddac2-fd4b-4dea-8484-6613b5c3dd19'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:00.092216 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1e0ddac2-fd4b-4dea-8484-6613b5c3dd19 admin admin] The token cache is being invalidate because project 62596e5209834a61b3a68da289b17b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:22:00.092915 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1e0ddac2-fd4b-4dea-8484-6613b5c3dd19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:00.093897 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-1e0ddac2-fd4b-4dea-8484-6613b5c3dd19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:00.096362 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1414/2802] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:21:59 2022] DELETE /identity/v3/projects/62596e5209834a61b3a68da289b17b80 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:22:04.976810 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643e248-b38b-4b97-a7fd-108167e72d5d service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:04.978496 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-8643e248-b38b-4b97-a7fd-108167e72d5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:04.993287 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643e248-b38b-4b97-a7fd-108167e72d5d service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:05.057582 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa02de-34ba-4fc5-b032-0989732cce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:05.058572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa02de-34ba-4fc5-b032-0989732cce2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:05.058939 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa02de-34ba-4fc5-b032-0989732cce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:05.059277 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa02de-34ba-4fc5-b032-0989732cce2f admin admin] PATH_INFO: `/v3/users/f09910d3266f44e59b0274ae72e4ceca` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:05.062242 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa02de-34ba-4fc5-b032-0989732cce2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f09910d3266f44e59b0274ae72e4ceca)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:05.063958 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa02de-34ba-4fc5-b032-0989732cce2f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:05.322505 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6baa02de-34ba-4fc5-b032-0989732cce2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f09910d3266f44e59b0274ae72e4ceca'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:05.323555 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6baa02de-34ba-4fc5-b032-0989732cce2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f09910d3266f44e59b0274ae72e4ceca'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:05.338050 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6baa02de-34ba-4fc5-b032-0989732cce2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f09910d3266f44e59b0274ae72e4ceca'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:05.347583 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6baa02de-34ba-4fc5-b032-0989732cce2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f09910d3266f44e59b0274ae72e4ceca'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:05.439391 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-6baa02de-34ba-4fc5-b032-0989732cce2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f09910d3266f44e59b0274ae72e4ceca'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:05.446508 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1389/2803] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:22:04 2022] DELETE /identity/v3/users/f09910d3266f44e59b0274ae72e4ceca => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:22:05.451226 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23c303-9a55-4bfa-b8b7-295c3a7c7ff5 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:05.456561 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23c303-9a55-4bfa-b8b7-295c3a7c7ff5 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:05.456561 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23c303-9a55-4bfa-b8b7-295c3a7c7ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:05.469409 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-3c23c303-9a55-4bfa-b8b7-295c3a7c7ff5 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:22:05.470621 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-3c23c303-9a55-4bfa-b8b7-295c3a7c7ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:05.548910 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1415/2804] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:22:05.560805 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa02de-34ba-4fc5-b032-0989732cce2f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:05.562335 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-6baa02de-34ba-4fc5-b032-0989732cce2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:05.640133 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa02de-34ba-4fc5-b032-0989732cce2f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:05.643908 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cedb88-4cc3-48d8-b38e-e10d7d96bb2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:05.644550 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cedb88-4cc3-48d8-b38e-e10d7d96bb2e service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:05.644826 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cedb88-4cc3-48d8-b38e-e10d7d96bb2e service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:05.645096 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cedb88-4cc3-48d8-b38e-e10d7d96bb2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:05.654936 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cedb88-4cc3-48d8-b38e-e10d7d96bb2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:05.656372 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cedb88-4cc3-48d8-b38e-e10d7d96bb2e service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:05.668432 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1390/2805] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:22:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:22:06.166958 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23c303-9a55-4bfa-b8b7-295c3a7c7ff5 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:06.168424 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-3c23c303-9a55-4bfa-b8b7-295c3a7c7ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:06.186286 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23c303-9a55-4bfa-b8b7-295c3a7c7ff5 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:06.197188 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5732f1c-176b-450b-9f05-026a64d022b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:06.198123 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5732f1c-176b-450b-9f05-026a64d022b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:06.198401 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5732f1c-176b-450b-9f05-026a64d022b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:06.200838 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5732f1c-176b-450b-9f05-026a64d022b9 admin admin] PATH_INFO: `/v3/projects/46b6fea8ab4d41648fa3dc45275122a0` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:06.201568 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5732f1c-176b-450b-9f05-026a64d022b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46b6fea8ab4d41648fa3dc45275122a0)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:06.203625 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5732f1c-176b-450b-9f05-026a64d022b9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:06.331044 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5732f1c-176b-450b-9f05-026a64d022b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46b6fea8ab4d41648fa3dc45275122a0', 'request_id': 'req-b5732f1c-176b-450b-9f05-026a64d022b9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:06.405494 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5732f1c-176b-450b-9f05-026a64d022b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46b6fea8ab4d41648fa3dc45275122a0', 'request_id': 'req-b5732f1c-176b-450b-9f05-026a64d022b9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:06.414556 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5732f1c-176b-450b-9f05-026a64d022b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46b6fea8ab4d41648fa3dc45275122a0', 'request_id': 'req-b5732f1c-176b-450b-9f05-026a64d022b9'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:06.426307 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5732f1c-176b-450b-9f05-026a64d022b9 admin admin] The token cache is being invalidate because project 46b6fea8ab4d41648fa3dc45275122a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:22:06.427184 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5732f1c-176b-450b-9f05-026a64d022b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:06.428365 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-b5732f1c-176b-450b-9f05-026a64d022b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:06.430194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1416/2806] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:22:06 2022] DELETE /identity/v3/projects/46b6fea8ab4d41648fa3dc45275122a0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:22:06.435138 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cedb88-4cc3-48d8-b38e-e10d7d96bb2e service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:06.450943 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cedb88-4cc3-48d8-b38e-e10d7d96bb2e service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:06.513995 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653f7b5-f6fc-415e-b5d0-b5771391a881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:06.514902 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653f7b5-f6fc-415e-b5d0-b5771391a881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:06.515186 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653f7b5-f6fc-415e-b5d0-b5771391a881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:06.515465 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653f7b5-f6fc-415e-b5d0-b5771391a881 admin admin] PATH_INFO: `/v3/users/5f043d03c2334097b3a15b1b2b43b20f` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:06.516651 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653f7b5-f6fc-415e-b5d0-b5771391a881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f043d03c2334097b3a15b1b2b43b20f)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:06.518828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653f7b5-f6fc-415e-b5d0-b5771391a881 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:06.757523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d653f7b5-f6fc-415e-b5d0-b5771391a881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f043d03c2334097b3a15b1b2b43b20f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:06.758675 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d653f7b5-f6fc-415e-b5d0-b5771391a881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f043d03c2334097b3a15b1b2b43b20f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:06.775099 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d653f7b5-f6fc-415e-b5d0-b5771391a881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f043d03c2334097b3a15b1b2b43b20f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:06.784591 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d653f7b5-f6fc-415e-b5d0-b5771391a881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f043d03c2334097b3a15b1b2b43b20f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:06.867208 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-d653f7b5-f6fc-415e-b5d0-b5771391a881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f043d03c2334097b3a15b1b2b43b20f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:06.877580 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1391/2807] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:22:06 2022] DELETE /identity/v3/users/5f043d03c2334097b3a15b1b2b43b20f => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:22:07.588845 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5732f1c-176b-450b-9f05-026a64d022b9 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:07.588845 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-b5732f1c-176b-450b-9f05-026a64d022b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:07.598905 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5732f1c-176b-450b-9f05-026a64d022b9 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:07.663844 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816872e-11b2-4826-a329-32216a3a9ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:07.664744 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816872e-11b2-4826-a329-32216a3a9ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:07.665024 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816872e-11b2-4826-a329-32216a3a9ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:07.665301 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816872e-11b2-4826-a329-32216a3a9ee2 admin admin] PATH_INFO: `/v3/projects/45853845fdbd4539b64894fdee198415` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:07.666512 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816872e-11b2-4826-a329-32216a3a9ee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45853845fdbd4539b64894fdee198415)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:07.668622 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816872e-11b2-4826-a329-32216a3a9ee2 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:07.778997 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2816872e-11b2-4826-a329-32216a3a9ee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45853845fdbd4539b64894fdee198415', 'request_id': 'req-2816872e-11b2-4826-a329-32216a3a9ee2'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:07.917550 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2816872e-11b2-4826-a329-32216a3a9ee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45853845fdbd4539b64894fdee198415', 'request_id': 'req-2816872e-11b2-4826-a329-32216a3a9ee2'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:07.923559 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2816872e-11b2-4826-a329-32216a3a9ee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45853845fdbd4539b64894fdee198415', 'request_id': 'req-2816872e-11b2-4826-a329-32216a3a9ee2'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:07.935371 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2816872e-11b2-4826-a329-32216a3a9ee2 admin admin] The token cache is being invalidate because project 45853845fdbd4539b64894fdee198415 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:22:07.935660 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2816872e-11b2-4826-a329-32216a3a9ee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:07.936310 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-2816872e-11b2-4826-a329-32216a3a9ee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:07.937868 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1417/2808] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:22:07 2022] DELETE /identity/v3/projects/45853845fdbd4539b64894fdee198415 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:22:07.944350 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba06c43-9f67-49bb-83b5-c78990147607 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:07.944828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba06c43-9f67-49bb-83b5-c78990147607 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:07.944954 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba06c43-9f67-49bb-83b5-c78990147607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:07.972877 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-eba06c43-9f67-49bb-83b5-c78990147607 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:22:07.974047 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-eba06c43-9f67-49bb-83b5-c78990147607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:08.032884 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1392/2809] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:22:08.040740 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da98ac1-524c-4de4-a45c-0af096154074 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:08.041026 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da98ac1-524c-4de4-a45c-0af096154074 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:08.041294 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da98ac1-524c-4de4-a45c-0af096154074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:08.059549 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-9da98ac1-524c-4de4-a45c-0af096154074 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:22:08.060732 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-9da98ac1-524c-4de4-a45c-0af096154074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:08.068483 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1418/2810] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:22:08.073818 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba06c43-9f67-49bb-83b5-c78990147607 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:08.083405 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba06c43-9f67-49bb-83b5-c78990147607 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:08.088776 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425e590-050d-420b-9172-99773139ffc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:08.089410 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425e590-050d-420b-9172-99773139ffc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:08.089689 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425e590-050d-420b-9172-99773139ffc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:08.089959 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425e590-050d-420b-9172-99773139ffc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:08.090749 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425e590-050d-420b-9172-99773139ffc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:22:08.091061 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425e590-050d-420b-9172-99773139ffc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:08.095953 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425e590-050d-420b-9172-99773139ffc5 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:08.103862 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1393/2811] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:22:08.108160 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da98ac1-524c-4de4-a45c-0af096154074 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:08.118044 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da98ac1-524c-4de4-a45c-0af096154074 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:08.122944 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add91384-21f8-436c-a43a-b83bded6cdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:08.123578 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add91384-21f8-436c-a43a-b83bded6cdbc admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:08.123912 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add91384-21f8-436c-a43a-b83bded6cdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:08.124191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add91384-21f8-436c-a43a-b83bded6cdbc admin admin] PATH_INFO: `/v3/projects` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:08.124867 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add91384-21f8-436c-a43a-b83bded6cdbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:08.126796 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add91384-21f8-436c-a43a-b83bded6cdbc admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:08.284566 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1419/2812] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:22:08 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:22:08.289349 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425e590-050d-420b-9172-99773139ffc5 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:08.298902 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425e590-050d-420b-9172-99773139ffc5 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:08.353637 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bf49c-08ed-4385-945f-17c488e361cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:08.354292 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bf49c-08ed-4385-945f-17c488e361cd admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:08.354571 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bf49c-08ed-4385-945f-17c488e361cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:08.354875 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bf49c-08ed-4385-945f-17c488e361cd admin admin] PATH_INFO: `/v3/users` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:08.355544 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bf49c-08ed-4385-945f-17c488e361cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:08.357426 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bf49c-08ed-4385-945f-17c488e361cd admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:08.487695 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1394/2813] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:22:08 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:22:08.489025 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add91384-21f8-436c-a43a-b83bded6cdbc admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:08.500526 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add91384-21f8-436c-a43a-b83bded6cdbc admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:08.505165 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8824d-58d6-4d90-ac13-345c542150a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:08.505901 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8824d-58d6-4d90-ac13-345c542150a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:08.506194 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8824d-58d6-4d90-ac13-345c542150a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:08.506513 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8824d-58d6-4d90-ac13-345c542150a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:08.507294 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8824d-58d6-4d90-ac13-345c542150a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:08.508875 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8824d-58d6-4d90-ac13-345c542150a0 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:08.519364 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1420/2814] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:22:08.523479 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bf49c-08ed-4385-945f-17c488e361cd admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:08.536860 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bf49c-08ed-4385-945f-17c488e361cd admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:08.542834 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd0ec3-07fa-4c90-96fb-01152fba0b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:08.543566 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd0ec3-07fa-4c90-96fb-01152fba0b78 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:08.543918 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd0ec3-07fa-4c90-96fb-01152fba0b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:08.544307 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd0ec3-07fa-4c90-96fb-01152fba0b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:08.545202 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd0ec3-07fa-4c90-96fb-01152fba0b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:08.546810 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd0ec3-07fa-4c90-96fb-01152fba0b78 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:08.557716 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1395/2815] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:22:08.561947 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8824d-58d6-4d90-ac13-345c542150a0 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:08.572039 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8824d-58d6-4d90-ac13-345c542150a0 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:08.576645 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ff175-047a-486d-8681-4c5fac075d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:08.577617 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ff175-047a-486d-8681-4c5fac075d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:08.577898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ff175-047a-486d-8681-4c5fac075d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:08.578172 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ff175-047a-486d-8681-4c5fac075d6b admin admin] PATH_INFO: `/v3/projects/b6f8c22cfaac48ccaedeab6b357db064/users/5399364ef70344a49728edf11de0585b/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:08.593527 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ff175-047a-486d-8681-4c5fac075d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f8c22cfaac48ccaedeab6b357db064, user_id=5399364ef70344a49728edf11de0585b, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:08.596178 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ff175-047a-486d-8681-4c5fac075d6b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:08.719058 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1421/2816] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:22:08 2022] PUT /identity/v3/projects/b6f8c22cfaac48ccaedeab6b357db064/users/5399364ef70344a49728edf11de0585b/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:22:08.730208 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141366d-5c87-486e-adc5-194aeb8a1692 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:08.730490 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141366d-5c87-486e-adc5-194aeb8a1692 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:08.730798 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141366d-5c87-486e-adc5-194aeb8a1692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:08.742492 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a7f5f-addc-46e3-b6b2-cf2530e4d4fa None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:08.743509 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a7f5f-addc-46e3-b6b2-cf2530e4d4fa None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:08.743509 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a7f5f-addc-46e3-b6b2-cf2530e4d4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:08.760082 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-6e3a7f5f-addc-46e3-b6b2-cf2530e4d4fa None None] MFA Rules not processed for user `34d53bd8a6b84f38897666568873a36b`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:22:08.761263 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-3141366d-5c87-486e-adc5-194aeb8a1692 None None] MFA Rules not processed for user `5399364ef70344a49728edf11de0585b`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:22:08.761416 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-6e3a7f5f-addc-46e3-b6b2-cf2530e4d4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:08.762455 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-3141366d-5c87-486e-adc5-194aeb8a1692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:08.816749 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1422/2817] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:22:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:22:08.826802 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1396/2818] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:22:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:22:08.837699 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a7f5f-addc-46e3-b6b2-cf2530e4d4fa None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:08.839623 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-6e3a7f5f-addc-46e3-b6b2-cf2530e4d4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:08.899608 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a7f5f-addc-46e3-b6b2-cf2530e4d4fa None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:08.903464 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afa959-fd84-4c0d-b68a-03e97bb06eda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:08.904127 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afa959-fd84-4c0d-b68a-03e97bb06eda service cinder] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:08.904403 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afa959-fd84-4c0d-b68a-03e97bb06eda service cinder] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:08.904674 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afa959-fd84-4c0d-b68a-03e97bb06eda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:08.913248 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afa959-fd84-4c0d-b68a-03e97bb06eda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:08.914933 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afa959-fd84-4c0d-b68a-03e97bb06eda service cinder] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:08.923819 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1423/2819] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:22:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:22:08.943955 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141366d-5c87-486e-adc5-194aeb8a1692 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:09.006085 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141366d-5c87-486e-adc5-194aeb8a1692 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:09.011403 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c3179-4116-4952-80d9-9ec893e9a085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:09.012274 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3179-4116-4952-80d9-9ec893e9a085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:09.012557 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3179-4116-4952-80d9-9ec893e9a085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:09.012833 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3179-4116-4952-80d9-9ec893e9a085 admin admin] PATH_INFO: `/v3/users/5399364ef70344a49728edf11de0585b` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:09.014042 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c3179-4116-4952-80d9-9ec893e9a085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5399364ef70344a49728edf11de0585b)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:09.015990 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c3179-4116-4952-80d9-9ec893e9a085 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:09.076047 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afa959-fd84-4c0d-b68a-03e97bb06eda service cinder] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:09.077437 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-c4afa959-fd84-4c0d-b68a-03e97bb06eda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:09.133607 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afa959-fd84-4c0d-b68a-03e97bb06eda service cinder] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:09.137235 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94171840-90fd-4f35-a1ba-66bc245f2a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:09.137866 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94171840-90fd-4f35-a1ba-66bc245f2a74 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:09.138145 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94171840-90fd-4f35-a1ba-66bc245f2a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:09.138663 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94171840-90fd-4f35-a1ba-66bc245f2a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:09.140262 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-94171840-90fd-4f35-a1ba-66bc245f2a74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:09.150535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94171840-90fd-4f35-a1ba-66bc245f2a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:09.152006 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94171840-90fd-4f35-a1ba-66bc245f2a74 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:09.159954 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1424/2820] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:22:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:22:09.218554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-cd7c3179-4116-4952-80d9-9ec893e9a085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5399364ef70344a49728edf11de0585b'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:09.219235 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-cd7c3179-4116-4952-80d9-9ec893e9a085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5399364ef70344a49728edf11de0585b'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:09.230875 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-cd7c3179-4116-4952-80d9-9ec893e9a085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5399364ef70344a49728edf11de0585b'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:09.237617 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-cd7c3179-4116-4952-80d9-9ec893e9a085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5399364ef70344a49728edf11de0585b'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:09.320378 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-cd7c3179-4116-4952-80d9-9ec893e9a085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5399364ef70344a49728edf11de0585b'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:09.326805 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1397/2821] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:22:08 2022] DELETE /identity/v3/users/5399364ef70344a49728edf11de0585b => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:22:09.331523 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e57ed6-47cb-4ea7-aed5-fc1718b7d0df None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:09.331968 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e57ed6-47cb-4ea7-aed5-fc1718b7d0df None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:09.332310 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e57ed6-47cb-4ea7-aed5-fc1718b7d0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:09.350045 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-d3e57ed6-47cb-4ea7-aed5-fc1718b7d0df None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:22:09.352449 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d3e57ed6-47cb-4ea7-aed5-fc1718b7d0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:09.414202 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1425/2822] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:22:09.423998 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c3179-4116-4952-80d9-9ec893e9a085 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:09.425558 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-cd7c3179-4116-4952-80d9-9ec893e9a085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:09.481218 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c3179-4116-4952-80d9-9ec893e9a085 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:09.485095 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816f7c1-4122-4880-a9e6-dd033d8936c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:09.485730 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816f7c1-4122-4880-a9e6-dd033d8936c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:09.486009 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816f7c1-4122-4880-a9e6-dd033d8936c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:09.486286 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816f7c1-4122-4880-a9e6-dd033d8936c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:09.495547 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816f7c1-4122-4880-a9e6-dd033d8936c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:09.497205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816f7c1-4122-4880-a9e6-dd033d8936c2 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:09.506554 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1398/2823] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:22:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:22:09.564216 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e57ed6-47cb-4ea7-aed5-fc1718b7d0df None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:09.566128 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d3e57ed6-47cb-4ea7-aed5-fc1718b7d0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:09.645088 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e57ed6-47cb-4ea7-aed5-fc1718b7d0df None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:09.651141 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a21fdf-dc5d-437b-9268-de1e21481929 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae711b94b32a431ab880aa8f6068ff25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:09.651784 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a21fdf-dc5d-437b-9268-de1e21481929 service placement] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:09.652066 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a21fdf-dc5d-437b-9268-de1e21481929 service placement] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:09.652344 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a21fdf-dc5d-437b-9268-de1e21481929 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:09.654103 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-09a21fdf-dc5d-437b-9268-de1e21481929 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:09.666431 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a21fdf-dc5d-437b-9268-de1e21481929 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:09.668106 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a21fdf-dc5d-437b-9268-de1e21481929 service placement] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:09.677870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1426/2824] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:22:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:22:09.960651 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816f7c1-4122-4880-a9e6-dd033d8936c2 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:09.968564 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-a816f7c1-4122-4880-a9e6-dd033d8936c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:09.976208 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816f7c1-4122-4880-a9e6-dd033d8936c2 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:09.981701 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258820a0-e5ae-4735-9830-f69449cfd569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:09.983342 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258820a0-e5ae-4735-9830-f69449cfd569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:09.983633 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258820a0-e5ae-4735-9830-f69449cfd569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:09.983900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258820a0-e5ae-4735-9830-f69449cfd569 admin admin] PATH_INFO: `/v3/projects/b6f8c22cfaac48ccaedeab6b357db064` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:09.985104 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258820a0-e5ae-4735-9830-f69449cfd569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6f8c22cfaac48ccaedeab6b357db064)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:09.987216 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258820a0-e5ae-4735-9830-f69449cfd569 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:10.078906 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-258820a0-e5ae-4735-9830-f69449cfd569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6f8c22cfaac48ccaedeab6b357db064', 'request_id': 'req-258820a0-e5ae-4735-9830-f69449cfd569'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:10.163114 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-258820a0-e5ae-4735-9830-f69449cfd569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6f8c22cfaac48ccaedeab6b357db064', 'request_id': 'req-258820a0-e5ae-4735-9830-f69449cfd569'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:10.169227 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-258820a0-e5ae-4735-9830-f69449cfd569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6f8c22cfaac48ccaedeab6b357db064', 'request_id': 'req-258820a0-e5ae-4735-9830-f69449cfd569'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:10.180706 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-258820a0-e5ae-4735-9830-f69449cfd569 admin admin] The token cache is being invalidate because project b6f8c22cfaac48ccaedeab6b357db064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:22:10.180996 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-258820a0-e5ae-4735-9830-f69449cfd569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:10.181653 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-258820a0-e5ae-4735-9830-f69449cfd569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:10.183225 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1399/2825] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:22:09 2022] DELETE /identity/v3/projects/b6f8c22cfaac48ccaedeab6b357db064 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:22:10.188221 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e800be5-eac1-4b4a-8c58-50e41e249b23 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:10.188590 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e800be5-eac1-4b4a-8c58-50e41e249b23 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:10.188941 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e800be5-eac1-4b4a-8c58-50e41e249b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:10.206923 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-5e800be5-eac1-4b4a-8c58-50e41e249b23 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:22:10.208118 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5e800be5-eac1-4b4a-8c58-50e41e249b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:10.268788 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1427/2826] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:22:10.278250 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105a8e4-8bac-40cd-8782-07085a55a52c None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:10.278569 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105a8e4-8bac-40cd-8782-07085a55a52c None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:10.279891 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105a8e4-8bac-40cd-8782-07085a55a52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:10.297325 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-4105a8e4-8bac-40cd-8782-07085a55a52c None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:22:10.298519 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-4105a8e4-8bac-40cd-8782-07085a55a52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:10.306747 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1400/2827] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:22:10.310835 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e800be5-eac1-4b4a-8c58-50e41e249b23 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:10.320961 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e800be5-eac1-4b4a-8c58-50e41e249b23 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:10.325574 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3ea93-62f6-41d3-81f1-4458889c472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:10.326218 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3ea93-62f6-41d3-81f1-4458889c472b admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:10.326498 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3ea93-62f6-41d3-81f1-4458889c472b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:10.326810 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3ea93-62f6-41d3-81f1-4458889c472b admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:10.327551 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3ea93-62f6-41d3-81f1-4458889c472b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:22:10.327854 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3ea93-62f6-41d3-81f1-4458889c472b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:10.329433 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3ea93-62f6-41d3-81f1-4458889c472b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:10.341704 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1428/2828] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:22:10.346044 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105a8e4-8bac-40cd-8782-07085a55a52c None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:10.356177 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105a8e4-8bac-40cd-8782-07085a55a52c None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:10.361090 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731347f-ea45-423e-a381-f27ef2ca9040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:10.361731 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731347f-ea45-423e-a381-f27ef2ca9040 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:10.366026 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731347f-ea45-423e-a381-f27ef2ca9040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:10.366026 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731347f-ea45-423e-a381-f27ef2ca9040 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:10.366026 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731347f-ea45-423e-a381-f27ef2ca9040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:10.366026 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731347f-ea45-423e-a381-f27ef2ca9040 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:10.520868 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1401/2829] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:22:10 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:22:10.526153 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3ea93-62f6-41d3-81f1-4458889c472b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:10.536455 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3ea93-62f6-41d3-81f1-4458889c472b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:10.594120 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff859f5-4774-469a-9911-346a66ee67a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:10.594873 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff859f5-4774-469a-9911-346a66ee67a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:10.595152 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff859f5-4774-469a-9911-346a66ee67a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:10.595424 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff859f5-4774-469a-9911-346a66ee67a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:10.596116 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff859f5-4774-469a-9911-346a66ee67a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:10.598011 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff859f5-4774-469a-9911-346a66ee67a9 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:10.702636 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1429/2830] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:22:10 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:22:10.706622 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731347f-ea45-423e-a381-f27ef2ca9040 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:10.717489 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731347f-ea45-423e-a381-f27ef2ca9040 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:10.723735 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f016019-e4bb-42a9-8574-29172fe2eb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:10.723735 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f016019-e4bb-42a9-8574-29172fe2eb0d admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:10.723735 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f016019-e4bb-42a9-8574-29172fe2eb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:10.723735 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f016019-e4bb-42a9-8574-29172fe2eb0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:10.724143 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f016019-e4bb-42a9-8574-29172fe2eb0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:10.725714 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f016019-e4bb-42a9-8574-29172fe2eb0d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:10.735760 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1402/2831] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:22:10.739602 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff859f5-4774-469a-9911-346a66ee67a9 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:10.753581 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff859f5-4774-469a-9911-346a66ee67a9 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:10.759281 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0103b84-cb93-4382-9030-2bf432269e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:10.759931 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0103b84-cb93-4382-9030-2bf432269e26 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:10.760232 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0103b84-cb93-4382-9030-2bf432269e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:10.760506 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0103b84-cb93-4382-9030-2bf432269e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:10.761243 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0103b84-cb93-4382-9030-2bf432269e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:10.762838 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0103b84-cb93-4382-9030-2bf432269e26 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:10.773327 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1430/2832] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:22:10.777831 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f016019-e4bb-42a9-8574-29172fe2eb0d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:10.788218 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f016019-e4bb-42a9-8574-29172fe2eb0d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:10.793158 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feceac2-c65b-4d92-aa53-bc64df572a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:10.794024 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feceac2-c65b-4d92-aa53-bc64df572a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:10.794306 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feceac2-c65b-4d92-aa53-bc64df572a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:10.794704 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feceac2-c65b-4d92-aa53-bc64df572a2d admin admin] PATH_INFO: `/v3/projects/e4eb8a6d1e52451986b709807fd63703/users/b4841032c12c44d29d91be0b50425e74/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:10.809752 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feceac2-c65b-4d92-aa53-bc64df572a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4eb8a6d1e52451986b709807fd63703, user_id=b4841032c12c44d29d91be0b50425e74, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:10.812453 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feceac2-c65b-4d92-aa53-bc64df572a2d admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:10.869762 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1403/2833] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:22:10 2022] PUT /identity/v3/projects/e4eb8a6d1e52451986b709807fd63703/users/b4841032c12c44d29d91be0b50425e74/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:22:10.880216 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e253f-a647-4545-b207-a3b19888b8b5 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:10.880501 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e253f-a647-4545-b207-a3b19888b8b5 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:10.880774 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e253f-a647-4545-b207-a3b19888b8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:10.908601 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-1b5e253f-a647-4545-b207-a3b19888b8b5 None None] MFA Rules not processed for user `b4841032c12c44d29d91be0b50425e74`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:22:10.909898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-1b5e253f-a647-4545-b207-a3b19888b8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:10.971969 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1431/2834] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:22:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:22:10.982701 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feceac2-c65b-4d92-aa53-bc64df572a2d admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:10.984396 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-5feceac2-c65b-4d92-aa53-bc64df572a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:11.042010 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feceac2-c65b-4d92-aa53-bc64df572a2d admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:11.045796 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31d61f-a689-473b-9556-0744f206ed90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:11.046507 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31d61f-a689-473b-9556-0744f206ed90 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:11.046813 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31d61f-a689-473b-9556-0744f206ed90 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:11.051977 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31d61f-a689-473b-9556-0744f206ed90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:11.056541 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31d61f-a689-473b-9556-0744f206ed90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:11.057968 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31d61f-a689-473b-9556-0744f206ed90 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:11.066790 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1404/2835] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:22:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:22:12.481552 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3409384-6107-4bc3-b801-60f95df18809 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:12.481552 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3409384-6107-4bc3-b801-60f95df18809 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:12.481552 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3409384-6107-4bc3-b801-60f95df18809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:12.500524 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-d3409384-6107-4bc3-b801-60f95df18809 None None] MFA Rules not processed for user `fa9ea7738c634318a532ebca2e564745`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:22:12.501814 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-d3409384-6107-4bc3-b801-60f95df18809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:12.558778 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1432/2836] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Feb 16 17:22:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:22:12.571614 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31d61f-a689-473b-9556-0744f206ed90 service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:12.572989 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-7c31d61f-a689-473b-9556-0744f206ed90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:12.640399 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31d61f-a689-473b-9556-0744f206ed90 service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:12.645490 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fe5f8-4bb4-43ef-8806-dffd8c9765fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc59cb98783b4353a405b8b9a3a9d592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:12.646123 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe5f8-4bb4-43ef-8806-dffd8c9765fd service swift] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:12.646484 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe5f8-4bb4-43ef-8806-dffd8c9765fd service swift] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:12.646817 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe5f8-4bb4-43ef-8806-dffd8c9765fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:12.656407 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fe5f8-4bb4-43ef-8806-dffd8c9765fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:12.660124 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fe5f8-4bb4-43ef-8806-dffd8c9765fd service swift] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:12.666902 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1405/2837] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Feb 16 17:22:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 17:22:15.503331 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3409384-6107-4bc3-b801-60f95df18809 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:15.607219 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3409384-6107-4bc3-b801-60f95df18809 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:15.620123 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cf46b-b021-490f-a070-315723b9fdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:15.622388 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cf46b-b021-490f-a070-315723b9fdda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:15.622886 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cf46b-b021-490f-a070-315723b9fdda admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:15.628179 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cf46b-b021-490f-a070-315723b9fdda admin admin] PATH_INFO: `/v3/users/b4841032c12c44d29d91be0b50425e74` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:15.628179 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cf46b-b021-490f-a070-315723b9fdda admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4841032c12c44d29d91be0b50425e74)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:15.628179 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cf46b-b021-490f-a070-315723b9fdda admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:15.824048 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f75cf46b-b021-490f-a070-315723b9fdda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4841032c12c44d29d91be0b50425e74'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:15.824629 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f75cf46b-b021-490f-a070-315723b9fdda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4841032c12c44d29d91be0b50425e74'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:15.838046 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f75cf46b-b021-490f-a070-315723b9fdda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4841032c12c44d29d91be0b50425e74'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:15.845099 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f75cf46b-b021-490f-a070-315723b9fdda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4841032c12c44d29d91be0b50425e74'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:15.845862 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-f75cf46b-b021-490f-a070-315723b9fdda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4841032c12c44d29d91be0b50425e74'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:15.919097 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1433/2838] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:22:15 2022] DELETE /identity/v3/users/b4841032c12c44d29d91be0b50425e74 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:22:15.924032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059607db-9476-44ba-b75d-749e5374ed02 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:15.925017 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059607db-9476-44ba-b75d-749e5374ed02 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:15.925738 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059607db-9476-44ba-b75d-749e5374ed02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:15.946233 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-059607db-9476-44ba-b75d-749e5374ed02 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:22:15.951465 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-059607db-9476-44ba-b75d-749e5374ed02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:16.016498 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1406/2839] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:22:16.026893 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cf46b-b021-490f-a070-315723b9fdda admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:16.028371 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-f75cf46b-b021-490f-a070-315723b9fdda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:16.091657 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cf46b-b021-490f-a070-315723b9fdda admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:16.096746 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653995b2-14b8-4b59-9d93-9fa6787a2560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:16.097407 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653995b2-14b8-4b59-9d93-9fa6787a2560 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:16.097697 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653995b2-14b8-4b59-9d93-9fa6787a2560 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:16.097967 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653995b2-14b8-4b59-9d93-9fa6787a2560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:16.108022 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653995b2-14b8-4b59-9d93-9fa6787a2560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:16.109459 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653995b2-14b8-4b59-9d93-9fa6787a2560 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:16.121002 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1434/2840] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:22:16.737389 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059607db-9476-44ba-b75d-749e5374ed02 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:16.739104 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-059607db-9476-44ba-b75d-749e5374ed02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:16.791089 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059607db-9476-44ba-b75d-749e5374ed02 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:16.798513 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270f98c-ca84-4354-946e-f03a62155fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:16.799985 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270f98c-ca84-4354-946e-f03a62155fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:16.800270 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270f98c-ca84-4354-946e-f03a62155fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:16.800547 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270f98c-ca84-4354-946e-f03a62155fe4 admin admin] PATH_INFO: `/v3/projects/e4eb8a6d1e52451986b709807fd63703` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:16.802096 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270f98c-ca84-4354-946e-f03a62155fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4eb8a6d1e52451986b709807fd63703)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:16.804997 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270f98c-ca84-4354-946e-f03a62155fe4 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:16.950351 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f270f98c-ca84-4354-946e-f03a62155fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4eb8a6d1e52451986b709807fd63703', 'request_id': 'req-f270f98c-ca84-4354-946e-f03a62155fe4'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:17.039200 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f270f98c-ca84-4354-946e-f03a62155fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4eb8a6d1e52451986b709807fd63703', 'request_id': 'req-f270f98c-ca84-4354-946e-f03a62155fe4'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:17.045141 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f270f98c-ca84-4354-946e-f03a62155fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4eb8a6d1e52451986b709807fd63703', 'request_id': 'req-f270f98c-ca84-4354-946e-f03a62155fe4'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:17.056516 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f270f98c-ca84-4354-946e-f03a62155fe4 admin admin] The token cache is being invalidate because project e4eb8a6d1e52451986b709807fd63703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:22:17.056800 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f270f98c-ca84-4354-946e-f03a62155fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:17.057425 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-f270f98c-ca84-4354-946e-f03a62155fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:17.058985 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1407/2841] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:22:16 2022] DELETE /identity/v3/projects/e4eb8a6d1e52451986b709807fd63703 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:22:17.065726 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dab19c-6676-436a-bf28-1504965f0ebe None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:17.065726 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dab19c-6676-436a-bf28-1504965f0ebe None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:17.065726 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dab19c-6676-436a-bf28-1504965f0ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:17.083498 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-43dab19c-6676-436a-bf28-1504965f0ebe None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:22:17.084733 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-43dab19c-6676-436a-bf28-1504965f0ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:17.152095 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1435/2842] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:22:17.159803 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778e9f9-4084-4cfd-8120-76f50cd61e6f None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:17.160088 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778e9f9-4084-4cfd-8120-76f50cd61e6f None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:17.160360 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778e9f9-4084-4cfd-8120-76f50cd61e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:17.182256 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-7778e9f9-4084-4cfd-8120-76f50cd61e6f None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:22:17.183606 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-7778e9f9-4084-4cfd-8120-76f50cd61e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:17.191518 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1408/2843] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:22:17.196918 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dab19c-6676-436a-bf28-1504965f0ebe None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:17.207221 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dab19c-6676-436a-bf28-1504965f0ebe None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:17.213154 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7953429-9b86-45e0-bbea-d7216797cfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:17.213817 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7953429-9b86-45e0-bbea-d7216797cfb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:17.214097 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7953429-9b86-45e0-bbea-d7216797cfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:17.214370 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7953429-9b86-45e0-bbea-d7216797cfb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:17.215125 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7953429-9b86-45e0-bbea-d7216797cfb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:22:17.215435 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7953429-9b86-45e0-bbea-d7216797cfb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:17.217173 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7953429-9b86-45e0-bbea-d7216797cfb0 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:17.234249 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1436/2844] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:22:17.235200 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778e9f9-4084-4cfd-8120-76f50cd61e6f None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:17.245686 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778e9f9-4084-4cfd-8120-76f50cd61e6f None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:17.250806 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a853d3f-b5c9-4191-b60b-19b208cf6273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:17.254624 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a853d3f-b5c9-4191-b60b-19b208cf6273 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:17.254624 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a853d3f-b5c9-4191-b60b-19b208cf6273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:17.254624 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a853d3f-b5c9-4191-b60b-19b208cf6273 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:17.254624 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a853d3f-b5c9-4191-b60b-19b208cf6273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:17.254624 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a853d3f-b5c9-4191-b60b-19b208cf6273 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:17.351152 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1409/2845] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:22:17 2022] POST /identity/v3/projects => generated 399 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:22:17.355711 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7953429-9b86-45e0-bbea-d7216797cfb0 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:17.370777 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7953429-9b86-45e0-bbea-d7216797cfb0 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:17.440067 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844a11f-84c0-4ac6-b9b1-f4c8539c2083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:17.440742 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844a11f-84c0-4ac6-b9b1-f4c8539c2083 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:17.441026 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844a11f-84c0-4ac6-b9b1-f4c8539c2083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:17.441302 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844a11f-84c0-4ac6-b9b1-f4c8539c2083 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:17.441994 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844a11f-84c0-4ac6-b9b1-f4c8539c2083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:17.444706 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844a11f-84c0-4ac6-b9b1-f4c8539c2083 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:17.573173 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1437/2846] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:22:17 2022] POST /identity/v3/users => generated 300 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:22:17.577238 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a853d3f-b5c9-4191-b60b-19b208cf6273 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:17.588352 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a853d3f-b5c9-4191-b60b-19b208cf6273 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:17.592966 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d4868-fa97-4275-91e3-e00fa08ec84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:17.593618 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d4868-fa97-4275-91e3-e00fa08ec84c admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:17.593900 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d4868-fa97-4275-91e3-e00fa08ec84c admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:17.594178 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d4868-fa97-4275-91e3-e00fa08ec84c admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:17.595057 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d4868-fa97-4275-91e3-e00fa08ec84c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:17.596668 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d4868-fa97-4275-91e3-e00fa08ec84c admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:17.607237 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1410/2847] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:22:17.611926 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844a11f-84c0-4ac6-b9b1-f4c8539c2083 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:17.623353 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844a11f-84c0-4ac6-b9b1-f4c8539c2083 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:17.628337 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7751c-fbce-457a-8a98-5a544f0cef0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:17.629324 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7751c-fbce-457a-8a98-5a544f0cef0d admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:17.629785 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7751c-fbce-457a-8a98-5a544f0cef0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:17.630210 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7751c-fbce-457a-8a98-5a544f0cef0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:17.631236 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7751c-fbce-457a-8a98-5a544f0cef0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:17.633591 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7751c-fbce-457a-8a98-5a544f0cef0d admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:17.644655 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1438/2848] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:22:17.649213 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d4868-fa97-4275-91e3-e00fa08ec84c admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:17.668082 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d4868-fa97-4275-91e3-e00fa08ec84c admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:17.673153 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278199a-1016-4acd-90ab-a8e3e9227bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:17.674118 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278199a-1016-4acd-90ab-a8e3e9227bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:17.674474 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278199a-1016-4acd-90ab-a8e3e9227bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:17.674850 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278199a-1016-4acd-90ab-a8e3e9227bd6 admin admin] PATH_INFO: `/v3/projects/88273644661942cf8182d2d075fe766e/users/9361d03fbe86458d81029b88aacb9f7e/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:17.696468 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278199a-1016-4acd-90ab-a8e3e9227bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88273644661942cf8182d2d075fe766e, user_id=9361d03fbe86458d81029b88aacb9f7e, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:17.699165 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278199a-1016-4acd-90ab-a8e3e9227bd6 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:17.800783 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1411/2849] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:22:17 2022] PUT /identity/v3/projects/88273644661942cf8182d2d075fe766e/users/9361d03fbe86458d81029b88aacb9f7e/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:22:17.812620 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451753a-353a-481f-9318-ce3faf414456 None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:17.820831 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451753a-353a-481f-9318-ce3faf414456 None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:17.820831 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451753a-353a-481f-9318-ce3faf414456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:17.842374 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-5451753a-353a-481f-9318-ce3faf414456 None None] MFA Rules not processed for user `9361d03fbe86458d81029b88aacb9f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:22:17.843729 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5451753a-353a-481f-9318-ce3faf414456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:17.946325 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1439/2850] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:22:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 17:22:17.959555 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278199a-1016-4acd-90ab-a8e3e9227bd6 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:17.961584 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-3278199a-1016-4acd-90ab-a8e3e9227bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:18.042342 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278199a-1016-4acd-90ab-a8e3e9227bd6 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:18.046096 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1b5e7-846a-4615-a829-bd1215101734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:18.046780 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1b5e7-846a-4615-a829-bd1215101734 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:18.047058 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1b5e7-846a-4615-a829-bd1215101734 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:18.047330 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1b5e7-846a-4615-a829-bd1215101734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:18.057011 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1b5e7-846a-4615-a829-bd1215101734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:18.058358 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1b5e7-846a-4615-a829-bd1215101734 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:18.067415 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1412/2851] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:22:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:22:30.154554 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451753a-353a-481f-9318-ce3faf414456 None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:30.216817 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451753a-353a-481f-9318-ce3faf414456 None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:30.221373 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d63fb-32af-45c1-90bb-b9e0339231b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:30.222257 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d63fb-32af-45c1-90bb-b9e0339231b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:30.222535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d63fb-32af-45c1-90bb-b9e0339231b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:30.222838 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d63fb-32af-45c1-90bb-b9e0339231b7 admin admin] PATH_INFO: `/v3/users/9361d03fbe86458d81029b88aacb9f7e` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:30.224021 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d63fb-32af-45c1-90bb-b9e0339231b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9361d03fbe86458d81029b88aacb9f7e)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:30.226081 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d63fb-32af-45c1-90bb-b9e0339231b7 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:30.447027 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-c59d63fb-32af-45c1-90bb-b9e0339231b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9361d03fbe86458d81029b88aacb9f7e'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:30.447688 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-c59d63fb-32af-45c1-90bb-b9e0339231b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9361d03fbe86458d81029b88aacb9f7e'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:30.458978 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-c59d63fb-32af-45c1-90bb-b9e0339231b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9361d03fbe86458d81029b88aacb9f7e'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:30.465749 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-c59d63fb-32af-45c1-90bb-b9e0339231b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9361d03fbe86458d81029b88aacb9f7e'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:30.466454 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-c59d63fb-32af-45c1-90bb-b9e0339231b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9361d03fbe86458d81029b88aacb9f7e'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:30.524154 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1440/2852] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:22:30 2022] DELETE /identity/v3/users/9361d03fbe86458d81029b88aacb9f7e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:22:30.528702 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776509a8-9bf1-404b-b6d0-645e18912445 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:30.529222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776509a8-9bf1-404b-b6d0-645e18912445 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:30.529222 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776509a8-9bf1-404b-b6d0-645e18912445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:30.546762 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-776509a8-9bf1-404b-b6d0-645e18912445 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:22:30.547940 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-776509a8-9bf1-404b-b6d0-645e18912445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:30.605348 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1413/2853] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:22:30.615216 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d63fb-32af-45c1-90bb-b9e0339231b7 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:30.617262 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-c59d63fb-32af-45c1-90bb-b9e0339231b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:30.673553 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d63fb-32af-45c1-90bb-b9e0339231b7 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:30.677179 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b891e-670a-4418-b7c5-d6fec454fb25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:30.677819 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b891e-670a-4418-b7c5-d6fec454fb25 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:30.678099 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b891e-670a-4418-b7c5-d6fec454fb25 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:30.678370 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b891e-670a-4418-b7c5-d6fec454fb25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:30.688361 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b891e-670a-4418-b7c5-d6fec454fb25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:30.689832 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b891e-670a-4418-b7c5-d6fec454fb25 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:30.702698 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1441/2854] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:22:31.111252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776509a8-9bf1-404b-b6d0-645e18912445 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:31.112949 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-776509a8-9bf1-404b-b6d0-645e18912445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:31.127009 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776509a8-9bf1-404b-b6d0-645e18912445 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:31.131642 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56772ad7-d546-4fae-93b5-faf5145a9a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:31.132977 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56772ad7-d546-4fae-93b5-faf5145a9a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:31.133373 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56772ad7-d546-4fae-93b5-faf5145a9a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:31.133638 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56772ad7-d546-4fae-93b5-faf5145a9a78 admin admin] PATH_INFO: `/v3/projects/88273644661942cf8182d2d075fe766e` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:31.134878 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56772ad7-d546-4fae-93b5-faf5145a9a78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88273644661942cf8182d2d075fe766e)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:31.136813 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56772ad7-d546-4fae-93b5-faf5145a9a78 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:31.233545 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-56772ad7-d546-4fae-93b5-faf5145a9a78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88273644661942cf8182d2d075fe766e', 'request_id': 'req-56772ad7-d546-4fae-93b5-faf5145a9a78'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:31.341566 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-56772ad7-d546-4fae-93b5-faf5145a9a78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88273644661942cf8182d2d075fe766e', 'request_id': 'req-56772ad7-d546-4fae-93b5-faf5145a9a78'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:31.347610 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-56772ad7-d546-4fae-93b5-faf5145a9a78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88273644661942cf8182d2d075fe766e', 'request_id': 'req-56772ad7-d546-4fae-93b5-faf5145a9a78'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:31.359495 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-56772ad7-d546-4fae-93b5-faf5145a9a78 admin admin] The token cache is being invalidate because project 88273644661942cf8182d2d075fe766e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:22:31.359779 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-56772ad7-d546-4fae-93b5-faf5145a9a78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:31.360400 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-56772ad7-d546-4fae-93b5-faf5145a9a78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:22:31.361911 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1414/2855] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:22:31 2022] DELETE /identity/v3/projects/88273644661942cf8182d2d075fe766e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:22:33.257963 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b891e-670a-4418-b7c5-d6fec454fb25 service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:33.259516 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-250b891e-670a-4418-b7c5-d6fec454fb25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:33.334236 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b891e-670a-4418-b7c5-d6fec454fb25 service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:33.397875 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0156b-0e98-47b0-aac8-02647c23961c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:33.398520 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0156b-0e98-47b0-aac8-02647c23961c service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:33.398850 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0156b-0e98-47b0-aac8-02647c23961c service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:33.399110 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0156b-0e98-47b0-aac8-02647c23961c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:33.401431 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-96f0156b-0e98-47b0-aac8-02647c23961c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:33.413736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f0156b-0e98-47b0-aac8-02647c23961c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:33.415034 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f0156b-0e98-47b0-aac8-02647c23961c service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:33.426101 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1442/2856] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:22:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:22:46.523890 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56772ad7-d546-4fae-93b5-faf5145a9a78 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:46.525290 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-56772ad7-d546-4fae-93b5-faf5145a9a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:46.583565 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56772ad7-d546-4fae-93b5-faf5145a9a78 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:46.587149 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341767da-e03d-4cb7-91c5-2d9b1ebea335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:46.587780 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341767da-e03d-4cb7-91c5-2d9b1ebea335 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:46.588103 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341767da-e03d-4cb7-91c5-2d9b1ebea335 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:46.588379 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341767da-e03d-4cb7-91c5-2d9b1ebea335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:46.590263 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-341767da-e03d-4cb7-91c5-2d9b1ebea335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:46.649131 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341767da-e03d-4cb7-91c5-2d9b1ebea335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:46.650618 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341767da-e03d-4cb7-91c5-2d9b1ebea335 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:46.659828 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1415/2857] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:22:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:22:52.770920 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0156b-0e98-47b0-aac8-02647c23961c service nova] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:22:52.772290 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-96f0156b-0e98-47b0-aac8-02647c23961c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:52.860571 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0156b-0e98-47b0-aac8-02647c23961c service nova] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:22:52.865735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9f419-08a8-46b2-a753-26db75f8a451 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae711b94b32a431ab880aa8f6068ff25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:22:52.866400 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9f419-08a8-46b2-a753-26db75f8a451 service placement] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:22:52.866705 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9f419-08a8-46b2-a753-26db75f8a451 service placement] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:22:52.866976 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9f419-08a8-46b2-a753-26db75f8a451 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:22:52.868715 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2de9f419-08a8-46b2-a753-26db75f8a451 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:22:52.880364 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9f419-08a8-46b2-a753-26db75f8a451 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:22:52.881906 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9f419-08a8-46b2-a753-26db75f8a451 service placement] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:22:52.891735 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1443/2858] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:22:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:25:04.921113 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341767da-e03d-4cb7-91c5-2d9b1ebea335 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:04.929730 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341767da-e03d-4cb7-91c5-2d9b1ebea335 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:04.933437 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d63ca9-dba5-4d76-920e-febd7ce10aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:04.934064 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d63ca9-dba5-4d76-920e-febd7ce10aeb service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:04.934344 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d63ca9-dba5-4d76-920e-febd7ce10aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:04.934617 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d63ca9-dba5-4d76-920e-febd7ce10aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:04.936419 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b7d63ca9-dba5-4d76-920e-febd7ce10aeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:25:04.968216 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d63ca9-dba5-4d76-920e-febd7ce10aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:04.969626 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d63ca9-dba5-4d76-920e-febd7ce10aeb service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:04.993746 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1416/2859] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:25:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:25:05.629900 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9f419-08a8-46b2-a753-26db75f8a451 service placement] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:05.647928 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9f419-08a8-46b2-a753-26db75f8a451 service placement] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:05.653816 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058b64f-9302-4b05-9851-f5c37810907e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:05.654803 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058b64f-9302-4b05-9851-f5c37810907e service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:05.655255 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058b64f-9302-4b05-9851-f5c37810907e service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:05.656328 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058b64f-9302-4b05-9851-f5c37810907e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:05.659087 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a058b64f-9302-4b05-9851-f5c37810907e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:25:05.675759 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058b64f-9302-4b05-9851-f5c37810907e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:05.677193 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058b64f-9302-4b05-9851-f5c37810907e service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:05.700591 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1444/2860] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:25:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:25:09.602205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d63ca9-dba5-4d76-920e-febd7ce10aeb service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:09.603593 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b7d63ca9-dba5-4d76-920e-febd7ce10aeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:25:09.678938 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d63ca9-dba5-4d76-920e-febd7ce10aeb service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:09.682522 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddde66-64b3-4dcf-a946-2f4829783dd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ca3e2a770f463a95dfb045ffd51dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:09.683174 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddde66-64b3-4dcf-a946-2f4829783dd5 service cinder] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:09.683453 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddde66-64b3-4dcf-a946-2f4829783dd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:09.683725 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddde66-64b3-4dcf-a946-2f4829783dd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:09.685497 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-85ddde66-64b3-4dcf-a946-2f4829783dd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:25:09.698544 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddde66-64b3-4dcf-a946-2f4829783dd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:09.699972 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddde66-64b3-4dcf-a946-2f4829783dd5 service cinder] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:09.710702 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1417/2861] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:25:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:25:15.218583 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eebe1d-6238-48ec-aeb4-6153192f209a None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:15.219103 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eebe1d-6238-48ec-aeb4-6153192f209a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:15.219230 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eebe1d-6238-48ec-aeb4-6153192f209a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:15.277870 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-27eebe1d-6238-48ec-aeb4-6153192f209a None None] MFA Rules not processed for user `fa9ea7738c634318a532ebca2e564745`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:25:15.279136 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-27eebe1d-6238-48ec-aeb4-6153192f209a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:25:15.340978 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1445/2862] 10.222.0.42 () {58 vars in 967 bytes} [Wed Feb 16 17:25:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:25:15.382114 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddde66-64b3-4dcf-a946-2f4829783dd5 service cinder] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:15.383530 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-85ddde66-64b3-4dcf-a946-2f4829783dd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:25:15.471171 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddde66-64b3-4dcf-a946-2f4829783dd5 service cinder] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:15.476235 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c49eb-6bc1-4aba-b206-b5e5cd2b3c80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc59cb98783b4353a405b8b9a3a9d592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:15.476861 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c49eb-6bc1-4aba-b206-b5e5cd2b3c80 service swift] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:15.477141 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c49eb-6bc1-4aba-b206-b5e5cd2b3c80 service swift] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:15.477416 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c49eb-6bc1-4aba-b206-b5e5cd2b3c80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:15.485267 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c49eb-6bc1-4aba-b206-b5e5cd2b3c80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:15.487181 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c49eb-6bc1-4aba-b206-b5e5cd2b3c80 service swift] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:15.494961 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1418/2863] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Feb 16 17:25:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 17:25:23.775977 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eebe1d-6238-48ec-aeb4-6153192f209a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:23.777456 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-27eebe1d-6238-48ec-aeb4-6153192f209a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:25:23.844006 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eebe1d-6238-48ec-aeb4-6153192f209a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:23.849770 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe6719-539a-4c85-bf8c-8dbd95e7349f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:23.850633 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe6719-539a-4c85-bf8c-8dbd95e7349f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:23.850937 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe6719-539a-4c85-bf8c-8dbd95e7349f admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:23.858296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe6719-539a-4c85-bf8c-8dbd95e7349f admin admin] PATH_INFO: `/v3/users/34d53bd8a6b84f38897666568873a36b` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:23.858296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe6719-539a-4c85-bf8c-8dbd95e7349f admin admin] RBAC: Authorizing `identity:delete_user(user_id=34d53bd8a6b84f38897666568873a36b)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:23.858296 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe6719-539a-4c85-bf8c-8dbd95e7349f admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:24.058205 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4dbe6719-539a-4c85-bf8c-8dbd95e7349f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34d53bd8a6b84f38897666568873a36b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:24.058891 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4dbe6719-539a-4c85-bf8c-8dbd95e7349f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34d53bd8a6b84f38897666568873a36b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:24.070429 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4dbe6719-539a-4c85-bf8c-8dbd95e7349f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34d53bd8a6b84f38897666568873a36b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:24.077062 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4dbe6719-539a-4c85-bf8c-8dbd95e7349f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34d53bd8a6b84f38897666568873a36b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:24.077775 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-4dbe6719-539a-4c85-bf8c-8dbd95e7349f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34d53bd8a6b84f38897666568873a36b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:24.160080 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1446/2864] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:25:23 2022] DELETE /identity/v3/users/34d53bd8a6b84f38897666568873a36b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:25:24.432456 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c49eb-6bc1-4aba-b206-b5e5cd2b3c80 service swift] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:24.443861 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c49eb-6bc1-4aba-b206-b5e5cd2b3c80 service swift] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:24.499980 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cbc48-d69f-45b5-a987-7304e7d59d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:24.500822 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cbc48-d69f-45b5-a987-7304e7d59d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:24.501455 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cbc48-d69f-45b5-a987-7304e7d59d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:24.501591 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cbc48-d69f-45b5-a987-7304e7d59d33 admin admin] PATH_INFO: `/v3/projects/253a843df1be4a2f8c30e1e06eca8b56` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:24.502707 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cbc48-d69f-45b5-a987-7304e7d59d33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=253a843df1be4a2f8c30e1e06eca8b56)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:24.504569 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cbc48-d69f-45b5-a987-7304e7d59d33 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:24.619391 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-586cbc48-d69f-45b5-a987-7304e7d59d33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '253a843df1be4a2f8c30e1e06eca8b56', 'request_id': 'req-586cbc48-d69f-45b5-a987-7304e7d59d33'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:24.739061 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-586cbc48-d69f-45b5-a987-7304e7d59d33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '253a843df1be4a2f8c30e1e06eca8b56', 'request_id': 'req-586cbc48-d69f-45b5-a987-7304e7d59d33'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:24.744831 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-586cbc48-d69f-45b5-a987-7304e7d59d33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '253a843df1be4a2f8c30e1e06eca8b56', 'request_id': 'req-586cbc48-d69f-45b5-a987-7304e7d59d33'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:24.756220 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-586cbc48-d69f-45b5-a987-7304e7d59d33 admin admin] The token cache is being invalidate because project 253a843df1be4a2f8c30e1e06eca8b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:25:24.756508 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-586cbc48-d69f-45b5-a987-7304e7d59d33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:24.757135 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-586cbc48-d69f-45b5-a987-7304e7d59d33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:24.758733 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1419/2865] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:25:24 2022] DELETE /identity/v3/projects/253a843df1be4a2f8c30e1e06eca8b56 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:25:24.762762 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe6719-539a-4c85-bf8c-8dbd95e7349f admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:24.764258 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-4dbe6719-539a-4c85-bf8c-8dbd95e7349f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:25:24.777619 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe6719-539a-4c85-bf8c-8dbd95e7349f admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:24.831890 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eaddc9-15b3-481e-a00b-bad97026d9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:24.832739 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaddc9-15b3-481e-a00b-bad97026d9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:24.833010 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaddc9-15b3-481e-a00b-bad97026d9be admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:24.833288 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaddc9-15b3-481e-a00b-bad97026d9be admin admin] PATH_INFO: `/v3/users/bdadf97ebedc43ccaeec27255dc8f16c` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:24.834456 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eaddc9-15b3-481e-a00b-bad97026d9be admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdadf97ebedc43ccaeec27255dc8f16c)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:24.836460 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eaddc9-15b3-481e-a00b-bad97026d9be admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:25.021530 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e5eaddc9-15b3-481e-a00b-bad97026d9be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdadf97ebedc43ccaeec27255dc8f16c'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:25.022488 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e5eaddc9-15b3-481e-a00b-bad97026d9be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdadf97ebedc43ccaeec27255dc8f16c'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:25.035447 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e5eaddc9-15b3-481e-a00b-bad97026d9be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdadf97ebedc43ccaeec27255dc8f16c'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:25.042304 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e5eaddc9-15b3-481e-a00b-bad97026d9be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdadf97ebedc43ccaeec27255dc8f16c'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:25.043003 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-e5eaddc9-15b3-481e-a00b-bad97026d9be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdadf97ebedc43ccaeec27255dc8f16c'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:25.153234 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1447/2866] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:25:24 2022] DELETE /identity/v3/users/bdadf97ebedc43ccaeec27255dc8f16c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:25:25.378480 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cbc48-d69f-45b5-a987-7304e7d59d33 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:25.379941 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-586cbc48-d69f-45b5-a987-7304e7d59d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:25:25.392602 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cbc48-d69f-45b5-a987-7304e7d59d33 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:25.450967 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255f657-f76a-4c75-866f-a09999dabc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:25.451816 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255f657-f76a-4c75-866f-a09999dabc3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:25.452093 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255f657-f76a-4c75-866f-a09999dabc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:25.452363 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255f657-f76a-4c75-866f-a09999dabc3e admin admin] PATH_INFO: `/v3/projects/48ad682ce2d742809aae21643d732761` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:25.453544 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255f657-f76a-4c75-866f-a09999dabc3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=48ad682ce2d742809aae21643d732761)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:25.455583 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255f657-f76a-4c75-866f-a09999dabc3e admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:25.557321 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a255f657-f76a-4c75-866f-a09999dabc3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ad682ce2d742809aae21643d732761', 'request_id': 'req-a255f657-f76a-4c75-866f-a09999dabc3e'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:25.628731 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a255f657-f76a-4c75-866f-a09999dabc3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ad682ce2d742809aae21643d732761', 'request_id': 'req-a255f657-f76a-4c75-866f-a09999dabc3e'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:25.634548 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a255f657-f76a-4c75-866f-a09999dabc3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ad682ce2d742809aae21643d732761', 'request_id': 'req-a255f657-f76a-4c75-866f-a09999dabc3e'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:25.645568 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a255f657-f76a-4c75-866f-a09999dabc3e admin admin] The token cache is being invalidate because project 48ad682ce2d742809aae21643d732761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:25:25.649868 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a255f657-f76a-4c75-866f-a09999dabc3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:25.649868 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-a255f657-f76a-4c75-866f-a09999dabc3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:25:25.649868 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1420/2867] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:25:25 2022] DELETE /identity/v3/projects/48ad682ce2d742809aae21643d732761 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:25:25.653209 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1eeb9-e06d-47f1-a888-83277267ec8a None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:25.653495 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1eeb9-e06d-47f1-a888-83277267ec8a None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:25.653763 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1eeb9-e06d-47f1-a888-83277267ec8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:25.674661 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-fff1eeb9-e06d-47f1-a888-83277267ec8a None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:25:25.675881 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-fff1eeb9-e06d-47f1-a888-83277267ec8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:25:25.735645 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1448/2868] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:25:25.744441 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08044a43-7aa1-4f80-a0f8-97ddd79bf7f5 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:25.744726 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08044a43-7aa1-4f80-a0f8-97ddd79bf7f5 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:25.745006 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08044a43-7aa1-4f80-a0f8-97ddd79bf7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:25.763590 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-08044a43-7aa1-4f80-a0f8-97ddd79bf7f5 None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:25:25.764761 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-08044a43-7aa1-4f80-a0f8-97ddd79bf7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:25:25.773478 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1421/2869] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:25:25.777766 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1eeb9-e06d-47f1-a888-83277267ec8a None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:25.788338 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1eeb9-e06d-47f1-a888-83277267ec8a None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:25.792933 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ccf71-92c4-4f8c-ba6b-b30ace3d1431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:25.793578 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ccf71-92c4-4f8c-ba6b-b30ace3d1431 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:25.793861 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ccf71-92c4-4f8c-ba6b-b30ace3d1431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:25.794135 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ccf71-92c4-4f8c-ba6b-b30ace3d1431 admin admin] PATH_INFO: `/v3/domains` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:25.794884 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ccf71-92c4-4f8c-ba6b-b30ace3d1431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79469) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 17:25:25.795191 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ccf71-92c4-4f8c-ba6b-b30ace3d1431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:25.796774 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ccf71-92c4-4f8c-ba6b-b30ace3d1431 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:25.810925 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1449/2870] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Feb 16 17:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:25:25.815550 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08044a43-7aa1-4f80-a0f8-97ddd79bf7f5 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:25.824701 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08044a43-7aa1-4f80-a0f8-97ddd79bf7f5 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:25.829475 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6571d12-da24-4bdf-87b7-db0a45e79248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:25.830127 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6571d12-da24-4bdf-87b7-db0a45e79248 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:25.830440 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6571d12-da24-4bdf-87b7-db0a45e79248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:25.830903 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6571d12-da24-4bdf-87b7-db0a45e79248 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:25.831614 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6571d12-da24-4bdf-87b7-db0a45e79248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:25.833599 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6571d12-da24-4bdf-87b7-db0a45e79248 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:25.951618 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1422/2871] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:25:25 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:25:25.956854 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ccf71-92c4-4f8c-ba6b-b30ace3d1431 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:25.968069 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ccf71-92c4-4f8c-ba6b-b30ace3d1431 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:26.033647 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3598e7-b2c1-4d5c-bbd4-1505fb348c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:26.034608 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3598e7-b2c1-4d5c-bbd4-1505fb348c01 admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:26.034923 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3598e7-b2c1-4d5c-bbd4-1505fb348c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:26.035200 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3598e7-b2c1-4d5c-bbd4-1505fb348c01 admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:26.035928 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3598e7-b2c1-4d5c-bbd4-1505fb348c01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:26.037831 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3598e7-b2c1-4d5c-bbd4-1505fb348c01 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:26.126707 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1450/2872] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:25:25 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:25:26.131739 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6571d12-da24-4bdf-87b7-db0a45e79248 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:26.144130 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6571d12-da24-4bdf-87b7-db0a45e79248 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:26.149544 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db3185-8bbe-4bbc-972d-eb67e82b5596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:26.150190 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db3185-8bbe-4bbc-972d-eb67e82b5596 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:26.150501 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db3185-8bbe-4bbc-972d-eb67e82b5596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:26.150767 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db3185-8bbe-4bbc-972d-eb67e82b5596 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:26.151479 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db3185-8bbe-4bbc-972d-eb67e82b5596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:26.153420 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db3185-8bbe-4bbc-972d-eb67e82b5596 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:26.166862 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1423/2873] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:25:26.171139 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3598e7-b2c1-4d5c-bbd4-1505fb348c01 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:26.182680 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3598e7-b2c1-4d5c-bbd4-1505fb348c01 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:26.187500 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e527a-d438-4c83-b745-9e917a48c739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:26.188190 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e527a-d438-4c83-b745-9e917a48c739 admin admin] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:26.188467 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e527a-d438-4c83-b745-9e917a48c739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:26.188736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e527a-d438-4c83-b745-9e917a48c739 admin admin] PATH_INFO: `/v3/roles` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:26.189624 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e527a-d438-4c83-b745-9e917a48c739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:26.192633 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e527a-d438-4c83-b745-9e917a48c739 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:26.204463 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1451/2874] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:25:26.209362 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db3185-8bbe-4bbc-972d-eb67e82b5596 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:26.220033 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db3185-8bbe-4bbc-972d-eb67e82b5596 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:26.225543 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b84655-60e2-4911-a69d-1f876ecc88a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:26.226488 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b84655-60e2-4911-a69d-1f876ecc88a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:26.226803 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b84655-60e2-4911-a69d-1f876ecc88a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:26.227075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b84655-60e2-4911-a69d-1f876ecc88a6 admin admin] PATH_INFO: `/v3/projects/72c85a3c46034521a4025c09bc742aec/users/5d9ed53ffa2e4eedbe21e154dce4fe65/roles/d361c0606e4646d3afa601176d0422ec` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:26.241258 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b84655-60e2-4911-a69d-1f876ecc88a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c85a3c46034521a4025c09bc742aec, user_id=5d9ed53ffa2e4eedbe21e154dce4fe65, role_id=d361c0606e4646d3afa601176d0422ec)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:26.244749 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b84655-60e2-4911-a69d-1f876ecc88a6 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:26.320409 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1424/2875] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:25:26 2022] PUT /identity/v3/projects/72c85a3c46034521a4025c09bc742aec/users/5d9ed53ffa2e4eedbe21e154dce4fe65/roles/d361c0606e4646d3afa601176d0422ec => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:25:26.325748 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ce7e1-ab81-41d0-9eb9-c4dcab2bdcca None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:26.326044 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ce7e1-ab81-41d0-9eb9-c4dcab2bdcca None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:26.326324 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ce7e1-ab81-41d0-9eb9-c4dcab2bdcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:26.347278 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-2d9ce7e1-ab81-41d0-9eb9-c4dcab2bdcca None None] MFA Rules not processed for user `b96481fed12c49429f583e04dace6093`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:25:26.348924 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-2d9ce7e1-ab81-41d0-9eb9-c4dcab2bdcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:25:26.412413 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1452/2876] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:25:26.422833 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b84655-60e2-4911-a69d-1f876ecc88a6 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:26.424673 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-32b84655-60e2-4911-a69d-1f876ecc88a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:25:26.482240 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b84655-60e2-4911-a69d-1f876ecc88a6 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:26.485818 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762c75c-6df7-4a5b-b541-c36028db0453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:26.486777 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762c75c-6df7-4a5b-b541-c36028db0453 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:26.487191 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762c75c-6df7-4a5b-b541-c36028db0453 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:26.487469 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762c75c-6df7-4a5b-b541-c36028db0453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:26.496657 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762c75c-6df7-4a5b-b541-c36028db0453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:26.498162 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762c75c-6df7-4a5b-b541-c36028db0453 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:26.508267 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1425/2877] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:25:32.262042 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362613a1-54ed-4e9f-8329-8b15a51f49ba None None] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:32.264736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362613a1-54ed-4e9f-8329-8b15a51f49ba None None] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:32.264736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362613a1-54ed-4e9f-8329-8b15a51f49ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:32.290959 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.auth.core [None req-362613a1-54ed-4e9f-8329-8b15a51f49ba None None] MFA Rules not processed for user `5d9ed53ffa2e4eedbe21e154dce4fe65`. Rule list: `[]` (Enabled: `True`). {{(pid=79469) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:25:32.292161 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-362613a1-54ed-4e9f-8329-8b15a51f49ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:25:32.358537 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1453/2878] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:25:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:25:32.364163 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762c75c-6df7-4a5b-b541-c36028db0453 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:32.374184 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762c75c-6df7-4a5b-b541-c36028db0453 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:32.378834 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a5373-08d6-4b0f-8a7a-2264c4ecfea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:32.379474 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a5373-08d6-4b0f-8a7a-2264c4ecfea2 admin admin] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:32.379770 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a5373-08d6-4b0f-8a7a-2264c4ecfea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:32.380032 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a5373-08d6-4b0f-8a7a-2264c4ecfea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:32.380754 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a5373-08d6-4b0f-8a7a-2264c4ecfea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:32.382712 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a5373-08d6-4b0f-8a7a-2264c4ecfea2 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:32.469432 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1426/2879] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Feb 16 17:25:32 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 17:25:32.474367 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362613a1-54ed-4e9f-8329-8b15a51f49ba None None] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:32.484989 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362613a1-54ed-4e9f-8329-8b15a51f49ba None None] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:32.540415 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435a7fd-a286-406d-b955-e2dd551ae89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:32.541079 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435a7fd-a286-406d-b955-e2dd551ae89b admin admin] REQUEST_METHOD: `POST` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:32.541355 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435a7fd-a286-406d-b955-e2dd551ae89b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:32.541625 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435a7fd-a286-406d-b955-e2dd551ae89b admin admin] PATH_INFO: `/v3/users` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:32.542311 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435a7fd-a286-406d-b955-e2dd551ae89b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:32.544240 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435a7fd-a286-406d-b955-e2dd551ae89b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:32.642374 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1454/2880] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Feb 16 17:25:32 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 17:25:32.644172 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a5373-08d6-4b0f-8a7a-2264c4ecfea2 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:32.654572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a5373-08d6-4b0f-8a7a-2264c4ecfea2 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:32.660316 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e390b-a16c-479c-a2fe-8befa97ed6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:32.661121 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e390b-a16c-479c-a2fe-8befa97ed6fd admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:32.661394 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e390b-a16c-479c-a2fe-8befa97ed6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:32.661660 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e390b-a16c-479c-a2fe-8befa97ed6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:32.662373 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e390b-a16c-479c-a2fe-8befa97ed6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:32.663984 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e390b-a16c-479c-a2fe-8befa97ed6fd admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:32.674681 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1427/2881] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 17:25:32.678769 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435a7fd-a286-406d-b955-e2dd551ae89b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:32.688811 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435a7fd-a286-406d-b955-e2dd551ae89b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:32.693537 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bad19-40f0-43fd-9e13-0f1079959475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:32.697077 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bad19-40f0-43fd-9e13-0f1079959475 admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:32.697077 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bad19-40f0-43fd-9e13-0f1079959475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:32.697077 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bad19-40f0-43fd-9e13-0f1079959475 admin admin] PATH_INFO: `/v3/projects/1deeef01c98647659e70b135c79bf0d6/users/e00a30538d874af1ac1cffdd7611c15f/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:32.710856 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320bad19-40f0-43fd-9e13-0f1079959475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1deeef01c98647659e70b135c79bf0d6, user_id=e00a30538d874af1ac1cffdd7611c15f, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:32.713535 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320bad19-40f0-43fd-9e13-0f1079959475 admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:32.825978 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1455/2882] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:25:32 2022] PUT /identity/v3/projects/1deeef01c98647659e70b135c79bf0d6/users/e00a30538d874af1ac1cffdd7611c15f/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:25:32.833715 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e390b-a16c-479c-a2fe-8befa97ed6fd admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:32.840705 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e390b-a16c-479c-a2fe-8befa97ed6fd admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:32.898180 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb95673-8a7f-4f80-9f70-2ad26f332c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:32.898913 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb95673-8a7f-4f80-9f70-2ad26f332c44 admin admin] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:32.899200 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb95673-8a7f-4f80-9f70-2ad26f332c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:32.899481 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb95673-8a7f-4f80-9f70-2ad26f332c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:32.900239 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb95673-8a7f-4f80-9f70-2ad26f332c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:32.901836 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb95673-8a7f-4f80-9f70-2ad26f332c44 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:32.912505 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1428/2883] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Feb 16 17:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 17:25:32.919137 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bad19-40f0-43fd-9e13-0f1079959475 admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:32.927083 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bad19-40f0-43fd-9e13-0f1079959475 admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:32.931863 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b70d60-d6a3-457c-a35a-11085962f87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:32.932736 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b70d60-d6a3-457c-a35a-11085962f87b admin admin] REQUEST_METHOD: `PUT` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:32.933039 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b70d60-d6a3-457c-a35a-11085962f87b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:32.933319 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b70d60-d6a3-457c-a35a-11085962f87b admin admin] PATH_INFO: `/v3/projects/1deeef01c98647659e70b135c79bf0d6/users/e00a30538d874af1ac1cffdd7611c15f/roles/8263a29ceeed4576b3b6959c99964ed7` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:32.935367 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b70d60-d6a3-457c-a35a-11085962f87b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1deeef01c98647659e70b135c79bf0d6, user_id=e00a30538d874af1ac1cffdd7611c15f, role_id=8263a29ceeed4576b3b6959c99964ed7)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:32.937994 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b70d60-d6a3-457c-a35a-11085962f87b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:32.950023 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1456/2884] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Feb 16 17:25:32 2022] PUT /identity/v3/projects/1deeef01c98647659e70b135c79bf0d6/users/e00a30538d874af1ac1cffdd7611c15f/roles/8263a29ceeed4576b3b6959c99964ed7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:25:38.571249 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f9952-4576-41ee-ba52-599c4d1ba195 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:38.571790 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f9952-4576-41ee-ba52-599c4d1ba195 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:38.571877 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f9952-4576-41ee-ba52-599c4d1ba195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:38.600228 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-9c4f9952-4576-41ee-ba52-599c4d1ba195 None None] MFA Rules not processed for user `e00a30538d874af1ac1cffdd7611c15f`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:25:38.601517 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-9c4f9952-4576-41ee-ba52-599c4d1ba195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:25:38.672084 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1429/2885] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:25:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:25:38.684204 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b70d60-d6a3-457c-a35a-11085962f87b admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:25:38.686008 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-89b70d60-d6a3-457c-a35a-11085962f87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:25:38.762156 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b70d60-d6a3-457c-a35a-11085962f87b admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:25:38.775305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e962b7-f799-46d8-a751-bd46c52a9f3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:25:38.775305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e962b7-f799-46d8-a751-bd46c52a9f3d service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:38.775305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e962b7-f799-46d8-a751-bd46c52a9f3d service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:38.775305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e962b7-f799-46d8-a751-bd46c52a9f3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:38.849478 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e962b7-f799-46d8-a751-bd46c52a9f3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:25:38.851067 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e962b7-f799-46d8-a751-bd46c52a9f3d service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:25:38.860593 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1457/2886] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:25:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:25:41.638288 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dce154-e11a-4f59-96e8-c182d24792c2 None None] REQUEST_METHOD: `POST` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:25:41.639421 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dce154-e11a-4f59-96e8-c182d24792c2 None None] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:25:41.639709 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dce154-e11a-4f59-96e8-c182d24792c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:25:41.658037 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.auth.core [None req-b2dce154-e11a-4f59-96e8-c182d24792c2 None None] MFA Rules not processed for user `5d9ed53ffa2e4eedbe21e154dce4fe65`. Rule list: `[]` (Enabled: `True`). {{(pid=79468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:25:41.660155 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-b2dce154-e11a-4f59-96e8-c182d24792c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:25:41.668572 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1430/2887] 10.222.0.42 () {58 vars in 957 bytes} [Wed Feb 16 17:25:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 17:26:01.743115 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e962b7-f799-46d8-a751-bd46c52a9f3d service nova] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:26:01.744681 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-a6e962b7-f799-46d8-a751-bd46c52a9f3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:26:01.801291 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e962b7-f799-46d8-a751-bd46c52a9f3d service nova] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:26:01.805112 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c83bbd-56f5-439c-8c7c-293f77bbd93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:26:01.805787 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c83bbd-56f5-439c-8c7c-293f77bbd93e service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:26:01.806065 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c83bbd-56f5-439c-8c7c-293f77bbd93e service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:26:01.806338 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c83bbd-56f5-439c-8c7c-293f77bbd93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:26:01.808165 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e9c83bbd-56f5-439c-8c7c-293f77bbd93e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:26:01.818316 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c83bbd-56f5-439c-8c7c-293f77bbd93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:26:01.819758 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c83bbd-56f5-439c-8c7c-293f77bbd93e service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:26:01.828379 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1458/2888] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:26:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:26:19.101405 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dce154-e11a-4f59-96e8-c182d24792c2 None None] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:26:19.111994 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dce154-e11a-4f59-96e8-c182d24792c2 None None] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:26:19.115644 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fd137-9ae0-402a-aed1-39ad89c94978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:26:19.116268 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fd137-9ae0-402a-aed1-39ad89c94978 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:26:19.116547 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fd137-9ae0-402a-aed1-39ad89c94978 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:26:19.116820 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fd137-9ae0-402a-aed1-39ad89c94978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:26:19.126692 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fd137-9ae0-402a-aed1-39ad89c94978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:26:19.128098 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fd137-9ae0-402a-aed1-39ad89c94978 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:26:19.137250 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1431/2889] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:26:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:27:59.735342 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c83bbd-56f5-439c-8c7c-293f77bbd93e service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:27:59.736695 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-e9c83bbd-56f5-439c-8c7c-293f77bbd93e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:27:59.805130 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c83bbd-56f5-439c-8c7c-293f77bbd93e service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:27:59.810154 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930f49e-531b-49a1-8ad7-3f83ec5d1f42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae711b94b32a431ab880aa8f6068ff25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:27:59.810820 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930f49e-531b-49a1-8ad7-3f83ec5d1f42 service placement] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:27:59.811105 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930f49e-531b-49a1-8ad7-3f83ec5d1f42 service placement] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:27:59.811379 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930f49e-531b-49a1-8ad7-3f83ec5d1f42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:27:59.813129 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-b930f49e-531b-49a1-8ad7-3f83ec5d1f42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:27:59.824916 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930f49e-531b-49a1-8ad7-3f83ec5d1f42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:27:59.826481 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930f49e-531b-49a1-8ad7-3f83ec5d1f42 service placement] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:27:59.837005 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1459/2890] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:27:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:28:49.637311 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fd137-9ae0-402a-aed1-39ad89c94978 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:28:49.646577 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fd137-9ae0-402a-aed1-39ad89c94978 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:28:49.650205 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70deb3c7-c409-442b-85a0-fe20363df634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:28:49.650858 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deb3c7-c409-442b-85a0-fe20363df634 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:28:49.651141 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deb3c7-c409-442b-85a0-fe20363df634 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:28:49.651414 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deb3c7-c409-442b-85a0-fe20363df634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:28:49.653142 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-70deb3c7-c409-442b-85a0-fe20363df634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:28:49.662678 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70deb3c7-c409-442b-85a0-fe20363df634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:28:49.664091 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70deb3c7-c409-442b-85a0-fe20363df634 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:28:49.672375 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1432/2891] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:28:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:28:49.769469 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930f49e-531b-49a1-8ad7-3f83ec5d1f42 service placement] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:28:49.780221 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930f49e-531b-49a1-8ad7-3f83ec5d1f42 service placement] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:28:49.784780 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea00c5-ac00-42f5-bb54-7098a395774e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:28:49.785421 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea00c5-ac00-42f5-bb54-7098a395774e service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:28:49.785703 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea00c5-ac00-42f5-bb54-7098a395774e service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:28:49.786113 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea00c5-ac00-42f5-bb54-7098a395774e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:28:49.788053 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-99ea00c5-ac00-42f5-bb54-7098a395774e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:28:49.801596 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea00c5-ac00-42f5-bb54-7098a395774e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:28:49.803352 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea00c5-ac00-42f5-bb54-7098a395774e service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:28:49.814045 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1460/2892] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:28:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:28:49.872825 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70deb3c7-c409-442b-85a0-fe20363df634 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:28:49.885841 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70deb3c7-c409-442b-85a0-fe20363df634 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:28:49.892241 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05659a0b-de53-44e0-8923-a32b3a1450bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae711b94b32a431ab880aa8f6068ff25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:28:49.892867 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05659a0b-de53-44e0-8923-a32b3a1450bc service placement] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:28:49.893156 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05659a0b-de53-44e0-8923-a32b3a1450bc service placement] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:28:49.893430 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05659a0b-de53-44e0-8923-a32b3a1450bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:28:49.895877 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-05659a0b-de53-44e0-8923-a32b3a1450bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:28:49.907473 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05659a0b-de53-44e0-8923-a32b3a1450bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:28:49.912487 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05659a0b-de53-44e0-8923-a32b3a1450bc service placement] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:28:49.918882 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1433/2893] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:28:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:28:50.856310 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea00c5-ac00-42f5-bb54-7098a395774e service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:28:50.869080 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea00c5-ac00-42f5-bb54-7098a395774e service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:28:50.875685 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa68400-15bb-4c79-a538-9ac9515049f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:28:50.876418 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa68400-15bb-4c79-a538-9ac9515049f3 service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:28:50.876753 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa68400-15bb-4c79-a538-9ac9515049f3 service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:28:50.877082 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa68400-15bb-4c79-a538-9ac9515049f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:28:50.879019 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-7aa68400-15bb-4c79-a538-9ac9515049f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:28:50.891766 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa68400-15bb-4c79-a538-9ac9515049f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:28:50.893464 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa68400-15bb-4c79-a538-9ac9515049f3 service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:28:50.905026 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1461/2894] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:28:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:30:37.050827 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05659a0b-de53-44e0-8923-a32b3a1450bc service placement] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:30:37.052241 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-05659a0b-de53-44e0-8923-a32b3a1450bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:30:37.068179 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05659a0b-de53-44e0-8923-a32b3a1450bc service placement] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:30:37.074123 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ae33b-c710-4116-b1ac-08b069fdf5e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:30:37.074791 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ae33b-c710-4116-b1ac-08b069fdf5e0 service nova] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:30:37.075069 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ae33b-c710-4116-b1ac-08b069fdf5e0 service nova] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:30:37.075341 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ae33b-c710-4116-b1ac-08b069fdf5e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:30:37.077742 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-e07ae33b-c710-4116-b1ac-08b069fdf5e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:30:37.091029 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ae33b-c710-4116-b1ac-08b069fdf5e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:30:37.092795 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ae33b-c710-4116-b1ac-08b069fdf5e0 service nova] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:30:37.106901 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1434/2895] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:30:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:30:37.166757 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa68400-15bb-4c79-a538-9ac9515049f3 service nova] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:30:37.176132 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa68400-15bb-4c79-a538-9ac9515049f3 service nova] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:30:37.179687 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be42907-b9ac-45f4-a6cf-844054d2febe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:30:37.180310 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be42907-b9ac-45f4-a6cf-844054d2febe service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:30:37.180594 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be42907-b9ac-45f4-a6cf-844054d2febe service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:30:37.180883 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be42907-b9ac-45f4-a6cf-844054d2febe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:30:37.182933 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-5be42907-b9ac-45f4-a6cf-844054d2febe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:30:37.193045 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be42907-b9ac-45f4-a6cf-844054d2febe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:30:37.195053 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be42907-b9ac-45f4-a6cf-844054d2febe service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:30:37.204131 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1462/2896] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:30:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 17:30:37.598684 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ae33b-c710-4116-b1ac-08b069fdf5e0 service nova] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:30:37.606088 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ae33b-c710-4116-b1ac-08b069fdf5e0 service nova] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:30:37.611498 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f20e6-187e-4c48-8a95-4e42677a9061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:30:37.612067 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f20e6-187e-4c48-8a95-4e42677a9061 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:30:37.612573 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f20e6-187e-4c48-8a95-4e42677a9061 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:30:37.613783 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f20e6-187e-4c48-8a95-4e42677a9061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:30:37.615756 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-0a7f20e6-187e-4c48-8a95-4e42677a9061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:30:37.636422 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f20e6-187e-4c48-8a95-4e42677a9061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:30:37.637187 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f20e6-187e-4c48-8a95-4e42677a9061 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:30:37.650287 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1435/2897] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:30:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:30:38.814669 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be42907-b9ac-45f4-a6cf-844054d2febe service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:30:38.829925 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be42907-b9ac-45f4-a6cf-844054d2febe service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:30:38.835532 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b40112-831b-416c-ad5c-1da4ddb4c2ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a30603a236e4681a7702eec7029e9db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:30:38.836396 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b40112-831b-416c-ad5c-1da4ddb4c2ec service nova] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:30:38.836673 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b40112-831b-416c-ad5c-1da4ddb4c2ec service nova] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:30:38.836984 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b40112-831b-416c-ad5c-1da4ddb4c2ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:30:38.845201 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b40112-831b-416c-ad5c-1da4ddb4c2ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:30:38.846792 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b40112-831b-416c-ad5c-1da4ddb4c2ec service nova] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:30:38.856566 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1463/2898] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:30:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:30:38.911976 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f20e6-187e-4c48-8a95-4e42677a9061 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:30:38.921506 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f20e6-187e-4c48-8a95-4e42677a9061 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:30:38.925236 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ba9d3-d7f6-418a-8dcc-cccfdee3ef81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:30:38.925892 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ba9d3-d7f6-418a-8dcc-cccfdee3ef81 service neutron] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:30:38.926189 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ba9d3-d7f6-418a-8dcc-cccfdee3ef81 service neutron] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:30:38.926463 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ba9d3-d7f6-418a-8dcc-cccfdee3ef81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:30:38.928217 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-7b9ba9d3-d7f6-418a-8dcc-cccfdee3ef81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:30:38.942485 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ba9d3-d7f6-418a-8dcc-cccfdee3ef81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:30:38.943918 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ba9d3-d7f6-418a-8dcc-cccfdee3ef81 service neutron] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:30:38.954876 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1436/2899] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:30:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:30:42.741926 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b40112-831b-416c-ad5c-1da4ddb4c2ec service nova] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:30:42.752392 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b40112-831b-416c-ad5c-1da4ddb4c2ec service nova] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:30:42.756074 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43457976-1367-4a5b-807f-96894f56a794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6db9534cc094e8281b0aa34e2cb4b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:30:42.756734 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43457976-1367-4a5b-807f-96894f56a794 service neutron] REQUEST_METHOD: `GET` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:30:42.757020 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43457976-1367-4a5b-807f-96894f56a794 service neutron] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:30:42.757294 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43457976-1367-4a5b-807f-96894f56a794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:30:42.816163 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43457976-1367-4a5b-807f-96894f56a794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:30:42.817676 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43457976-1367-4a5b-807f-96894f56a794 service neutron] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:30:42.827307 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1464/2900] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 17:30:50.503252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ba9d3-d7f6-418a-8dcc-cccfdee3ef81 service neutron] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:30:50.515530 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ba9d3-d7f6-418a-8dcc-cccfdee3ef81 service neutron] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:30:50.520214 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b193c5c-4e2f-4e2c-831d-ff3ba633a11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:30:50.521072 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b193c5c-4e2f-4e2c-831d-ff3ba633a11f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:30:50.521393 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b193c5c-4e2f-4e2c-831d-ff3ba633a11f admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:30:50.521649 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b193c5c-4e2f-4e2c-831d-ff3ba633a11f admin admin] PATH_INFO: `/v3/users/5d9ed53ffa2e4eedbe21e154dce4fe65` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:30:50.522958 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b193c5c-4e2f-4e2c-831d-ff3ba633a11f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d9ed53ffa2e4eedbe21e154dce4fe65)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:30:50.525075 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b193c5c-4e2f-4e2c-831d-ff3ba633a11f admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:30:50.721509 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0b193c5c-4e2f-4e2c-831d-ff3ba633a11f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d9ed53ffa2e4eedbe21e154dce4fe65'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:50.722216 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0b193c5c-4e2f-4e2c-831d-ff3ba633a11f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d9ed53ffa2e4eedbe21e154dce4fe65'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:50.734191 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0b193c5c-4e2f-4e2c-831d-ff3ba633a11f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d9ed53ffa2e4eedbe21e154dce4fe65'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:50.740831 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0b193c5c-4e2f-4e2c-831d-ff3ba633a11f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d9ed53ffa2e4eedbe21e154dce4fe65'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:50.822611 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-0b193c5c-4e2f-4e2c-831d-ff3ba633a11f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d9ed53ffa2e4eedbe21e154dce4fe65'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:50.829018 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1437/2901] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:30:50 2022] DELETE /identity/v3/users/5d9ed53ffa2e4eedbe21e154dce4fe65 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:30:51.086478 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43457976-1367-4a5b-807f-96894f56a794 service neutron] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:30:51.098663 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43457976-1367-4a5b-807f-96894f56a794 service neutron] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:30:51.156370 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85d038-0749-4064-9f88-56b065b2f2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:30:51.157240 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85d038-0749-4064-9f88-56b065b2f2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:30:51.157511 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85d038-0749-4064-9f88-56b065b2f2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:30:51.157787 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85d038-0749-4064-9f88-56b065b2f2ce admin admin] PATH_INFO: `/v3/projects/72c85a3c46034521a4025c09bc742aec` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:30:51.159094 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85d038-0749-4064-9f88-56b065b2f2ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=72c85a3c46034521a4025c09bc742aec)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:30:51.160979 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85d038-0749-4064-9f88-56b065b2f2ce admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:30:51.307983 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-0a85d038-0749-4064-9f88-56b065b2f2ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72c85a3c46034521a4025c09bc742aec', 'request_id': 'req-0a85d038-0749-4064-9f88-56b065b2f2ce'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:51.398898 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-0a85d038-0749-4064-9f88-56b065b2f2ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72c85a3c46034521a4025c09bc742aec', 'request_id': 'req-0a85d038-0749-4064-9f88-56b065b2f2ce'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:51.404619 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-0a85d038-0749-4064-9f88-56b065b2f2ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72c85a3c46034521a4025c09bc742aec', 'request_id': 'req-0a85d038-0749-4064-9f88-56b065b2f2ce'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:51.415525 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-0a85d038-0749-4064-9f88-56b065b2f2ce admin admin] The token cache is being invalidate because project 72c85a3c46034521a4025c09bc742aec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:30:51.424928 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-0a85d038-0749-4064-9f88-56b065b2f2ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:51.424928 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-0a85d038-0749-4064-9f88-56b065b2f2ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:51.424928 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1465/2902] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:30:51 2022] DELETE /identity/v3/projects/72c85a3c46034521a4025c09bc742aec => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:30:51.425252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b193c5c-4e2f-4e2c-831d-ff3ba633a11f admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:30:51.425252 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-0b193c5c-4e2f-4e2c-831d-ff3ba633a11f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:30:51.436614 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b193c5c-4e2f-4e2c-831d-ff3ba633a11f admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:30:51.491185 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa9d42-a21c-4a51-8f9c-23adebf77680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:30:51.492044 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa9d42-a21c-4a51-8f9c-23adebf77680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:30:51.492324 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa9d42-a21c-4a51-8f9c-23adebf77680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:30:51.492600 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa9d42-a21c-4a51-8f9c-23adebf77680 admin admin] PATH_INFO: `/v3/users/e00a30538d874af1ac1cffdd7611c15f` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:30:51.494590 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa9d42-a21c-4a51-8f9c-23adebf77680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00a30538d874af1ac1cffdd7611c15f)` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:30:51.496534 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa9d42-a21c-4a51-8f9c-23adebf77680 admin admin] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:30:51.726493 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-53fa9d42-a21c-4a51-8f9c-23adebf77680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00a30538d874af1ac1cffdd7611c15f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:51.728287 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-53fa9d42-a21c-4a51-8f9c-23adebf77680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00a30538d874af1ac1cffdd7611c15f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:51.741652 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-53fa9d42-a21c-4a51-8f9c-23adebf77680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00a30538d874af1ac1cffdd7611c15f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:51.749472 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-53fa9d42-a21c-4a51-8f9c-23adebf77680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00a30538d874af1ac1cffdd7611c15f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:51.804629 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.notifications [None req-53fa9d42-a21c-4a51-8f9c-23adebf77680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00a30538d874af1ac1cffdd7611c15f'} {{(pid=79468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:51.811523 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1438/2903] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Feb 16 17:30:51 2022] DELETE /identity/v3/users/e00a30538d874af1ac1cffdd7611c15f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 17:30:52.079479 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85d038-0749-4064-9f88-56b065b2f2ce admin admin] Authenticating user token {{(pid=79469) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:30:52.081044 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.fernet_utils [None req-0a85d038-0749-4064-9f88-56b065b2f2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79469) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:30:52.098628 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85d038-0749-4064-9f88-56b065b2f2ce admin admin] Validating token access rules against request {{(pid=79469) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:30:52.156987 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7e7c7-8bbc-4140-8303-a191ec24ce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96481fed12c49429f583e04dace6093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604997d855554910a2aa75344774960d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79469) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:30:52.157837 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7e7c7-8bbc-4140-8303-a191ec24ce2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:30:52.158118 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7e7c7-8bbc-4140-8303-a191ec24ce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:30:52.158412 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7e7c7-8bbc-4140-8303-a191ec24ce2b admin admin] PATH_INFO: `/v3/projects/1deeef01c98647659e70b135c79bf0d6` {{(pid=79469) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:30:52.159597 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7e7c7-8bbc-4140-8303-a191ec24ce2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1deeef01c98647659e70b135c79bf0d6)` {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:30:52.161515 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7e7c7-8bbc-4140-8303-a191ec24ce2b admin admin] RBAC: Authorization granted {{(pid=79469) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:30:52.255923 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-a3d7e7c7-8bbc-4140-8303-a191ec24ce2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1deeef01c98647659e70b135c79bf0d6', 'request_id': 'req-a3d7e7c7-8bbc-4140-8303-a191ec24ce2b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:52.324613 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-a3d7e7c7-8bbc-4140-8303-a191ec24ce2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1deeef01c98647659e70b135c79bf0d6', 'request_id': 'req-a3d7e7c7-8bbc-4140-8303-a191ec24ce2b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:52.330295 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-a3d7e7c7-8bbc-4140-8303-a191ec24ce2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1deeef01c98647659e70b135c79bf0d6', 'request_id': 'req-a3d7e7c7-8bbc-4140-8303-a191ec24ce2b'} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:52.342368 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-a3d7e7c7-8bbc-4140-8303-a191ec24ce2b admin admin] The token cache is being invalidate because project 1deeef01c98647659e70b135c79bf0d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79469) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 17:30:52.342815 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-a3d7e7c7-8bbc-4140-8303-a191ec24ce2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:52.343305 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: DEBUG keystone.notifications [None req-a3d7e7c7-8bbc-4140-8303-a191ec24ce2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79469) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 17:30:52.344839 dv-cinder-829565-2-iscsi devstack@keystone.service[79469]: [pid: 79469|app: 0|req: 1466/2904] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Feb 16 17:30:52 2022] DELETE /identity/v3/projects/1deeef01c98647659e70b135c79bf0d6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 17:33:04.714804 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa9d42-a21c-4a51-8f9c-23adebf77680 admin admin] Authenticating user token {{(pid=79468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:33:04.716229 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-53fa9d42-a21c-4a51-8f9c-23adebf77680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:33:04.853979 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa9d42-a21c-4a51-8f9c-23adebf77680 admin admin] Validating token access rules against request {{(pid=79468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:33:04.910422 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c8aa5-1894-4f8c-aa5b-2c81cfc353fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae711b94b32a431ab880aa8f6068ff25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6160f9606d06486b9a11a23ee717af79', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:33:04.911106 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c8aa5-1894-4f8c-aa5b-2c81cfc353fd service placement] REQUEST_METHOD: `GET` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:33:04.911385 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c8aa5-1894-4f8c-aa5b-2c81cfc353fd service placement] SCRIPT_NAME: `/identity` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:33:04.911661 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c8aa5-1894-4f8c-aa5b-2c81cfc353fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:33:04.913429 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.fernet_utils [None req-614c8aa5-1894-4f8c-aa5b-2c81cfc353fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:33:04.924983 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c8aa5-1894-4f8c-aa5b-2c81cfc353fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:33:04.926549 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c8aa5-1894-4f8c-aa5b-2c81cfc353fd service placement] RBAC: Authorization granted {{(pid=79468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:33:04.936465 dv-cinder-829565-2-iscsi devstack@keystone.service[79468]: [pid: 79468|app: 0|req: 1439/2905] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Feb 16 17:33:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)